Wednesday, 2019-12-04

sean-k-mooneywe shoudl not put the instance in error state because we were not able to get the diagnositcs right00:00
eanderssonsure this would only be for the scheduling event00:00
eanderssonsince mandatory is per message not per queue00:00
sean-k-mooneyits per type of rpc call we do00:01
sean-k-mooneye.g. you set it in your argmuent to send00:01
sean-k-mooneyif we pass mandaroy on all topic sends then we woudl ahve to deally with it constently for ever api action that needs to call the compute node00:02
sean-k-mooneyif we dont set it gloably for all topic sends we need to consdider how to handel the failure specific for each action00:03
sean-k-mooneyeandersson: in the specifc case of server create. if the downcall form the condutor to the compute failed to send you would like us to retry the next compute node correct.00:06
sean-k-mooneyif we set the instance to error at that point we would not retry00:07
sean-k-mooneyif we did retry i think we would still want to incremetn the failed boot counter for the compute node so the BuildFailureWeigher can avoid that host and log an error at a minium00:09
eanderssonSorry stepping away again. Btw we got a ton of open positions if anyone wants to come and help me work on this stuff. :p00:09
sean-k-mooneyno worries im about to call it a night anyway00:10
*** tbachman has quit IRC00:26
*** mlavalle has quit IRC00:37
*** sapd1 has joined #openstack-nova00:42
*** ociuhandu has joined #openstack-nova00:51
*** ociuhandu has quit IRC00:56
*** tosky has quit IRC00:56
*** zhanglong has joined #openstack-nova00:57
*** Liang__ has joined #openstack-nova01:02
*** zhanglong has quit IRC01:06
*** zhanglong has joined #openstack-nova01:08
*** zhanglong has quit IRC01:17
*** zhanglong has joined #openstack-nova01:20
*** zhanglong has quit IRC01:28
*** zhanglong has joined #openstack-nova01:30
*** zhanglong has quit IRC01:36
*** sapd1 has quit IRC01:38
*** dpawlik has joined #openstack-nova01:40
*** sorrison has quit IRC01:42
*** zhanglong has joined #openstack-nova01:42
*** igordc has quit IRC01:44
*** sorrison has joined #openstack-nova01:44
openstackgerritGhanshyam Mann proposed openstack/nova master: Pass the target in os-services APIs policy  https://review.opendev.org/67668801:45
*** dpawlik has quit IRC01:45
openstackgerritGhanshyam Mann proposed openstack/nova master: Add test coverage of existing admin_actions policies  https://review.opendev.org/65769801:45
*** hamzy has joined #openstack-nova01:47
*** igordc has joined #openstack-nova01:51
*** KeithMnemonic has quit IRC01:52
*** zhanglong has quit IRC01:54
*** zhanglong has joined #openstack-nova01:56
*** dklyle has quit IRC01:58
*** ociuhandu has joined #openstack-nova02:03
*** ociuhandu has quit IRC02:08
*** tbachman has joined #openstack-nova02:08
*** dklyle has joined #openstack-nova02:11
openstackgerritBoxiang Zhu proposed openstack/nova master: Make evacuation respects anti-affinity rule  https://review.opendev.org/64996302:22
*** gyee has quit IRC02:25
*** slaweq has joined #openstack-nova02:26
eanderssonRestart rmq and rebuilt it. Lets see if the issue goes away.02:27
openstackgerritBoxiang Zhu proposed openstack/nova master: Fix live migration break group policy simultaneously  https://review.opendev.org/65196902:29
*** slaweq has quit IRC02:30
*** chenhaw has joined #openstack-nova02:33
*** slaweq has joined #openstack-nova02:40
*** igordc has quit IRC02:43
*** ociuhandu has joined #openstack-nova02:43
*** mdbooth has quit IRC02:44
*** slaweq has quit IRC02:44
*** mdbooth has joined #openstack-nova02:45
*** ociuhandu has quit IRC02:52
*** abhishekk has joined #openstack-nova02:57
*** slaweq has joined #openstack-nova02:58
*** slaweq has quit IRC03:03
openstackgerritBrin Zhang proposed openstack/nova master: PoC: Support re-configure the delete_on_termination in server  https://review.opendev.org/69382803:04
*** slaweq has joined #openstack-nova03:11
*** slaweq has quit IRC03:16
*** mkrai has joined #openstack-nova03:22
eanderssonsean-k-mooney yea I would prefer it to retry and write an error to the logs, but probably cleaner and easier to implement it to stop and put the instance into an ERROR'd state instead.03:24
eanderssonI am gonna see if I can set up something like Terraform to better handle instances stuck in BUILDING03:25
eanderssonI think out of the box it gets stuck in a weird state, but I am sure there is a way to have Terraform handle issues like this more gracefully.03:25
*** mkrai_ has joined #openstack-nova03:27
*** slaweq has joined #openstack-nova03:29
*** mkrai has quit IRC03:30
*** slaweq has quit IRC03:34
*** johnthetubaguy has quit IRC03:42
*** udesale has joined #openstack-nova03:42
*** slaweq has joined #openstack-nova03:44
*** slaweq has quit IRC03:49
*** ociuhandu has joined #openstack-nova03:54
openstackgerritjichenjc proposed openstack/nova master: libvirt: avoid cpu check at s390x arch  https://review.opendev.org/69622803:59
*** ociuhandu has quit IRC04:01
*** slaweq has joined #openstack-nova04:02
*** slaweq has quit IRC04:06
*** bhagyashris has joined #openstack-nova04:09
*** mkrai_ has quit IRC04:22
*** mkrai has joined #openstack-nova04:22
*** jmlowe has quit IRC04:37
*** jmlowe has joined #openstack-nova04:39
*** dasp has quit IRC04:41
*** dasp has joined #openstack-nova04:41
*** slaweq has joined #openstack-nova04:59
*** abhishekk has quit IRC05:01
*** abhishekk has joined #openstack-nova05:03
*** slaweq has quit IRC05:03
openstackgerritjichenjc proposed openstack/nova master: downgrade when host does not support capabilities  https://review.opendev.org/69722805:05
*** slaweq has joined #openstack-nova05:11
*** dave-mccowan has quit IRC05:14
*** slaweq has quit IRC05:15
*** boxiang_ has joined #openstack-nova05:16
*** bhagyashris has quit IRC05:18
*** bhagyashris has joined #openstack-nova05:19
*** boxiang has quit IRC05:19
*** yaawang has quit IRC05:20
*** yaawang has joined #openstack-nova05:20
*** lbragstad_ has joined #openstack-nova05:27
*** lbragstad has quit IRC05:28
*** slaweq has joined #openstack-nova05:29
*** lbragstad has joined #openstack-nova05:30
*** ociuhandu has joined #openstack-nova05:30
*** lbragstad_ has quit IRC05:31
*** larainema has joined #openstack-nova05:34
*** slaweq has quit IRC05:34
*** ociuhandu has quit IRC05:35
*** lbragstad_ has joined #openstack-nova05:39
*** lbragstad has quit IRC05:41
*** dpawlik has joined #openstack-nova05:42
*** dpawlik has quit IRC05:47
openstackgerritBrin Zhang proposed openstack/nova-specs master: Support re-configure deleted_on_termination in server  https://review.opendev.org/58033605:47
*** slaweq has joined #openstack-nova05:52
*** abhishekk has quit IRC05:56
*** slaweq has quit IRC05:57
*** pcaruana has joined #openstack-nova06:01
*** udesale has quit IRC06:03
*** bhagyashris has quit IRC06:10
*** slaweq has joined #openstack-nova06:13
*** mkrai has quit IRC06:14
*** slaweq has quit IRC06:17
*** bhagyashris has joined #openstack-nova06:25
*** slaweq has joined #openstack-nova06:29
*** links has joined #openstack-nova06:31
*** maciejjozefczyk has joined #openstack-nova06:33
*** slaweq has quit IRC06:34
*** udesale has joined #openstack-nova06:37
*** sorrison has quit IRC06:39
*** dpawlik has joined #openstack-nova06:45
*** brinzhang has joined #openstack-nova06:46
openstackgerritOpenStack Proposal Bot proposed openstack/nova master: Imported Translations from Zanata  https://review.opendev.org/69471706:46
*** sapd1 has joined #openstack-nova06:48
*** sorrison has joined #openstack-nova06:52
*** Luzi has joined #openstack-nova06:53
*** bhagyashris_ has joined #openstack-nova06:58
*** bhagyashris has quit IRC07:00
*** boxiang has joined #openstack-nova07:01
*** boxiang_ has quit IRC07:02
*** ociuhandu has joined #openstack-nova07:03
*** chenhaw has quit IRC07:06
*** sorrison has quit IRC07:06
*** ociuhandu has quit IRC07:08
*** rcernin has quit IRC07:09
*** sorrison has joined #openstack-nova07:09
*** chenhaw has joined #openstack-nova07:10
*** sorrison has quit IRC07:14
*** chenhaw has quit IRC07:15
*** chenhaw has joined #openstack-nova07:16
*** sorrison has joined #openstack-nova07:27
*** boxiang_ has joined #openstack-nova07:28
*** boxiang has quit IRC07:31
*** yaawang has quit IRC07:31
*** yaawang has joined #openstack-nova07:32
*** damien_r has quit IRC07:35
openstackgerritjichenjc proposed openstack/nova master: libvirt: avoid cpu check at s390x arch  https://review.opendev.org/69622807:37
*** chenhaw has quit IRC07:39
*** chenhaw has joined #openstack-nova07:45
*** boxiang_ has quit IRC07:46
*** boxiang has joined #openstack-nova07:46
*** boxiang has quit IRC07:47
*** slaweq has joined #openstack-nova07:49
openstackgerritLuyao Zhong proposed openstack/nova master: support live migration with vpmems  https://review.opendev.org/68785607:56
*** chenhaw has quit IRC07:56
*** sorrison has quit IRC07:56
*** ygk_12345 has joined #openstack-nova07:57
*** ygk_12345 has left #openstack-nova07:58
*** sorrison has joined #openstack-nova07:59
*** tesseract has joined #openstack-nova08:00
*** dpawlik has quit IRC08:01
*** shilpasd has quit IRC08:02
*** chenhaw has joined #openstack-nova08:15
*** awalende has joined #openstack-nova08:15
*** tkajinam has quit IRC08:17
*** lpetrut has joined #openstack-nova08:17
*** lpetrut has quit IRC08:23
*** kashyap has quit IRC08:23
*** spotz has quit IRC08:23
*** tesseract has quit IRC08:24
*** pcaruana has quit IRC08:24
*** Liang__ has quit IRC08:24
*** abaindur has quit IRC08:24
*** jamesdenton has quit IRC08:24
*** jlvillal has quit IRC08:24
*** mgariepy has quit IRC08:24
*** johanssone has quit IRC08:24
*** factor has quit IRC08:24
*** Jeffrey4l has quit IRC08:24
*** bbowen has quit IRC08:24
*** elod has quit IRC08:24
*** lennyb has quit IRC08:24
*** tbarron has quit IRC08:24
*** hoonetorg has quit IRC08:24
*** irclogbot_3 has quit IRC08:24
*** bnemec has quit IRC08:24
*** benj_ has quit IRC08:24
*** klindgren_ has quit IRC08:24
*** corvus has quit IRC08:24
*** ianw has quit IRC08:24
*** sapd1_ has quit IRC08:24
*** efried has quit IRC08:24
*** dosaboy has quit IRC08:24
*** canori01 has quit IRC08:24
*** ceryx has quit IRC08:24
*** eandersson has quit IRC08:24
*** stephenfin has quit IRC08:24
*** aspiers has quit IRC08:24
*** zer0c00l has quit IRC08:24
*** szaher has quit IRC08:24
*** obre has quit IRC08:24
*** larsks has quit IRC08:24
*** Vek has quit IRC08:24
*** sorrison has quit IRC08:24
*** brinzhang has quit IRC08:24
*** maciejjozefczyk has quit IRC08:24
*** lbragstad_ has quit IRC08:24
*** dasp has quit IRC08:24
*** jmlowe has quit IRC08:24
*** zhanglong has quit IRC08:24
*** hamzy has quit IRC08:24
*** liuyulong has quit IRC08:24
*** gshippey has quit IRC08:24
*** jbernard has quit IRC08:24
*** yikun has quit IRC08:24
*** larainema has quit IRC08:24
*** Roamer` has quit IRC08:24
*** mugsie has quit IRC08:24
*** donnyd has quit IRC08:24
*** df_sbr has quit IRC08:24
*** jdillaman has quit IRC08:24
*** rmk has quit IRC08:24
*** owalsh has quit IRC08:24
*** Li_Liu has quit IRC08:24
*** TheJulia has quit IRC08:24
*** mnasiadka has quit IRC08:24
*** rpittau|afk has quit IRC08:24
*** gregwork has quit IRC08:24
*** toanster has quit IRC08:24
*** bcm has quit IRC08:24
*** frickler has quit IRC08:24
*** masayukig has quit IRC08:24
*** _erlon_ has quit IRC08:24
*** pas-ha has quit IRC08:24
*** chenhaw has quit IRC08:24
*** yaawang has quit IRC08:24
*** tbachman has quit IRC08:24
*** aloga has quit IRC08:24
*** trident has quit IRC08:24
*** gibi has quit IRC08:24
*** rnoriega_ has quit IRC08:24
*** _gryf_ has quit IRC08:24
*** d34dh0r53 has quit IRC08:24
*** openstackgerrit has quit IRC08:24
*** mtreinish has quit IRC08:24
*** antonym has quit IRC08:24
*** amorin has quit IRC08:24
*** brtknr has quit IRC08:24
*** evrardjp has quit IRC08:24
*** bhagyashris_ has quit IRC08:24
*** links has quit IRC08:24
*** zbr has quit IRC08:24
*** fnordahl has quit IRC08:24
*** jkulik has quit IRC08:24
*** StevenK has quit IRC08:24
*** cmurphy has quit IRC08:24
*** mgoddard has quit IRC08:24
*** logan- has quit IRC08:24
*** adrianc has quit IRC08:24
*** dtantsur|afk has quit IRC08:24
*** mloza has quit IRC08:24
*** alex_xu has quit IRC08:24
*** markmcclain has quit IRC08:24
*** mmethot has quit IRC08:24
*** smcginnis has quit IRC08:24
*** samc-bbc has quit IRC08:24
*** haleyb has quit IRC08:24
*** yankcrime has quit IRC08:24
*** nicholas has quit IRC08:24
*** amotoki has quit IRC08:24
*** Anticimex has quit IRC08:24
*** coreycb has quit IRC08:24
*** knikolla has quit IRC08:24
*** ildikov has quit IRC08:24
*** ttx has quit IRC08:24
*** awalende has quit IRC08:24
*** tinwood has quit IRC08:24
*** rouk has quit IRC08:24
*** jroll has quit IRC08:24
*** francoisp has quit IRC08:24
*** Alon_KS has quit IRC08:24
*** gouthamr has quit IRC08:24
*** bauzas has quit IRC08:24
*** pots has quit IRC08:24
*** fungi has quit IRC08:24
*** rajinir has quit IRC08:24
*** mmedvede has quit IRC08:24
*** gmann has quit IRC08:24
*** cz2 has quit IRC08:24
*** dustinc has quit IRC08:24
*** DinaBelova has quit IRC08:24
*** slaweq has quit IRC08:24
*** Luzi has quit IRC08:24
*** sapd1 has quit IRC08:24
*** udesale has quit IRC08:24
*** mdbooth has quit IRC08:24
*** eharney has quit IRC08:24
*** jangutter has quit IRC08:24
*** tetsuro_ has quit IRC08:24
*** jistr has quit IRC08:24
*** gryf has quit IRC08:24
*** panda has quit IRC08:24
*** mvkr has quit IRC08:24
*** adriant has quit IRC08:24
*** sean-k-mooney has quit IRC08:24
*** tonyb has quit IRC08:24
*** kaisers has quit IRC08:24
*** kukacz_ has quit IRC08:24
*** purplerbot has quit IRC08:24
*** lyarwood has quit IRC08:24
*** aarents has quit IRC08:24
*** lchabert has quit IRC08:24
*** ioni has quit IRC08:24
*** cgoncalves has quit IRC08:24
*** dansmith has quit IRC08:24
*** tobberydberg has quit IRC08:24
*** gary_perkins has quit IRC08:24
*** ericyoung has quit IRC08:24
*** tristanC has quit IRC08:24
*** arxcruz has quit IRC08:24
*** jhesketh has quit IRC08:24
*** kevinbenton has quit IRC08:24
*** NostawRm has quit IRC08:24
*** hemna_ has quit IRC08:24
*** ebbex has quit IRC08:24
*** noonedeadpunk has quit IRC08:24
*** dtruong has quit IRC08:24
*** andreaf has quit IRC08:24
*** diconico07 has quit IRC08:24
*** csatari has quit IRC08:24
*** johnsom has quit IRC08:24
*** portdirect has quit IRC08:24
*** jungleboyj has quit IRC08:24
*** dklyle has quit IRC08:24
*** vesper11 has quit IRC08:24
*** huaqiang has quit IRC08:24
*** brault has quit IRC08:24
*** ircuser-1 has quit IRC08:24
*** davee_ has quit IRC08:24
*** jrosser has quit IRC08:24
*** ganso has quit IRC08:24
*** luyao has quit IRC08:24
*** mgagne has quit IRC08:24
*** lifeless has quit IRC08:24
*** zzzeek has quit IRC08:24
*** guilhermesp has quit IRC08:24
*** tonyb[m] has quit IRC08:24
*** mordred has quit IRC08:24
*** ab-a has quit IRC08:24
*** arne_wiebalck has quit IRC08:24
*** vdrok has quit IRC08:24
*** mnaser has quit IRC08:24
*** NobodyCam has quit IRC08:24
*** rm_work has quit IRC08:24
*** melwitt has quit IRC08:24
*** Hazelesque has quit IRC08:24
*** awestin1 has quit IRC08:24
*** ChanServ has quit IRC08:24
*** awalende has joined #openstack-nova08:24
*** chenhaw has joined #openstack-nova08:24
*** tesseract has joined #openstack-nova08:24
*** sorrison has joined #openstack-nova08:24
*** slaweq has joined #openstack-nova08:24
*** yaawang has joined #openstack-nova08:24
*** bhagyashris_ has joined #openstack-nova08:24
*** Luzi has joined #openstack-nova08:24
*** sapd1 has joined #openstack-nova08:24
*** brinzhang has joined #openstack-nova08:24
*** udesale has joined #openstack-nova08:24
*** maciejjozefczyk has joined #openstack-nova08:24
*** links has joined #openstack-nova08:24
*** pcaruana has joined #openstack-nova08:24
*** lbragstad_ has joined #openstack-nova08:24
*** larainema has joined #openstack-nova08:24
*** dasp has joined #openstack-nova08:24
*** jmlowe has joined #openstack-nova08:24
*** mdbooth has joined #openstack-nova08:24
*** dklyle has joined #openstack-nova08:24
*** tbachman has joined #openstack-nova08:24
*** zhanglong has joined #openstack-nova08:24
*** hamzy has joined #openstack-nova08:24
*** Liang__ has joined #openstack-nova08:24
*** abaindur has joined #openstack-nova08:24
*** francoisp has joined #openstack-nova08:24
*** vesper11 has joined #openstack-nova08:24
*** eharney has joined #openstack-nova08:24
*** jamesdenton has joined #openstack-nova08:24
*** jhesketh has joined #openstack-nova08:24
*** jlvillal has joined #openstack-nova08:24
*** aloga has joined #openstack-nova08:24
*** trident has joined #openstack-nova08:24
*** liuyulong has joined #openstack-nova08:24
*** mgariepy has joined #openstack-nova08:24
*** zbr has joined #openstack-nova08:24
*** huaqiang has joined #openstack-nova08:24
*** gshippey has joined #openstack-nova08:24
*** Roamer` has joined #openstack-nova08:24
*** jangutter has joined #openstack-nova08:24
*** gibi has joined #openstack-nova08:24
*** johanssone has joined #openstack-nova08:24
*** tetsuro_ has joined #openstack-nova08:24
*** brault has joined #openstack-nova08:24
*** jkulik has joined #openstack-nova08:24
*** ircuser-1 has joined #openstack-nova08:24
*** jbernard has joined #openstack-nova08:24
*** davee_ has joined #openstack-nova08:24
*** yikun has joined #openstack-nova08:24
*** jistr has joined #openstack-nova08:24
*** factor has joined #openstack-nova08:24
*** fnordahl has joined #openstack-nova08:24
*** gryf has joined #openstack-nova08:24
*** cmurphy has joined #openstack-nova08:24
*** Jeffrey4l has joined #openstack-nova08:24
*** StevenK has joined #openstack-nova08:24
*** mugsie has joined #openstack-nova08:24
*** tinwood has joined #openstack-nova08:24
*** jrosser has joined #openstack-nova08:24
*** donnyd has joined #openstack-nova08:24
*** df_sbr has joined #openstack-nova08:24
*** rouk has joined #openstack-nova08:24
*** jroll has joined #openstack-nova08:24
*** ganso has joined #openstack-nova08:24
*** ttx has joined #openstack-nova08:24
*** bbowen has joined #openstack-nova08:24
*** pas-ha has joined #openstack-nova08:24
*** _erlon_ has joined #openstack-nova08:24
*** masayukig has joined #openstack-nova08:24
*** frickler has joined #openstack-nova08:24
*** bcm has joined #openstack-nova08:24
*** toanster has joined #openstack-nova08:24
*** gregwork has joined #openstack-nova08:24
*** rpittau has joined #openstack-nova08:24
*** mnasiadka has joined #openstack-nova08:24
*** Li_Liu has joined #openstack-nova08:24
*** TheJulia has joined #openstack-nova08:24
*** owalsh has joined #openstack-nova08:24
*** rmk has joined #openstack-nova08:24
*** jdillaman has joined #openstack-nova08:24
*** mgoddard has joined #openstack-nova08:24
*** tbarron has joined #openstack-nova08:24
*** elod has joined #openstack-nova08:24
*** logan- has joined #openstack-nova08:24
*** adrianc has joined #openstack-nova08:24
*** lennyb has joined #openstack-nova08:24
*** spotz has joined #openstack-nova08:24
*** kashyap has joined #openstack-nova08:24
*** panda has joined #openstack-nova08:24
*** mvkr has joined #openstack-nova08:24
*** luyao has joined #openstack-nova08:24
*** hoonetorg has joined #openstack-nova08:24
*** dtantsur|afk has joined #openstack-nova08:24
*** alex_xu has joined #openstack-nova08:24
*** mloza has joined #openstack-nova08:24
*** rnoriega_ has joined #openstack-nova08:24
*** Alon_KS has joined #openstack-nova08:24
*** gouthamr has joined #openstack-nova08:24
*** _gryf_ has joined #openstack-nova08:24
*** bauzas has joined #openstack-nova08:24
*** adriant has joined #openstack-nova08:24
*** d34dh0r53 has joined #openstack-nova08:24
*** openstackgerrit has joined #openstack-nova08:24
*** sean-k-mooney has joined #openstack-nova08:24
*** markmcclain has joined #openstack-nova08:24
*** tonyb has joined #openstack-nova08:24
*** mmethot has joined #openstack-nova08:24
*** kaisers has joined #openstack-nova08:24
*** irclogbot_3 has joined #openstack-nova08:24
*** bnemec has joined #openstack-nova08:24
*** benj_ has joined #openstack-nova08:24
*** klindgren_ has joined #openstack-nova08:24
*** pots has joined #openstack-nova08:24
*** smcginnis has joined #openstack-nova08:24
*** corvus has joined #openstack-nova08:24
*** samc-bbc has joined #openstack-nova08:24
*** mgagne has joined #openstack-nova08:24
*** kukacz_ has joined #openstack-nova08:24
*** ianw has joined #openstack-nova08:24
*** haleyb has joined #openstack-nova08:24
*** tonyb[m] has joined #openstack-nova08:24
*** sapd1_ has joined #openstack-nova08:24
*** lifeless has joined #openstack-nova08:24
*** efried has joined #openstack-nova08:24
*** yankcrime has joined #openstack-nova08:24
*** evrardjp has joined #openstack-nova08:24
*** brtknr has joined #openstack-nova08:24
*** amorin has joined #openstack-nova08:24
*** antonym has joined #openstack-nova08:24
*** mtreinish has joined #openstack-nova08:24
*** zzzeek has joined #openstack-nova08:24
*** guilhermesp has joined #openstack-nova08:24
*** ildikov has joined #openstack-nova08:24
*** knikolla has joined #openstack-nova08:24
*** coreycb has joined #openstack-nova08:24
*** Anticimex has joined #openstack-nova08:24
*** amotoki has joined #openstack-nova08:24
*** nicholas has joined #openstack-nova08:24
*** purplerbot has joined #openstack-nova08:24
*** dosaboy has joined #openstack-nova08:24
*** canori01 has joined #openstack-nova08:24
*** eandersson has joined #openstack-nova08:24
*** ceryx has joined #openstack-nova08:24
*** lyarwood has joined #openstack-nova08:24
*** ioni has joined #openstack-nova08:24
*** fungi has joined #openstack-nova08:24
*** aarents has joined #openstack-nova08:24
*** rajinir has joined #openstack-nova08:24
*** mordred has joined #openstack-nova08:24
*** stephenfin has joined #openstack-nova08:24
*** lchabert has joined #openstack-nova08:24
*** ab-a has joined #openstack-nova08:24
*** aspiers has joined #openstack-nova08:24
*** cgoncalves has joined #openstack-nova08:24
*** dtruong has joined #openstack-nova08:24
*** zer0c00l has joined #openstack-nova08:24
*** szaher has joined #openstack-nova08:24
*** andreaf has joined #openstack-nova08:24
*** obre has joined #openstack-nova08:24
*** dansmith has joined #openstack-nova08:24
*** larsks has joined #openstack-nova08:24
*** Vek has joined #openstack-nova08:24
*** tobberydberg has joined #openstack-nova08:24
*** diconico07 has joined #openstack-nova08:24
*** noonedeadpunk has joined #openstack-nova08:24
*** gary_perkins has joined #openstack-nova08:24
*** mmedvede has joined #openstack-nova08:24
*** ericyoung has joined #openstack-nova08:24
*** tristanC has joined #openstack-nova08:24
*** arxcruz has joined #openstack-nova08:24
*** cz2 has joined #openstack-nova08:24
*** gmann has joined #openstack-nova08:24
*** dustinc has joined #openstack-nova08:24
*** ChanServ has joined #openstack-nova08:24
*** arne_wiebalck has joined #openstack-nova08:24
*** vdrok has joined #openstack-nova08:24
*** NobodyCam has joined #openstack-nova08:24
*** mnaser has joined #openstack-nova08:24
*** rm_work has joined #openstack-nova08:24
*** melwitt has joined #openstack-nova08:24
*** Hazelesque has joined #openstack-nova08:24
*** awestin1 has joined #openstack-nova08:24
*** hemna_ has joined #openstack-nova08:24
*** jungleboyj has joined #openstack-nova08:24
*** NostawRm has joined #openstack-nova08:24
*** kevinbenton has joined #openstack-nova08:24
*** ebbex has joined #openstack-nova08:24
*** portdirect has joined #openstack-nova08:24
*** johnsom has joined #openstack-nova08:24
*** csatari has joined #openstack-nova08:24
*** DinaBelova has joined #openstack-nova08:24
*** orwell.freenode.net sets mode: +o ChanServ08:24
*** dpawlik has joined #openstack-nova08:28
*** chenhaw has quit IRC08:30
*** yaawang has quit IRC08:33
*** yaawang has joined #openstack-nova08:34
*** ivve has joined #openstack-nova08:36
*** damien_r has joined #openstack-nova08:38
*** damien_r has quit IRC08:39
*** damien_r has joined #openstack-nova08:39
*** mgoddard has quit IRC08:50
*** rcernin has joined #openstack-nova08:51
*** ralonsoh has joined #openstack-nova08:52
*** mgoddard has joined #openstack-nova08:54
*** mdbooth has quit IRC08:59
*** tosky has joined #openstack-nova09:00
openstackgerritSundar Nadathur proposed openstack/nova master: ksa auth conf and client for Cyborg access  https://review.opendev.org/63124209:08
openstackgerritSundar Nadathur proposed openstack/nova master: Add Cyborg device profile groups to request spec.  https://review.opendev.org/63124309:08
openstackgerritSundar Nadathur proposed openstack/nova master: Define Cyborg ARQ binding notification event.  https://review.opendev.org/69270709:08
openstackgerritSundar Nadathur proposed openstack/nova master: Create and bind Cyborg ARQs.  https://review.opendev.org/63124409:08
openstackgerritSundar Nadathur proposed openstack/nova master: Compose accelerator PCI devices into VM's domain XML.  https://review.opendev.org/63124509:08
openstackgerritSundar Nadathur proposed openstack/nova master: Delete ARQs for an instance when the instance is deleted.  https://review.opendev.org/67373509:08
*** ccamacho has joined #openstack-nova09:08
openstackgerritSundar Nadathur proposed openstack/nova master: Add cyborg tempest job.  https://review.opendev.org/67099909:08
*** mdbooth has joined #openstack-nova09:11
*** martinkennelly has joined #openstack-nova09:16
*** chenhaw has joined #openstack-nova09:21
*** sapd1 has quit IRC09:28
*** derekh has joined #openstack-nova09:34
*** PrinzElvis has joined #openstack-nova09:36
*** abaindur has quit IRC09:48
*** dpawlik has quit IRC09:49
*** bhagyashris has joined #openstack-nova09:50
*** rcernin has quit IRC09:53
*** bhagyashris_ has quit IRC09:53
*** mkrai has joined #openstack-nova09:57
openstackgerritStephen Finucane proposed openstack/nova master: nova-net: Remove remaining nova-network quotas  https://review.opendev.org/69715209:57
openstackgerritStephen Finucane proposed openstack/nova master: nova-net: Remove use of legacy 'FloatingIP' object  https://review.opendev.org/69715309:57
openstackgerritStephen Finucane proposed openstack/nova master: nova-net: Remove use of legacy 'Network' object  https://review.opendev.org/69715409:57
openstackgerritStephen Finucane proposed openstack/nova master: nova-net: Remove use of legacy 'SecurityGroup' object  https://review.opendev.org/69715509:57
openstackgerritStephen Finucane proposed openstack/nova master: nova-net: Remove unused nova-network objects  https://review.opendev.org/69715609:57
openstackgerritStephen Finucane proposed openstack/nova master: nova-net: Follow-up for I12a96ea659ed402cc4d1bd52a50e2e16042b6372  https://review.opendev.org/69725209:57
stephenfinbauzas: Care to get some of that nova-net removal goodness in ya this morning? https://review.opendev.org/#/c/696503/09:59
bauzasstephenfin: I could09:59
*** dpawlik has joined #openstack-nova10:02
*** dtantsur|afk is now known as dtantsur10:02
*** mkrai has quit IRC10:07
*** mkrai has joined #openstack-nova10:07
*** chenhaw has quit IRC10:08
*** brinzhang_ has joined #openstack-nova10:11
*** brinzhang has quit IRC10:13
*** chenhaw has joined #openstack-nova10:16
*** chenhaw has quit IRC10:19
*** tosky has quit IRC10:21
*** tosky has joined #openstack-nova10:21
*** Liang__ has quit IRC10:27
*** dtantsur is now known as dtantsur|brb10:30
openstackgerritLee Yarwood proposed openstack/nova stable/rocky: block_device: Copy original volume_type when missing for snapshot based volumes  https://review.opendev.org/69726010:36
openstackgerritLee Yarwood proposed openstack/nova stable/queens: block_device: Copy original volume_type when missing for snapshot based volumes  https://review.opendev.org/69726110:37
*** Luzi has quit IRC10:38
*** mkrai has quit IRC10:50
*** mkrai_ has joined #openstack-nova10:50
*** belmoreira has joined #openstack-nova10:59
*** mgoddard has quit IRC11:02
*** udesale has quit IRC11:07
*** mgoddard has joined #openstack-nova11:12
*** mgoddard has quit IRC11:12
*** lbragstad has joined #openstack-nova11:12
*** mgoddard has joined #openstack-nova11:13
*** lbragstad_ has quit IRC11:13
*** zbr_ has joined #openstack-nova11:14
*** zbr has quit IRC11:17
*** dpawlik has quit IRC11:19
*** rpittau is now known as rpittau|bbl11:27
openstackgerritThierry Carrez proposed openstack/nova master: Remove unused rootwrap filters  https://review.opendev.org/69713411:34
*** tbachman has quit IRC11:41
*** zhanglong has quit IRC11:43
*** dpawlik has joined #openstack-nova11:51
*** andreykurilin has joined #openstack-nova12:23
*** mkrai_ has quit IRC12:24
*** mkrai has joined #openstack-nova12:24
*** ociuhandu has joined #openstack-nova12:25
*** andreykurilin has left #openstack-nova12:26
*** andreykurilin has joined #openstack-nova12:27
*** avolkov has joined #openstack-nova12:27
*** mkrai has quit IRC12:29
*** artom has joined #openstack-nova12:31
*** dtantsur|brb is now known as dtantsur12:32
gibigmann: if you have time, this tempest fix would help with some of the tempest failures in CI https://review.opendev.org/#/c/68296412:34
*** damien_r has quit IRC12:35
*** ociuhandu has quit IRC12:36
efriedo/ gibi stephenfin, lend me your ears for a moment?12:42
gibiefried: I'm here but expect me to dissapeare randomly as I'm at the doctor's waiting room12:43
lyarwoodefried: I also think stephenfin is AFK at lunch at the moment btw12:44
efriedokay, thanks, I'll just leave this here then:12:46
efriedI'm working on this virtual TPM thing, trying to get the spec approved.12:46
efriedhttps://review.opendev.org/#/c/686804/12:46
efriedDan helped me get it to this point, but doesn't like some of the remaining oddness around snapshot-related operations.12:46
efriedHowever, he has implied that he won't stand in the way if others can get behind it.12:46
efriedSo... gibi and stephenfin, can you get behind it?12:46
*** larainema has quit IRC12:46
gibiefried: opened the spec. Let's see how ugly is the snapshot part12:47
*** PrinzElvis has quit IRC12:55
efriedgibi: I can tldr it for you:12:55
efriedThe vTPM belongs to the instance, not the image. So you can't do things like createImage to clone the VM and expect the vTPM to be cloned. (IMO this is sensible. Don't copy my security stuff around, please.)12:55
gibiyeah that seems reasonable. Do not leak secrete data between clones12:57
efriedSimilarly, if you do a rebuild, you keep your vTPM; you don't get whatever came from the new image.12:57
efriedWhatever's in the image might be expecting a given vTPM state that won't exist, but that's up to you to get right.12:58
efriedIn particular, we *do* save the vTPM state when you do createBackup12:58
efriedSo if you rebuild from that backup, we'll restore the vTPM as it existed at the point when you did the backup, which ought to maximize the chance that it's in the state the VM is expecting.12:59
gibiCan backups be used to clone a VM ?13:01
efriedtheoretically, yes, they do almost the same thing as createImage.13:01
efriedDocumentation would be the key here: If you're backing up, use createBackup; if you're cloning, use createImage.13:02
efriedWhich is what ops should be doing anyway, but I'm sure those get abused frequently today.13:02
efriedI think createBackup tries to maintain one image at a time, deleting the previous one any time you create a new one. Otherwise it's not different than createImage.13:03
gibiI see13:03
*** damien_r has joined #openstack-nova13:04
*** damien_r has quit IRC13:05
efriedSo the other two main quirks of concern are:13:05
efried- Evacuate doesn't restore your vTPM, sorry.13:05
efried- You have to do stuff as the instance owner. (IMO this is also good: my vTPM is secure stuff, I don't even want the admin to have access to it.)13:05
*** damien_r has joined #openstack-nova13:05
gibidoesn't shared disk + evacuate could keep the vTMP file? or the vTPM file is somewhere far from the instance disk?13:06
efriedthe latter :(13:06
efriedthe vTPM is maintained by libvirt13:07
efriednot in the instance13:07
gibiOK so it is some obscure location that the deployer won't share between compute hosts13:07
efriedwell13:07
gibianyhow this could be a future improvement in libvirt + nova13:07
efriedthe location is well known (though I'm not sure there's a contract that it won't change at some point)13:07
*** tbachman has joined #openstack-nova13:07
efriedtheoretically it may be possible for that directory to be shared13:07
gibiack13:07
efriedbut that would be up to the deployer to figure out, and I'm not going to do anything in nova to try to support (or prevent) it.13:08
gibisure13:08
gibimake sense13:08
gibiwhen you say "You have to do stuff as the instance owner" you mean nova needs to act in behalf of the instance owner to manage the vTPM or what is the stuff there?13:08
efriedcorrect13:09
*** dpawlik has quit IRC13:10
efriedNova needs to unlock the vTPM by defining a secret to libvirt when the guest is created13:10
efriedand, because security, the secret is owned by the instance owner; even the admin can't get at it.13:10
gibidoes it mean that the admin cannot delet the VM either?13:11
efriedProbably the most awkward of these areas is if you reboot the hypervisor, your VMs won't boot until the owner of the VM goes to boot them.13:11
efriedHm, interesting question.13:12
efriedThe admin won't be able to delete the secret in barbican, or the backup in swift13:12
efriedbut we don't have to make those error conditions.13:12
efriedSo the instance could still be destroyed, but those artifacts would be leaked in that case and the owner would have to go clean them up manually.13:12
gibibut then it means we leave junk around13:12
*** Liang__ has joined #openstack-nova13:13
efriedI'm not too sure how barbican/swift work in that regard. Maybe policy allows admins to delete things even if they don't own them. I guess that would make sense.13:13
*** dpawlik has joined #openstack-nova13:13
gibican we have some way out of this. I accep that the admin cannot read or write the vTPM data but cannot even delete when the user is potentially long gone?13:13
efriedyeah, I don't know that answer.13:14
gibiok, noting it down in the spec as question13:14
efriedNote that the folks asking for this (VMG) aren't actually using barbican, they have their own home-grown key manager.13:14
efriedSo I imagine they would be able to control that aspect of things.13:15
efriedI can find out whether swift has a similar policy capability. Thinking about it, I would imagine they do. It would only make sense that the admin, who could theoretically shut the whole thing down, should have the ability to delete individual bits, as long as they can't "see" them while they're doing it.13:16
gibiack, that could be a way out13:17
efriedOkay, so given all of that, do you think it is reasonable to support this thing, with proper documentation of these quirks?13:18
gibithe next step that the admin does is draining a compute to do some maintenance. I see that live migration works. that is good. It would be nice to have a way to cold migrate a VM even if it loses the vTPM data in the process13:18
gibiefried: I'm hesitant, as this is raw at the edges13:19
gibilet me go through the spec.13:19
efriedcold migrate works13:19
gibiohh13:19
gibicoolio13:19
efriedand shelve/unshelve (which uses snapshots) so cross-cell resize also works.13:20
gibiOK. let me read the spec, but it seems workable at least. And an admin can only disable the feature by not configuring it in the nova conf13:21
gibis/only/always/13:21
efriedyup13:22
efriedthanks gibi13:23
* efried ==> school run13:23
gibiefried: have fun!13:23
efriedenjoy your doc :)13:23
gibi... a long queue ...13:23
gibiit is the 4th hour I'm queueing...13:24
*** rpittau|bbl is now known as rpittau13:36
*** lbragstad_ has joined #openstack-nova13:38
*** brinzhang has joined #openstack-nova13:39
*** lbragstad has quit IRC13:39
*** mriedem has joined #openstack-nova13:42
*** brinzhang_ has quit IRC13:42
*** lbragstad has joined #openstack-nova13:46
*** eharney has quit IRC13:47
*** lbragstad_ has quit IRC13:48
efriedegads13:49
efriedDoes Hungary have a national health service like the UK?13:49
gibiyes, this is the type of service everyone gets automatically in Hungary13:50
efriedI remember the UK NHS being notoriously slow like that.13:50
sean-k-mooneyslow but free13:51
sean-k-mooneyand good once you are seen13:51
gibiI have a private issurance but it does not cover this type of follow up I have to do after my surgery I had the beginning of this year13:52
gibiso I sit and wait13:52
mriedemefried: i've invalidated https://bugs.launchpad.net/nova/+bug/1855015 since the jobs i'm looking at aren't failures for the most part13:53
openstackLaunchpad bug 1855015 in OpenStack Compute (nova) "Intermittent fails in nova-next job with "Multiple possible networks found, use a Network ID to be more specific."" [Undecided,Invalid]13:53
sean-k-mooneyefried: even without deleting the barbican key they can still do a vm delete right13:53
mriedemefried: there is a tempest test which is triggering the error in the api logs but the test handles the 400 response13:53
sean-k-mooneyand ya most service allow admins to delete stuff even if they dont own it so i suspect barbican and swift can do the same13:53
gibiefried, mriedem there is a fix for the tempest multiple network conflict https://review.opendev.org/#/c/68296413:54
efriedgood lord son, you posted two more comments and changed status while I was writing my response.13:54
*** lbragstad has quit IRC13:54
*** Liang__ is now known as LiangFang13:55
mriedemgotta be quick13:55
efriedgibi: thanks, they told me about that in -neutron13:55
efriedmriedem: okay if I reopen and mark as dup?13:55
*** lbragstad has joined #openstack-nova13:55
openstackgerritStephen Finucane proposed openstack/nova master: nova-net: Remove use of legacy 'FloatingIP' object  https://review.opendev.org/69715313:56
openstackgerritStephen Finucane proposed openstack/nova master: nova-net: Remove use of legacy 'Network' object  https://review.opendev.org/69715413:56
openstackgerritStephen Finucane proposed openstack/nova master: nova-net: Remove use of legacy 'SecurityGroup' object  https://review.opendev.org/69715513:56
openstackgerritStephen Finucane proposed openstack/nova master: nova-net: Remove unused nova-network objects  https://review.opendev.org/69715613:56
openstackgerritStephen Finucane proposed openstack/nova master: nova-net: Follow-up for I12a96ea659ed402cc4d1bd52a50e2e16042b6372  https://review.opendev.org/69725213:56
efriedmriedem: unclear why it would be invalid. It caused at least three patches to fail that I was looking directly at. The rest I didn't check explicitly, but no reason to believe it would be different.13:56
mriedemdupe against what?13:57
mriedemhttps://bugs.launchpad.net/tempest/+bug/1844568 ?13:57
openstackLaunchpad bug 1844568 in tempest "[compute] "create_test_server" if networks is undefined and more than one network is present" [Undecided,In progress] - Assigned to Rodolfo Alonso (rodolfo-alonso-hernandez)13:57
efriedyes13:57
mriedemsure go ahead13:57
*** links has quit IRC13:58
sean-k-mooneystephenfin: has your changes to _wait_for_state_change already merged13:58
gibiefried: comments in https://review.opendev.org/#/c/68680413:58
stephenfinsean-k-mooney: yes13:59
sean-k-mooneyok so i can drop the new class in that case but it means i have to do the rewite in the backport now13:59
efriedstephenfin: did you see vTPM conversation from earlier?13:59
stephenfinI did not13:59
efriedstephenfin: ~1h45m back14:00
stephenfinsean-k-mooney: You can...or you can just use the weird variant in the backports14:00
sean-k-mooneyno that is what i mean14:00
efried1h15, sorry14:00
sean-k-mooneyi need to use the version that takes the expected state in master and then rewrite it to use the move from state in the backports14:00
efriedgibi: thanks14:01
stephenfinsean-k-mooney: Yeah. It only needs to be done once though (the first backport) and should only result in 4 or 5 single line changes, I'd imagine14:01
stephenfinNot the end of the world14:01
stephenfinefried: Let me take a look after this meeting14:02
sean-k-mooneyit might be more involed then that but ya ill rebase everythin against master tehn ill start updatign the changes to make the difference clear14:03
openstackgerritsean mooney proposed openstack/nova master: Block rebuild when NUMA topology changed  https://review.opendev.org/68795714:03
openstackgerritsean mooney proposed openstack/nova master: Disable NUMATopologyFilter on rebuild  https://review.opendev.org/68986114:03
*** kashyap has quit IRC14:04
*** spotz has quit IRC14:04
sean-k-mooneyso that is just a rebase to master and ill work on the functional test changes now14:04
*** kashyap has joined #openstack-nova14:09
*** spotz has joined #openstack-nova14:09
*** belmoreira has quit IRC14:10
*** kashyap has quit IRC14:13
*** spotz has quit IRC14:13
mriedemi see our subunit parser failures are back on the rise14:15
mriedemlooks like this blew up https://zuul.opendev.org/t/openstack/build/d96bc0bfbb214661bcbb4b4e59b3d8bb/log/job-output.txt#301014:16
efriedgdi14:17
efriedhas anyone considered fixing subunit?14:17
sean-k-mooneyits not subunit its self14:17
sean-k-mooneyits how stestr is using it14:17
efriedhas anyone considered fixing stestr?14:17
sean-k-mooneywe are not fragmenting the packets properloy14:18
efriedMy point: It shouldn't be up to every consuming project to "not output so much"14:18
sean-k-mooneyright well we could just use pytest to run things but some people object to that too14:18
*** links has joined #openstack-nova14:19
*** kashyap has joined #openstack-nova14:19
*** spotz has joined #openstack-nova14:19
efriedis this a mtreinish thing?14:19
mriedemwell in this case something is obviously busted while this test is running14:20
mriedemone of the services is gone from the db for some reason, or the context it was using somehow - it's a multi-cell test so maybe it's looking in the wrong db14:20
mriedemso every 10 seconds when it reports it's state the service is not found14:20
mriedemand prints the traceback14:21
mtreinishefried: patches are more than welcome if you have a fix14:21
sean-k-mooneymtreinish: i think the issue is that its non triaival to figure out how stestr works to try and even start on the fix14:21
mtreinishsean-k-mooney: it's non trivial to figure out how subunit is working under the covers which is why I haven't had a fix for it yet14:22
mtreinishthe stream handling code is really hairy and mostly leftover from testr14:23
sean-k-mooneymtreinish: ya i treied to look at the stestr code to figure out how the subunit stream was being created to figure out where to fragment the packet but i got lost14:23
*** jraju__ has joined #openstack-nova14:24
openstackgerritMatt Riedemann proposed openstack/nova master: WIP: Implement cleanup_instance_network_on_host for neutron API  https://review.opendev.org/69716214:24
sean-k-mooneythat was partly because i was lookig at 2 codebase i dont undersantd and as you said the code is kind of hairy14:24
efriedokay, I wasn't criticizing you mtreinish, sorry if it came out that way. If you've already looked and it's "really hairy"...14:24
sean-k-mooneyefried: i know stephenfin melwitt and i all tried to figuire this out before and gave up14:25
*** links has quit IRC14:25
efriedI just remember several patches (from mriedem I think) that tried to chip away at the problem by reducing the amount of output from our tests.14:25
mtreinishyeah, also masayukig smcginnis and I also took a look into a couple years ago f2f at a summit and also gave up14:26
efriedgah14:26
mriedemregardless of subunit/stestr i don't think our tests should be spewing out a buttload of random tracebacks14:26
mriedemmasking that with fixing subunit/stestr somehow just papers over those issues14:26
sean-k-mooneyso the simple solution is to just use pytest or a non subunit based test runner but there are perfromace impacts to doing that14:26
mtreinishI have a PR which should workaround it I think: https://github.com/mtreinish/stestr/pull/271 but it introduces other behavior changes and isn't ready yet (and would be an opt-in mode)14:27
sean-k-mooneymtreinish: playing with the schduleiing did help in the past. i notced that grouping by class helped to some extent14:28
*** belmoreira has joined #openstack-nova14:29
mriedemoslo_messaging.exceptions.MessagingTimeout: No reply on topic conductor weee14:29
mriedemwe seem to have some fun eventlet issue in this failure as well14:29
mriedemhttps://gist.githubusercontent.com/mriedem/e01252253600abbef95045d73cfe2206/raw/67b6360c5766eb681cb3ad9e1901ff94fa152e98/gistfile1.txt14:31
sean-k-mooneyand some db errors " WARNING [nova.compute.manager] Failed to revert task state for instance. Error: (sqlite3.OperationalError) no such table: instance_extra'"14:31
mtreinishwhich review # and job is the failure happening on? I can take another stab at fixing the issue14:32
sean-k-mooney https://review.opendev.org/69716214:32
mriedemmtreinish: it's intermittent, we get all sorts of random stuff like this http://status.openstack.org/elastic-recheck/#1813147 and then we squash them as they crop up14:33
mriedemthe above gist is weird because the test is creating a server on compute1, the logs say it's ok, but the traceback looks like something is rescheduling to another host during build14:34
sean-k-mooneymtreinish: mriedem is not really changeing anything in that that would resonably cause those errors14:34
sean-k-mooneymriedem: could we be leaking some state betwween the different functional tests14:34
sean-k-mooneysuch that this fails only with some test orderings and passes with others14:35
mriedemyeah maybe but i don't see any other tests on the same worker that look like they would be doing reschedules14:35
mriedemanywho, recheck!14:36
sean-k-mooneythat was why grouping the test execution by class work to "fix" the issue in the past. i ment we did not hit the issue due to how the test were run14:36
mriedemwe could probably make that ServiceNotFound in the servicegroup api not a traceback so that if this fails again like this it doesn't blow up the subunit output parser14:36
sean-k-mooneywe didnt merge that since we actully found the problem and fixed it in that case14:37
*** mdbooth has quit IRC14:46
*** eharney has joined #openstack-nova14:46
*** nweinber has joined #openstack-nova14:47
*** mdbooth has joined #openstack-nova14:52
openstackgerritMatt Riedemann proposed openstack/nova master: Handle ServiceNotFound in DbDriver._report_state  https://review.opendev.org/69730114:53
*** tbachman has quit IRC14:53
*** bhagyashris has quit IRC15:01
*** dasp has quit IRC15:02
*** mriedem has quit IRC15:03
*** dasp has joined #openstack-nova15:03
*** mriedem has joined #openstack-nova15:04
*** lbragstad has quit IRC15:09
*** lbragstad has joined #openstack-nova15:10
*** jaosorior has joined #openstack-nova15:14
*** LiangFang has quit IRC15:19
*** udesale has joined #openstack-nova15:20
*** belmoreira has quit IRC15:21
*** dave-mccowan has joined #openstack-nova15:21
*** belmoreira has joined #openstack-nova15:24
*** dave-mccowan has quit IRC15:26
*** ivve has quit IRC15:33
*** tbachman has joined #openstack-nova15:39
dansmithefried: despite the fact that I dropped some comments on the request group patch about the testing mess, I'm going to mostly depend on you to ack the placementy request-group-y bit of that before I look too closely15:40
*** Sundar has joined #openstack-nova15:40
efrieddansmith: ack. It might depend on my series here https://review.opendev.org/#/q/status:open+project:openstack/nova+branch:master+topic:use-placement-1.3415:42
Sundardansmith: Thanks for the super-quick reviews.15:43
efriedbut, having been looking at that stuff pretty closely for the past week, I ought to be able to provide reasonable guidance in that regard :)15:43
*** awalende_ has joined #openstack-nova15:43
dansmithSundar: mmm, six hours later.. not super-quick :)15:44
*** ociuhandu has joined #openstack-nova15:45
Sundardansmith: I'll set higher standards for you going forward :P.15:45
dansmithSundar: fair warning, I have this gut feeling that you're missing a bunch of test coverage, but I'm not in that phase of review yet, so I'm not nitpicking all the conditionals15:46
*** awalende has quit IRC15:46
*** belmoreira has quit IRC15:47
Sundardansmith: ack, will look more into that.15:47
*** awalende_ has quit IRC15:48
stephenfinmriedem: comment on https://review.opendev.org/#/c/697122/15:49
*** brinzhang_ has joined #openstack-nova15:50
stephenfinCould I ask someone to go through the bottom few patches of the remove-nova-network series starting at [1]? There's a merge conflict coming and I'd rather not rebase/recheck the _entire_ queue [1] https://review.opendev.org/#/c/696503/15:50
efriedMy understanding stephenfin: we need to backport it as it stands. Which means if your change merges first, the backport of this one will need to be different from the master version.15:50
stephenfinYup, I get that. I'm tempted to suggest we just apply it against stable/train since it will soon be useless on master, but maybe that's a lot of work just to avoid some merge conflicts15:51
stephenfin(as in StableOnly)15:52
efriedIt won't be useless on master15:52
efriedwe still need to cache, which we're not doing15:52
mriedemstephenfin: replied15:52
*** brinzhang_ has quit IRC15:52
* efried steps out of the way15:52
*** brinzhang_ has joined #openstack-nova15:53
*** brinzhang has quit IRC15:53
stephenfinmriedem: Good thing I asked :)15:53
*** brinzhang_ has quit IRC15:54
mriedemi think we need to just make the neutron SecurityGroupAPI a singleton15:54
*** brinzhang_ has joined #openstack-nova15:54
mriedemit doesn't have any state as far as i can tell15:54
mriedemunlike SchedulerReportClient which does have some state15:54
efriedIt must not have state, since we were able to cache it before with no ill effects15:55
efriedunless the state was added in the interval when we had removed the caching.15:55
mriedemthe neutron sg api you mean15:55
stephenfinMakes sense to me. I can rework that patch accordingly15:55
*** salmankhan has joined #openstack-nova15:56
stephenfinthough I'll hold off for now since that queue is approaching x-cell resize size and will kill CI if pushed15:56
stephenfinRIP CI15:56
*** maciejjozefczyk is now known as mjozefcz|brb15:57
mriedemthe bottom 5 or so changes can use another core15:57
stephenfinmriedem: While I have you, is this the correct thing to do? https://review.opendev.org/#/c/697152/2/doc/api_samples/os-quota-class-sets/quota-classes-show-get-resp.json15:57
stephenfinI assume we don't support arbitrary quota classes so we can't modify the output for older microversions15:58
stephenfin...meaning I have to fake those nova-net'y quotas rather than just dropping them15:58
mriedemi'm pretty sure we only support one quota class, 'default'15:58
*** tbachman has quit IRC15:58
stephenfinsorry, arbitrary quotas...types?15:59
mriedemyeah you can't create random quota types15:59
salmankhanHI guys, I am facing an issue if someone can help. I upgraded the nova queens api from xenial to bionic and I am not able to see network info in "nova show" or "openstack server show" commands. However I can see the network details on dashboard or "nova interface-list" or "openstack port show" commands. Doesn't look like a database issue, but may be. If I reboot a instance there is no interface attached as well. What could be16:00
mriedemhttps://github.com/openstack/nova/blob/master/nova/api/openstack/compute/schemas/quota_sets.py#L2916:00
*** mjozefcz|brb has quit IRC16:00
stephenfinso I do have to keep them. okidok16:00
mriedemthat said, i'm not sure about what you're doing there with just changing all the network quota values to -116:00
stephenfinthat's what the noop driver was doing (unlimited) and those things are noops now16:01
stephenfinso...16:01
openstackgerritMerged openstack/nova master: Add QoS tempest config so bw tests run  https://review.opendev.org/69718016:01
mriedemthe noop quota driver is just for testing16:02
mriedemor nfv single tenant i guess16:02
mriedemi agree that we can't just remove them from the responses and stuff without a microversion since it changes the schema16:02
mriedemwe don't proxy enforcement of those to neutron at all do we?16:03
mriedemi know there was talk of doing that back in like havana16:03
stephenfinnope, they're dead16:03
stephenfinall DB model driven16:03
mriedemyeah, i mean the -1 is a lie because we're not enforcing those. we did deprecate them from the apis in 2.35 and 2.49 and they were a lie before if using neutron anyway - you could change security group rules quota to 500 in nova and it wouldn't apply to neutron16:05
melwittre: the noop quota driver, I had thought that was the way for a deployment that doesn't care about quotas to bypass all the calculating (perf impact). so I was thinking not to remove it because of that. am I missing something?16:06
*** brinzhang has joined #openstack-nova16:06
mriedemhow many deployments besides nfv single tenant don't care about quota?16:06
*** brinzhang has quit IRC16:08
stephenfinIf -1 is a lie, what do I return instead? Just 0?16:08
stephenfinI have to return _something_16:08
*** brinzhang_ has quit IRC16:08
*** brinzhang has joined #openstack-nova16:08
*** brinzhang has quit IRC16:09
*** gyee has joined #openstack-nova16:09
*** brinzhang has joined #openstack-nova16:10
mriedemit's all a lie is my point i think, so -1 is probably good enough16:10
mriedemi'm just not sure how clearly i'm thinking about this atm, or what alternatives there are16:11
mriedemi defer to dansmith16:11
*** brinzhang has quit IRC16:11
mriedemo-)16:11
*** brinzhang has joined #openstack-nova16:12
*** awalende has joined #openstack-nova16:12
dansmithI don't know about quota things16:12
dansmithI defer to melwitt16:12
*** brinzhang has quit IRC16:13
*** brinzhang has joined #openstack-nova16:14
melwittI'll take a look at it16:15
*** brinzhang has quit IRC16:15
salmankhanAnyone??? HI guys, I am facing an issue if someone can help. I upgraded the nova queens api from xenial to bionic and I am not able to see network info in "nova show" or "openstack server show" commands. However I can see the network details on dashboard or "nova interface-list" or "openstack port show" commands. Doesn't look like a database issue, but may be. If I reboot a instance there is no interface attached as well. Wha16:15
salmankhanfine.16:15
*** brinzhang has joined #openstack-nova16:16
*** awalende has quit IRC16:16
*** maciejjozefczyk has joined #openstack-nova16:16
*** brinzhang has quit IRC16:17
mriedemthe instance network info cache is probably missing16:17
salmankhanhow can it be fixed16:17
*** brinzhang has joined #openstack-nova16:17
mriedemcheck the instance_info_caches.network_info column for that instance16:18
mriedemon queens....i'm not sure16:18
mriedemthere is a periodic that would heal it starting in i think stein16:18
mriedemsee https://review.opendev.org/#/c/679274/16:18
mriedemyou could also take a look at this https://review.opendev.org/#/c/640516/16:20
mriedem"If someone comes forward saying "yes this fixes a thing I'm hitting" then I'd be willing to restore it."16:20
mriedemthat second patch won't help you on queens since it relies on the force_refresh kwarg from the previous patch16:21
sean-k-mooneymriedem: for what its worth we have backported only the periodic heal downstream16:21
mriedemsuper16:22
sean-k-mooneywe did not backport the data migration16:22
sean-k-mooneybecause that caused other issues16:22
mriedemand canonical is going to as well it looks like16:22
sean-k-mooneywe have it all the way back to newton at this point16:23
sean-k-mooneyalthough we only did newton in the last month16:23
salmankhanSo you saying apply this 679274, that could fix on queens?16:23
sean-k-mooneyonly if you have fixed teh underlying network issue16:24
sean-k-mooneythis only happens if there was an external failure that casued the cache to be curropted16:24
salmankhanI messed up with neutron ports policy and that probably corrupted the cache, I think.16:25
sean-k-mooneyyep that is one of the know ways to cause it16:25
salmankhanthough I have fixed that policy16:25
*** mlavalle has joined #openstack-nova16:26
sean-k-mooneyif the neutron policy.json is miss configured an empty list will be returned form neutron16:26
sean-k-mooneyand then we update the caceh with that16:26
sean-k-mooneyif that has been fixed the back can fix that16:26
salmankhanok,  :finger_crossed: going to apply 679274 and see.16:27
*** tbachman has joined #openstack-nova16:29
stephenfindansmith: Any idea what could cause this test to fail? https://zuul.opendev.org/t/openstack/build/c598788184854780b2494a45b42a9718/console16:32
stephenfin(from https://review.opendev.org/697156)16:33
dansmithmucking around with the registry16:33
dansmithoh16:34
stephenfinI thought maybe I'd removed an object that was referenced from another object, but it doesn't seem like I have16:34
dansmithstephenfin: did you maybe remove or not register an object?16:34
stephenfinI removed objects, yes16:34
stephenfinBut I've removed all references to those objects, fwict16:34
dansmithdid you remove one that you didn't remove from the test_objects list of hashes?16:34
*** ociuhandu has quit IRC16:35
dansmithunrelated to your failure, did we talk about removing objects already?16:35
stephenfingrep doesn't bring up any matches for the removed objects in 'nova/tests/unit/objects/'16:35
stephenfinI think so. You've to keep the DB models if it's persistent for a cycle or two, but the objects can go16:36
stephenfinI think...16:36
*** ociuhandu has joined #openstack-nova16:36
dansmithso, removing these objects will mean that if anything sends us one over the wire, we will completely fail,16:37
dansmithand obviously things stop being able to run remotable methods if they're not upgraded16:38
stephenfinThen I will triple check, but I think the only thing that could have sent these over the wire was nova-network, and that has been non-functional for at least a cycle now16:38
dansmithstephenfin: no, I think api would send them in some cases wouldn't it?16:39
dansmithnote I'm not saying we should keep them necessarily, just trying to think aloud16:39
stephenfinyup, I get ya. Checking now myself16:40
*** ociuhandu has quit IRC16:40
*** jangutter has quit IRC16:41
stephenfinYeah, leave it with me. I'll check my queue of patches and see if any of those objects could get through to the APIs. I'll state whatever I find in the commit message16:41
*** ociuhandu has joined #openstack-nova16:54
*** lpetrut has joined #openstack-nova16:56
openstackgerritMatt Riedemann proposed openstack/nova master: ironic: report a custom trait for the node owner  https://review.opendev.org/69718416:56
openstackgerritMatt Riedemann proposed openstack/nova master: WIP: Add node owner pre-filter  https://review.opendev.org/69718716:56
mriedemefried: i wrote a functional test for ^ and it shows what i suspected - traits aren't going to work16:56
mriedemnot enough context16:56
efriedmriedem: yeah, I was noodling that yesterday and I concur it would be pretty tough to do.16:57
efriedmriedem: If you had a I_AM_IRONIC trait, and Placement had a ?required_if=CUSTOM_OWNER_XXX:I_AM_IRONIC syntax....16:57
* efried feeds16:57
*** udesale has quit IRC16:58
mriedemand bingo bango you have metadata in placement :)16:58
*** ociuhandu has quit IRC16:59
sean-k-mooneyim pretty sure when i raised the idea of key:value traits in the past it was shot down pretty hard17:05
dansmithplease god no17:10
sean-k-mooneyyep that was the reaction back then too17:11
efriedI was not seriously proposing that.17:18
efriedforgot my /s17:19
*** jraju__ has quit IRC17:21
*** jaosorior has quit IRC17:23
*** ociuhandu has joined #openstack-nova17:24
*** kaliya has joined #openstack-nova17:26
openstackgerritMatt Riedemann proposed openstack/nova master: WIP: Add NodeOwnerFilter  https://review.opendev.org/69733117:26
*** tbachman has quit IRC17:28
*** kaliya has quit IRC17:30
*** dtantsur is now known as dtantsur|afk17:31
*** brinzhang_ has joined #openstack-nova17:37
*** brinzhang has quit IRC17:41
*** ociuhandu has quit IRC17:48
*** ociuhandu has joined #openstack-nova17:49
*** rpittau is now known as rpittau|afk17:50
*** ociuhandu has quit IRC17:53
*** tesseract has quit IRC18:04
*** lennyb has quit IRC18:05
*** derekh has quit IRC18:06
*** maciejjozefczyk has quit IRC18:16
*** tbachman has joined #openstack-nova18:17
*** lennyb has joined #openstack-nova18:18
*** martinkennelly has quit IRC18:23
*** igordc has joined #openstack-nova18:25
*** lennyb has quit IRC18:25
*** lennyb has joined #openstack-nova18:26
*** ociuhandu has joined #openstack-nova18:27
*** brinzhang has joined #openstack-nova18:29
*** ociuhandu has quit IRC18:32
*** brinzhang_ has quit IRC18:32
salmankhansean-k-mooney: Thanks mate! This fix worked for me  https://review.opendev.org/#/c/679274/18:51
*** amodi has joined #openstack-nova18:52
*** tosky has quit IRC18:54
*** eharney has quit IRC18:54
eanderssonOff topic but who do you poke to get Debian packages updated?18:58
fricklereandersson: zigo18:59
eanderssonThanks frickler18:59
*** ociuhandu has joined #openstack-nova19:00
*** salmankhan has quit IRC19:06
*** lennyb has quit IRC19:10
*** ociuhandu has quit IRC19:11
*** ociuhandu has joined #openstack-nova19:11
openstackgerritEric Fried proposed openstack/nova-specs master: Spec: Ussuri: Encrypted Emulated Virtual TPM  https://review.opendev.org/68680419:13
efriedgibi, stephenfin, sean-k-mooney: Thanks for those reviews. Hopefully addressed everything ^19:14
*** ociuhandu has quit IRC19:17
openstackgerritGhanshyam Mann proposed openstack/nova master: Add test coverage of existing admin_actions policies  https://review.opendev.org/65769819:19
*** lennyb has joined #openstack-nova19:22
*** ralonsoh has quit IRC19:29
openstackgerritMatt Riedemann proposed openstack/nova master: WIP: Add NodeOwnerFilter  https://review.opendev.org/69733119:31
openstackgerritGhanshyam Mann proposed openstack/nova master: Introduce scope_types in Admin Actions  https://review.opendev.org/65782319:35
*** damien_r has quit IRC19:38
*** lennyb has quit IRC19:38
*** lennyb has joined #openstack-nova19:42
*** df_sbr has quit IRC19:42
*** awalende has joined #openstack-nova19:44
*** lpetrut has quit IRC19:48
*** awalende has quit IRC19:49
*** Sundar has quit IRC19:57
*** awalende has joined #openstack-nova20:05
*** eharney has joined #openstack-nova20:07
*** nicolasbock has joined #openstack-nova20:08
*** ociuhandu has joined #openstack-nova20:10
*** kaliya has joined #openstack-nova20:14
*** abaindur has joined #openstack-nova20:17
*** abaindur has quit IRC20:17
*** abaindur has joined #openstack-nova20:18
*** abaindur has quit IRC20:18
*** kaliya has quit IRC20:18
*** abaindur has joined #openstack-nova20:19
*** mgariepy has quit IRC20:27
*** mgariepy has joined #openstack-nova20:35
*** lbragstad_ has joined #openstack-nova20:36
*** lbragstad has quit IRC20:37
*** awalende has quit IRC20:37
*** awalende has joined #openstack-nova20:38
*** awalende has quit IRC20:42
*** lbragstad_ is now known as lbragstad20:43
*** davee_ has quit IRC20:48
*** derekh has joined #openstack-nova20:53
*** derekh has quit IRC20:54
*** mriedem has quit IRC21:02
openstackgerritMerged openstack/nova stable/pike: Hook resource_tracker to remove stale node information  https://review.opendev.org/67646121:04
*** salmankhan has joined #openstack-nova21:25
*** pcaruana has quit IRC21:32
*** df_sbr has joined #openstack-nova21:37
*** bbowen has quit IRC21:51
*** slaweq has quit IRC21:56
*** salmankhan has quit IRC21:57
*** nweinber has quit IRC22:04
*** tosky has joined #openstack-nova22:10
*** mriedem has joined #openstack-nova22:14
*** ociuhandu has quit IRC22:19
*** rcernin has joined #openstack-nova22:19
*** ociuhandu has joined #openstack-nova22:20
*** ociuhandu has quit IRC22:24
*** brinzhang_ has joined #openstack-nova22:31
*** brinzhang_ has quit IRC22:33
*** brinzhang_ has joined #openstack-nova22:34
*** brinzhang has quit IRC22:34
*** avolkov has quit IRC23:00
*** tkajinam has joined #openstack-nova23:05
*** tbachman has quit IRC23:07
*** mriedem has quit IRC23:15
*** mlavalle has quit IRC23:27
*** ociuhandu has joined #openstack-nova23:30
*** ociuhandu has quit IRC23:35
*** brinzhang has joined #openstack-nova23:43
*** brinzhang_ has quit IRC23:46
*** slaweq has joined #openstack-nova23:49
*** slaweq has quit IRC23:54

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!