| *** brinzhang_ has joined #openstack-nova | 00:09 | |
| *** tosky has quit IRC | 00:10 | |
| openstackgerrit | Merged openstack/nova master: vmware: Remove vestigial nova-network support https://review.opendev.org/696503 | 00:11 |
|---|---|---|
| *** brinzhang has quit IRC | 00:12 | |
| *** brinzhang_ has quit IRC | 00:14 | |
| *** tbachman has joined #openstack-nova | 00:14 | |
| openstackgerrit | sean mooney proposed openstack/nova master: Block rebuild when NUMA topology changed https://review.opendev.org/687957 | 00:21 |
| openstackgerrit | sean mooney proposed openstack/nova master: Disable NUMATopologyFilter on rebuild https://review.opendev.org/689861 | 00:21 |
| *** tbachman has quit IRC | 00:25 | |
| openstackgerrit | Merged openstack/nova master: zvm: Remove vestigial nova-network support https://review.opendev.org/696504 | 00:30 |
| *** brinzhang has joined #openstack-nova | 00:31 | |
| *** ociuhandu has joined #openstack-nova | 00:39 | |
| *** brinzhang_ has joined #openstack-nova | 00:45 | |
| *** mdbooth has quit IRC | 00:48 | |
| *** ociuhandu has quit IRC | 00:48 | |
| *** brinzhang has quit IRC | 00:49 | |
| *** brinzhang has joined #openstack-nova | 00:50 | |
| *** brinzhang_ has quit IRC | 00:53 | |
| *** mdbooth has joined #openstack-nova | 00:59 | |
| *** tbachman has joined #openstack-nova | 01:05 | |
| *** Liang__ has joined #openstack-nova | 01:16 | |
| *** brinzhang_ has joined #openstack-nova | 01:21 | |
| *** brinzhang_ has quit IRC | 01:23 | |
| openstackgerrit | Merged openstack/nova master: Cache security group driver https://review.opendev.org/697122 | 01:24 |
| *** brinzhang has quit IRC | 01:25 | |
| *** larainema has joined #openstack-nova | 01:27 | |
| openstackgerrit | jichenjc proposed openstack/nova master: libvirt: avoid cpu check at s390x arch https://review.opendev.org/696228 | 01:36 |
| *** ociuhandu has joined #openstack-nova | 01:39 | |
| *** ociuhandu has quit IRC | 01:43 | |
| openstackgerrit | melanie witt proposed openstack/nova stable/queens: delete consumers which no longer have allocations https://review.opendev.org/697398 | 01:51 |
| *** chenhaw has joined #openstack-nova | 01:51 | |
| *** nicolasbock has quit IRC | 01:55 | |
| *** brinzhang has joined #openstack-nova | 01:57 | |
| *** brinzhang has quit IRC | 01:59 | |
| *** slaweq has joined #openstack-nova | 02:30 | |
| *** slaweq has quit IRC | 02:35 | |
| *** ociuhandu has joined #openstack-nova | 02:38 | |
| *** ociuhandu has quit IRC | 02:47 | |
| *** lbragstad has quit IRC | 02:48 | |
| *** mdbooth has quit IRC | 02:48 | |
| *** mdbooth has joined #openstack-nova | 02:49 | |
| *** slaweq has joined #openstack-nova | 02:51 | |
| *** igordc has quit IRC | 02:54 | |
| *** slaweq has quit IRC | 02:56 | |
| *** gyee has quit IRC | 03:03 | |
| *** brault has quit IRC | 03:06 | |
| *** tinwood has quit IRC | 03:10 | |
| *** tinwood has joined #openstack-nova | 03:12 | |
| *** abaindur has quit IRC | 03:27 | |
| *** boxiang has joined #openstack-nova | 03:28 | |
| *** zhanglong has joined #openstack-nova | 03:33 | |
| *** slaweq has joined #openstack-nova | 03:34 | |
| *** slaweq has quit IRC | 03:39 | |
| *** tkajinam is now known as tkajinam|lunch | 03:40 | |
| *** zhanglong has quit IRC | 03:44 | |
| *** udesale has joined #openstack-nova | 03:48 | |
| *** zhanglong has joined #openstack-nova | 03:49 | |
| *** slaweq has joined #openstack-nova | 03:58 | |
| *** lbragstad has joined #openstack-nova | 03:59 | |
| *** slaweq has quit IRC | 04:03 | |
| *** tetsuro_ has quit IRC | 04:06 | |
| *** tetsuro has joined #openstack-nova | 04:06 | |
| eandersson | mnaser what version of RabbitMQ are you running now? | 04:19 |
| *** artom has quit IRC | 04:32 | |
| *** artom has joined #openstack-nova | 04:33 | |
| *** bhagyashris has joined #openstack-nova | 04:33 | |
| *** slaweq has joined #openstack-nova | 04:33 | |
| *** slaweq has quit IRC | 04:38 | |
| *** boxiang_ has joined #openstack-nova | 05:05 | |
| *** bhagyashris has quit IRC | 05:05 | |
| *** boxiang has quit IRC | 05:08 | |
| *** boxiang_ has quit IRC | 05:16 | |
| *** boxiang_ has joined #openstack-nova | 05:16 | |
| *** slaweq has joined #openstack-nova | 05:18 | |
| *** slaweq has quit IRC | 05:22 | |
| *** links has joined #openstack-nova | 05:23 | |
| *** threestrands has joined #openstack-nova | 05:24 | |
| *** slaweq has joined #openstack-nova | 05:25 | |
| *** bhagyashris has joined #openstack-nova | 05:26 | |
| *** slaweq has quit IRC | 05:30 | |
| *** ociuhandu has joined #openstack-nova | 05:30 | |
| *** ociuhandu has quit IRC | 05:35 | |
| *** pcaruana has joined #openstack-nova | 05:38 | |
| *** pcaruana has quit IRC | 05:42 | |
| *** slaweq has joined #openstack-nova | 05:45 | |
| *** slaweq has quit IRC | 05:54 | |
| *** slaweq has joined #openstack-nova | 05:58 | |
| *** slaweq has quit IRC | 06:03 | |
| *** Luzi has joined #openstack-nova | 06:03 | |
| *** rcernin has quit IRC | 06:09 | |
| *** slaweq has joined #openstack-nova | 06:12 | |
| *** udesale has quit IRC | 06:13 | |
| *** udesale has joined #openstack-nova | 06:14 | |
| *** ociuhandu has joined #openstack-nova | 06:16 | |
| *** slaweq has quit IRC | 06:18 | |
| *** ociuhandu has quit IRC | 06:36 | |
| *** awalende has joined #openstack-nova | 06:39 | |
| *** awalende has quit IRC | 06:44 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/nova master: Imported Translations from Zanata https://review.opendev.org/694717 | 06:47 |
| *** ccamacho has quit IRC | 06:54 | |
| *** ralonsoh has joined #openstack-nova | 06:58 | |
| *** udesale has quit IRC | 07:02 | |
| *** ociuhandu has joined #openstack-nova | 07:03 | |
| *** udesale has joined #openstack-nova | 07:03 | |
| *** udesale has quit IRC | 07:06 | |
| *** udesale has joined #openstack-nova | 07:06 | |
| eandersson | I think I figured out the main issue we were having with instances getting stuck in BUILD. Many of our RabbitMQ Clusters got stuck into a bad state and because of how our scheduling works instances kept getting scheduled to the same computes. These computes had bad queues, but because it's almost impossible to know which compute(s) are affected. | 07:07 |
| eandersson | Because the database is not yet updated to reflect the compute hosting the instance (or at least it's not easy, or obvious to find the compute without digging deep into the database) | 07:08 |
| eandersson | I am still baffled on why so many RabbitMQ Clusters broke within a short period of time. Seems to be caused by some sort of memory leak on one of the RabbitMQ servers. | 07:09 |
| eandersson | But we also saw it happen on one cluster after a network partition. | 07:10 |
| eandersson | The only thing we could really find on RabbitMQ was messages stuck un'acked (even without consumers), but unsure if that was just a display issue. | 07:12 |
| *** maciejjozefczyk has joined #openstack-nova | 07:16 | |
| *** pcaruana has joined #openstack-nova | 07:17 | |
| *** avolkov has joined #openstack-nova | 07:19 | |
| *** ociuhandu has quit IRC | 07:27 | |
| *** ociuhandu has joined #openstack-nova | 07:27 | |
| *** damien_r has joined #openstack-nova | 07:54 | |
| *** zhanglong has quit IRC | 07:56 | |
| *** rcernin has joined #openstack-nova | 08:01 | |
| openstackgerrit | Luyao Zhong proposed openstack/nova-specs master: support live migration with virtual persistent memory https://review.opendev.org/695863 | 08:11 |
| *** awalende has joined #openstack-nova | 08:20 | |
| openstackgerrit | Luyao Zhong proposed openstack/nova-specs master: support live migration with virtual persistent memory https://review.opendev.org/695863 | 08:20 |
| *** tesseract has joined #openstack-nova | 08:21 | |
| *** yikun has quit IRC | 08:21 | |
| *** udesale has quit IRC | 08:31 | |
| *** udesale has joined #openstack-nova | 08:32 | |
| *** rpittau|afk is now known as rpittau | 08:32 | |
| *** kevinbenton has quit IRC | 08:34 | |
| *** NostawRm has quit IRC | 08:34 | |
| *** hemna_ has quit IRC | 08:34 | |
| *** abaindur has joined #openstack-nova | 08:35 | |
| *** tosky has joined #openstack-nova | 08:36 | |
| *** kevinbenton has joined #openstack-nova | 08:38 | |
| *** NostawRm has joined #openstack-nova | 08:38 | |
| *** hemna_ has joined #openstack-nova | 08:38 | |
| *** slaweq_ has joined #openstack-nova | 08:50 | |
| *** udesale has quit IRC | 08:58 | |
| *** slaweq_ has quit IRC | 08:59 | |
| *** lpetrut has joined #openstack-nova | 09:04 | |
| *** martinkennelly has joined #openstack-nova | 09:05 | |
| *** threestrands has quit IRC | 09:07 | |
| *** ociuhandu has quit IRC | 09:09 | |
| *** jangutter has joined #openstack-nova | 09:09 | |
| *** tkajinam|lunch has quit IRC | 09:09 | |
| *** udesale has joined #openstack-nova | 09:12 | |
| *** boxiang has joined #openstack-nova | 09:21 | |
| *** boxiang_ has quit IRC | 09:23 | |
| *** ccamacho has joined #openstack-nova | 09:42 | |
| *** derekh has joined #openstack-nova | 09:43 | |
| *** kevinbenton has quit IRC | 09:54 | |
| *** NostawRm has quit IRC | 09:54 | |
| *** hemna_ has quit IRC | 09:54 | |
| *** ccamacho has quit IRC | 09:54 | |
| *** boxiang has quit IRC | 09:54 | |
| *** lpetrut has quit IRC | 09:54 | |
| *** awalende has quit IRC | 09:54 | |
| *** avolkov has quit IRC | 09:54 | |
| *** tinwood has quit IRC | 09:54 | |
| *** amodi has quit IRC | 09:54 | |
| *** dpawlik has quit IRC | 09:54 | |
| *** sorrison has quit IRC | 09:54 | |
| *** jmlowe has quit IRC | 09:54 | |
| *** hamzy has quit IRC | 09:54 | |
| *** liuyulong has quit IRC | 09:54 | |
| *** gshippey has quit IRC | 09:54 | |
| *** jbernard has quit IRC | 09:54 | |
| *** jangutter has quit IRC | 09:54 | |
| *** yaawang has quit IRC | 09:54 | |
| *** Roamer` has quit IRC | 09:54 | |
| *** mugsie has quit IRC | 09:54 | |
| *** donnyd has quit IRC | 09:54 | |
| *** jdillaman has quit IRC | 09:54 | |
| *** rmk has quit IRC | 09:54 | |
| *** owalsh has quit IRC | 09:54 | |
| *** Li_Liu has quit IRC | 09:54 | |
| *** TheJulia has quit IRC | 09:54 | |
| *** mnasiadka has quit IRC | 09:54 | |
| *** rpittau has quit IRC | 09:54 | |
| *** gregwork has quit IRC | 09:54 | |
| *** toanster has quit IRC | 09:54 | |
| *** bcm has quit IRC | 09:54 | |
| *** frickler has quit IRC | 09:54 | |
| *** masayukig has quit IRC | 09:54 | |
| *** _erlon_ has quit IRC | 09:54 | |
| *** pas-ha has quit IRC | 09:54 | |
| *** eharney has quit IRC | 09:54 | |
| *** aloga has quit IRC | 09:54 | |
| *** trident has quit IRC | 09:54 | |
| *** gibi has quit IRC | 09:54 | |
| *** rnoriega_ has quit IRC | 09:54 | |
| *** _gryf_ has quit IRC | 09:54 | |
| *** d34dh0r53 has quit IRC | 09:54 | |
| *** openstackgerrit has quit IRC | 09:54 | |
| *** mtreinish has quit IRC | 09:54 | |
| *** antonym has quit IRC | 09:54 | |
| *** amorin has quit IRC | 09:54 | |
| *** brtknr has quit IRC | 09:54 | |
| *** evrardjp has quit IRC | 09:54 | |
| *** martinkennelly has quit IRC | 09:54 | |
| *** bhagyashris has quit IRC | 09:54 | |
| *** mdbooth has quit IRC | 09:54 | |
| *** larainema has quit IRC | 09:54 | |
| *** Liang__ has quit IRC | 09:54 | |
| *** tbachman has quit IRC | 09:54 | |
| *** df_sbr has quit IRC | 09:54 | |
| *** dasp has quit IRC | 09:54 | |
| *** andreykurilin has quit IRC | 09:54 | |
| *** mgoddard has quit IRC | 09:54 | |
| *** fnordahl has quit IRC | 09:54 | |
| *** jkulik has quit IRC | 09:54 | |
| *** StevenK has quit IRC | 09:54 | |
| *** cmurphy has quit IRC | 09:54 | |
| *** logan- has quit IRC | 09:54 | |
| *** adrianc has quit IRC | 09:54 | |
| *** dtantsur|afk has quit IRC | 09:54 | |
| *** mloza has quit IRC | 09:54 | |
| *** alex_xu has quit IRC | 09:54 | |
| *** markmcclain has quit IRC | 09:54 | |
| *** mmethot has quit IRC | 09:54 | |
| *** smcginnis has quit IRC | 09:54 | |
| *** samc-bbc has quit IRC | 09:54 | |
| *** haleyb has quit IRC | 09:54 | |
| *** yankcrime has quit IRC | 09:54 | |
| *** nicholas has quit IRC | 09:54 | |
| *** amotoki has quit IRC | 09:54 | |
| *** Anticimex has quit IRC | 09:54 | |
| *** coreycb has quit IRC | 09:54 | |
| *** knikolla has quit IRC | 09:54 | |
| *** ildikov has quit IRC | 09:54 | |
| *** ttx has quit IRC | 09:54 | |
| *** kashyap has quit IRC | 09:54 | |
| *** spotz has quit IRC | 09:54 | |
| *** tosky has quit IRC | 09:54 | |
| *** abaindur has quit IRC | 09:54 | |
| *** tesseract has quit IRC | 09:54 | |
| *** pcaruana has quit IRC | 09:54 | |
| *** maciejjozefczyk has quit IRC | 09:54 | |
| *** ralonsoh has quit IRC | 09:54 | |
| *** Luzi has quit IRC | 09:54 | |
| *** links has quit IRC | 09:54 | |
| *** tetsuro has quit IRC | 09:54 | |
| *** lbragstad has quit IRC | 09:54 | |
| *** mgariepy has quit IRC | 09:54 | |
| *** lennyb has quit IRC | 09:54 | |
| *** jamesdenton has quit IRC | 09:54 | |
| *** jlvillal has quit IRC | 09:54 | |
| *** johanssone has quit IRC | 09:54 | |
| *** factor has quit IRC | 09:54 | |
| *** Jeffrey4l has quit IRC | 09:54 | |
| *** elod has quit IRC | 09:54 | |
| *** tbarron has quit IRC | 09:54 | |
| *** hoonetorg has quit IRC | 09:55 | |
| *** irclogbot_3 has quit IRC | 09:55 | |
| *** bnemec has quit IRC | 09:55 | |
| *** benj_ has quit IRC | 09:55 | |
| *** klindgren_ has quit IRC | 09:55 | |
| *** corvus has quit IRC | 09:55 | |
| *** ianw has quit IRC | 09:55 | |
| *** sapd1_ has quit IRC | 09:55 | |
| *** efried has quit IRC | 09:55 | |
| *** dosaboy has quit IRC | 09:55 | |
| *** canori01 has quit IRC | 09:55 | |
| *** ceryx has quit IRC | 09:55 | |
| *** eandersson has quit IRC | 09:55 | |
| *** stephenfin has quit IRC | 09:55 | |
| *** aspiers has quit IRC | 09:55 | |
| *** zer0c00l has quit IRC | 09:55 | |
| *** szaher has quit IRC | 09:55 | |
| *** obre has quit IRC | 09:55 | |
| *** larsks has quit IRC | 09:55 | |
| *** Vek has quit IRC | 09:55 | |
| *** rcernin has quit IRC | 09:55 | |
| *** damien_r has quit IRC | 09:55 | |
| *** rouk has quit IRC | 09:55 | |
| *** jroll has quit IRC | 09:55 | |
| *** francoisp has quit IRC | 09:55 | |
| *** Alon_KS has quit IRC | 09:55 | |
| *** gouthamr has quit IRC | 09:55 | |
| *** bauzas has quit IRC | 09:55 | |
| *** pots has quit IRC | 09:55 | |
| *** fungi has quit IRC | 09:55 | |
| *** rajinir has quit IRC | 09:55 | |
| *** mmedvede has quit IRC | 09:55 | |
| *** gmann has quit IRC | 09:55 | |
| *** cz2 has quit IRC | 09:55 | |
| *** dustinc has quit IRC | 09:55 | |
| *** DinaBelova has quit IRC | 09:55 | |
| *** derekh has quit IRC | 09:55 | |
| *** udesale has quit IRC | 09:55 | |
| *** artom has quit IRC | 09:55 | |
| *** chenhaw has quit IRC | 09:55 | |
| *** jistr has quit IRC | 09:55 | |
| *** gryf has quit IRC | 09:55 | |
| *** panda has quit IRC | 09:55 | |
| *** mvkr has quit IRC | 09:55 | |
| *** adriant has quit IRC | 09:55 | |
| *** sean-k-mooney has quit IRC | 09:55 | |
| *** tonyb has quit IRC | 09:55 | |
| *** kaisers has quit IRC | 09:55 | |
| *** kukacz_ has quit IRC | 09:55 | |
| *** purplerbot has quit IRC | 09:55 | |
| *** lyarwood has quit IRC | 09:55 | |
| *** aarents has quit IRC | 09:55 | |
| *** lchabert has quit IRC | 09:55 | |
| *** ioni has quit IRC | 09:55 | |
| *** cgoncalves has quit IRC | 09:55 | |
| *** dansmith has quit IRC | 09:55 | |
| *** tobberydberg has quit IRC | 09:55 | |
| *** gary_perkins has quit IRC | 09:55 | |
| *** ericyoung has quit IRC | 09:55 | |
| *** tristanC has quit IRC | 09:55 | |
| *** arxcruz has quit IRC | 09:55 | |
| *** jhesketh has quit IRC | 09:55 | |
| *** ebbex has quit IRC | 09:55 | |
| *** noonedeadpunk has quit IRC | 09:55 | |
| *** dtruong has quit IRC | 09:55 | |
| *** andreaf has quit IRC | 09:55 | |
| *** diconico07 has quit IRC | 09:55 | |
| *** csatari has quit IRC | 09:55 | |
| *** johnsom has quit IRC | 09:55 | |
| *** portdirect has quit IRC | 09:55 | |
| *** jungleboyj has quit IRC | 09:55 | |
| *** zbr_ has quit IRC | 09:55 | |
| *** dklyle has quit IRC | 09:55 | |
| *** vesper11 has quit IRC | 09:55 | |
| *** huaqiang has quit IRC | 09:55 | |
| *** ircuser-1 has quit IRC | 09:55 | |
| *** jrosser has quit IRC | 09:55 | |
| *** ganso has quit IRC | 09:55 | |
| *** luyao has quit IRC | 09:55 | |
| *** mgagne has quit IRC | 09:55 | |
| *** lifeless has quit IRC | 09:55 | |
| *** zzzeek has quit IRC | 09:55 | |
| *** guilhermesp has quit IRC | 09:55 | |
| *** tonyb[m] has quit IRC | 09:55 | |
| *** mordred has quit IRC | 09:55 | |
| *** ab-a has quit IRC | 09:55 | |
| *** arne_wiebalck has quit IRC | 09:55 | |
| *** vdrok has quit IRC | 09:55 | |
| *** mnaser has quit IRC | 09:55 | |
| *** NobodyCam has quit IRC | 09:55 | |
| *** rm_work has quit IRC | 09:55 | |
| *** melwitt has quit IRC | 09:55 | |
| *** Hazelesque has quit IRC | 09:55 | |
| *** awestin1 has quit IRC | 09:55 | |
| *** ChanServ has quit IRC | 09:55 | |
| *** hemna_ has joined #openstack-nova | 10:04 | |
| *** NostawRm has joined #openstack-nova | 10:04 | |
| *** kevinbenton has joined #openstack-nova | 10:04 | |
| *** jbernard has joined #openstack-nova | 10:04 | |
| *** gshippey has joined #openstack-nova | 10:04 | |
| *** liuyulong has joined #openstack-nova | 10:04 | |
| *** hamzy has joined #openstack-nova | 10:04 | |
| *** jmlowe has joined #openstack-nova | 10:04 | |
| *** sorrison has joined #openstack-nova | 10:04 | |
| *** dpawlik has joined #openstack-nova | 10:04 | |
| *** amodi has joined #openstack-nova | 10:04 | |
| *** tinwood has joined #openstack-nova | 10:04 | |
| *** avolkov has joined #openstack-nova | 10:04 | |
| *** awalende has joined #openstack-nova | 10:04 | |
| *** lpetrut has joined #openstack-nova | 10:04 | |
| *** boxiang has joined #openstack-nova | 10:04 | |
| *** ccamacho has joined #openstack-nova | 10:04 | |
| *** pas-ha has joined #openstack-nova | 10:04 | |
| *** _erlon_ has joined #openstack-nova | 10:04 | |
| *** masayukig has joined #openstack-nova | 10:04 | |
| *** frickler has joined #openstack-nova | 10:04 | |
| *** bcm has joined #openstack-nova | 10:04 | |
| *** toanster has joined #openstack-nova | 10:04 | |
| *** gregwork has joined #openstack-nova | 10:04 | |
| *** rpittau has joined #openstack-nova | 10:04 | |
| *** mnasiadka has joined #openstack-nova | 10:04 | |
| *** Li_Liu has joined #openstack-nova | 10:04 | |
| *** TheJulia has joined #openstack-nova | 10:04 | |
| *** owalsh has joined #openstack-nova | 10:04 | |
| *** rmk has joined #openstack-nova | 10:04 | |
| *** jdillaman has joined #openstack-nova | 10:04 | |
| *** donnyd has joined #openstack-nova | 10:04 | |
| *** mugsie has joined #openstack-nova | 10:04 | |
| *** Roamer` has joined #openstack-nova | 10:04 | |
| *** yaawang has joined #openstack-nova | 10:04 | |
| *** jangutter has joined #openstack-nova | 10:04 | |
| *** evrardjp has joined #openstack-nova | 10:04 | |
| *** brtknr has joined #openstack-nova | 10:04 | |
| *** amorin has joined #openstack-nova | 10:04 | |
| *** antonym has joined #openstack-nova | 10:04 | |
| *** mtreinish has joined #openstack-nova | 10:04 | |
| *** openstackgerrit has joined #openstack-nova | 10:04 | |
| *** d34dh0r53 has joined #openstack-nova | 10:04 | |
| *** _gryf_ has joined #openstack-nova | 10:04 | |
| *** rnoriega_ has joined #openstack-nova | 10:04 | |
| *** gibi has joined #openstack-nova | 10:04 | |
| *** trident has joined #openstack-nova | 10:04 | |
| *** aloga has joined #openstack-nova | 10:04 | |
| *** eharney has joined #openstack-nova | 10:04 | |
| *** derekh has joined #openstack-nova | 10:04 | |
| *** tosky has joined #openstack-nova | 10:04 | |
| *** tesseract has joined #openstack-nova | 10:04 | |
| *** rcernin has joined #openstack-nova | 10:04 | |
| *** damien_r has joined #openstack-nova | 10:04 | |
| *** pcaruana has joined #openstack-nova | 10:04 | |
| *** maciejjozefczyk has joined #openstack-nova | 10:04 | |
| *** ralonsoh has joined #openstack-nova | 10:04 | |
| *** Luzi has joined #openstack-nova | 10:04 | |
| *** links has joined #openstack-nova | 10:04 | |
| *** artom has joined #openstack-nova | 10:04 | |
| *** tetsuro has joined #openstack-nova | 10:04 | |
| *** lbragstad has joined #openstack-nova | 10:04 | |
| *** chenhaw has joined #openstack-nova | 10:04 | |
| *** mgariepy has joined #openstack-nova | 10:04 | |
| *** lennyb has joined #openstack-nova | 10:04 | |
| *** spotz has joined #openstack-nova | 10:04 | |
| *** kashyap has joined #openstack-nova | 10:04 | |
| *** zbr_ has joined #openstack-nova | 10:04 | |
| *** dklyle has joined #openstack-nova | 10:04 | |
| *** francoisp has joined #openstack-nova | 10:04 | |
| *** vesper11 has joined #openstack-nova | 10:04 | |
| *** jamesdenton has joined #openstack-nova | 10:04 | |
| *** jhesketh has joined #openstack-nova | 10:04 | |
| *** jlvillal has joined #openstack-nova | 10:04 | |
| *** huaqiang has joined #openstack-nova | 10:04 | |
| *** johanssone has joined #openstack-nova | 10:04 | |
| *** ircuser-1 has joined #openstack-nova | 10:04 | |
| *** jistr has joined #openstack-nova | 10:04 | |
| *** factor has joined #openstack-nova | 10:04 | |
| *** gryf has joined #openstack-nova | 10:04 | |
| *** Jeffrey4l has joined #openstack-nova | 10:04 | |
| *** jrosser has joined #openstack-nova | 10:04 | |
| *** rouk has joined #openstack-nova | 10:04 | |
| *** jroll has joined #openstack-nova | 10:04 | |
| *** ganso has joined #openstack-nova | 10:04 | |
| *** tbarron has joined #openstack-nova | 10:04 | |
| *** elod has joined #openstack-nova | 10:04 | |
| *** panda has joined #openstack-nova | 10:04 | |
| *** mvkr has joined #openstack-nova | 10:04 | |
| *** luyao has joined #openstack-nova | 10:04 | |
| *** hoonetorg has joined #openstack-nova | 10:04 | |
| *** Alon_KS has joined #openstack-nova | 10:04 | |
| *** gouthamr has joined #openstack-nova | 10:04 | |
| *** bauzas has joined #openstack-nova | 10:04 | |
| *** adriant has joined #openstack-nova | 10:04 | |
| *** sean-k-mooney has joined #openstack-nova | 10:04 | |
| *** tonyb has joined #openstack-nova | 10:04 | |
| *** kaisers has joined #openstack-nova | 10:04 | |
| *** irclogbot_3 has joined #openstack-nova | 10:04 | |
| *** bnemec has joined #openstack-nova | 10:04 | |
| *** benj_ has joined #openstack-nova | 10:04 | |
| *** klindgren_ has joined #openstack-nova | 10:04 | |
| *** pots has joined #openstack-nova | 10:04 | |
| *** corvus has joined #openstack-nova | 10:04 | |
| *** mgagne has joined #openstack-nova | 10:04 | |
| *** kukacz_ has joined #openstack-nova | 10:04 | |
| *** ianw has joined #openstack-nova | 10:04 | |
| *** tonyb[m] has joined #openstack-nova | 10:04 | |
| *** sapd1_ has joined #openstack-nova | 10:04 | |
| *** lifeless has joined #openstack-nova | 10:04 | |
| *** efried has joined #openstack-nova | 10:04 | |
| *** zzzeek has joined #openstack-nova | 10:04 | |
| *** guilhermesp has joined #openstack-nova | 10:04 | |
| *** purplerbot has joined #openstack-nova | 10:04 | |
| *** dosaboy has joined #openstack-nova | 10:04 | |
| *** canori01 has joined #openstack-nova | 10:04 | |
| *** eandersson has joined #openstack-nova | 10:04 | |
| *** ceryx has joined #openstack-nova | 10:04 | |
| *** lyarwood has joined #openstack-nova | 10:04 | |
| *** ioni has joined #openstack-nova | 10:04 | |
| *** fungi has joined #openstack-nova | 10:04 | |
| *** aarents has joined #openstack-nova | 10:04 | |
| *** rajinir has joined #openstack-nova | 10:04 | |
| *** mordred has joined #openstack-nova | 10:04 | |
| *** stephenfin has joined #openstack-nova | 10:04 | |
| *** lchabert has joined #openstack-nova | 10:04 | |
| *** ab-a has joined #openstack-nova | 10:04 | |
| *** aspiers has joined #openstack-nova | 10:04 | |
| *** cgoncalves has joined #openstack-nova | 10:04 | |
| *** dtruong has joined #openstack-nova | 10:04 | |
| *** zer0c00l has joined #openstack-nova | 10:04 | |
| *** szaher has joined #openstack-nova | 10:04 | |
| *** andreaf has joined #openstack-nova | 10:04 | |
| *** obre has joined #openstack-nova | 10:04 | |
| *** dansmith has joined #openstack-nova | 10:04 | |
| *** larsks has joined #openstack-nova | 10:04 | |
| *** Vek has joined #openstack-nova | 10:04 | |
| *** tobberydberg has joined #openstack-nova | 10:04 | |
| *** diconico07 has joined #openstack-nova | 10:04 | |
| *** noonedeadpunk has joined #openstack-nova | 10:04 | |
| *** gary_perkins has joined #openstack-nova | 10:04 | |
| *** mmedvede has joined #openstack-nova | 10:04 | |
| *** ericyoung has joined #openstack-nova | 10:04 | |
| *** tristanC has joined #openstack-nova | 10:04 | |
| *** arxcruz has joined #openstack-nova | 10:04 | |
| *** cz2 has joined #openstack-nova | 10:04 | |
| *** gmann has joined #openstack-nova | 10:04 | |
| *** dustinc has joined #openstack-nova | 10:04 | |
| *** DinaBelova has joined #openstack-nova | 10:04 | |
| *** csatari has joined #openstack-nova | 10:04 | |
| *** johnsom has joined #openstack-nova | 10:04 | |
| *** portdirect has joined #openstack-nova | 10:04 | |
| *** ebbex has joined #openstack-nova | 10:04 | |
| *** jungleboyj has joined #openstack-nova | 10:04 | |
| *** awestin1 has joined #openstack-nova | 10:04 | |
| *** Hazelesque has joined #openstack-nova | 10:04 | |
| *** melwitt has joined #openstack-nova | 10:04 | |
| *** rm_work has joined #openstack-nova | 10:04 | |
| *** mnaser has joined #openstack-nova | 10:04 | |
| *** NobodyCam has joined #openstack-nova | 10:04 | |
| *** vdrok has joined #openstack-nova | 10:04 | |
| *** arne_wiebalck has joined #openstack-nova | 10:04 | |
| *** ChanServ has joined #openstack-nova | 10:04 | |
| *** orwell.freenode.net sets mode: +o ChanServ | 10:04 | |
| *** ttx has joined #openstack-nova | 10:04 | |
| *** martinkennelly has joined #openstack-nova | 10:04 | |
| *** bhagyashris has joined #openstack-nova | 10:04 | |
| *** mdbooth has joined #openstack-nova | 10:04 | |
| *** larainema has joined #openstack-nova | 10:04 | |
| *** Liang__ has joined #openstack-nova | 10:04 | |
| *** tbachman has joined #openstack-nova | 10:04 | |
| *** df_sbr has joined #openstack-nova | 10:04 | |
| *** dasp has joined #openstack-nova | 10:04 | |
| *** andreykurilin has joined #openstack-nova | 10:04 | |
| *** mgoddard has joined #openstack-nova | 10:04 | |
| *** jkulik has joined #openstack-nova | 10:04 | |
| *** fnordahl has joined #openstack-nova | 10:04 | |
| *** cmurphy has joined #openstack-nova | 10:04 | |
| *** StevenK has joined #openstack-nova | 10:04 | |
| *** logan- has joined #openstack-nova | 10:04 | |
| *** adrianc has joined #openstack-nova | 10:04 | |
| *** dtantsur|afk has joined #openstack-nova | 10:04 | |
| *** alex_xu has joined #openstack-nova | 10:04 | |
| *** mloza has joined #openstack-nova | 10:04 | |
| *** markmcclain has joined #openstack-nova | 10:04 | |
| *** mmethot has joined #openstack-nova | 10:04 | |
| *** smcginnis has joined #openstack-nova | 10:04 | |
| *** samc-bbc has joined #openstack-nova | 10:04 | |
| *** haleyb has joined #openstack-nova | 10:04 | |
| *** yankcrime has joined #openstack-nova | 10:04 | |
| *** nicholas has joined #openstack-nova | 10:04 | |
| *** amotoki has joined #openstack-nova | 10:04 | |
| *** Anticimex has joined #openstack-nova | 10:04 | |
| *** coreycb has joined #openstack-nova | 10:04 | |
| *** knikolla has joined #openstack-nova | 10:04 | |
| *** ildikov has joined #openstack-nova | 10:04 | |
| *** logan- has quit IRC | 10:05 | |
| *** dtantsur|afk is now known as dtantsur | 10:06 | |
| *** logan- has joined #openstack-nova | 10:06 | |
| stephenfin | bauzas: Can you send this on its way? https://review.opendev.org/#/c/665518/ | 10:08 |
| bauzas | stephenfin: sure | 10:09 |
| stephenfin | Thanks | 10:10 |
| bauzas | stephenfin: any chance to add a new tox target that would wrap pre-commit ? | 10:14 |
| stephenfin | I could, but it doesn't really make sense. They're really different tools | 10:14 |
| stephenfin | pre-commit "installs" things by cloning git repos and creating its own venv. It wouldn't benefit from tox | 10:15 |
| zbr_ | stephenfin: it makes a lot of sense, haptics being one of them | 10:16 |
| stephenfin | haptics? | 10:16 |
| zbr_ | yeah, or habbits | 10:16 |
| zbr_ | most devs are used to call "tox -e linters", as most projects in opestack have them. | 10:16 |
| bauzas | stephenfin: i have to admit I'm new to pre-commit, but I'll give it a try | 10:16 |
| stephenfin | zbr_: to be clear, this doesn't replace that - you can still call that | 10:17 |
| bauzas | stephenfin: that said, I'm maybe a bit torn about saying we *could* deprecate fast8 | 10:17 |
| zbr_ | mainly you change how we orchestrate linters without changing the user interface | 10:17 |
| stephenfin | all that pre-commit adds is a way to call it automatically | 10:17 |
| zbr_ | tox -> linters -> pre-commit -> .... | 10:17 |
| stephenfin | no, it's more like | 10:17 |
| zbr_ | mainly the only dependency listed in linters environment of tox would be "pre-commit" | 10:17 |
| stephenfin | tox -> flake8 (hacking) | 10:17 |
| stephenfin | pre-commit -> flake8 (hacking) | 10:17 |
| stephenfin | it's two different ways to achieve the same end goal | 10:18 |
| bauzas | stephenfin: anyway, sent to the gate | 10:18 |
| stephenfin | bauzas: ta | 10:18 |
| zbr_ | so you adopt the tool without changing how user is calling it, and more important without asking them to install a new tool. | 10:18 |
| *** Liang__ has quit IRC | 10:18 | |
| * bauzas needs to drop for a while | 10:18 | |
| zbr_ | just having python and tox is usually enough | 10:18 |
| stephenfin | I have flake8 integrated into my editor because it makes my life easier | 10:19 |
| stephenfin | but I don't force people to do the same | 10:19 |
| stephenfin | ditto for pre-commit | 10:19 |
| stephenfin | so long as flake8 is passing, I don't care how people check things | 10:19 |
| stephenfin | pre-commit is just another way to do that check | 10:19 |
| stephenfin | on top of 'tox -e pep8', 'tox -e flake8', random editor integration, etc. | 10:20 |
| zbr_ | stephenfin: yeah, another way. who said you would loose ability to use flake8 in your editor | 10:20 |
| stephenfin | no one did | 10:21 |
| zbr_ | huh.... :D | 10:21 |
| stephenfin | I don't get the point? | 10:21 |
| zbr_ | I was explaining why I find useful to call pre-commit from tox, also makes very easy to integrate with zuul, without gaving to add any extra configs. | 10:22 |
| zbr_ | in fact tox itself is doing it, https://github.com/tox-dev/tox/blob/master/tox.ini#L68-L70 | 10:24 |
| stephenfin | could be one to do in the future so, once it's bedded in | 10:24 |
| stephenfin | for now though, I've had a hard enough time getting _something_ in that I'll take the win I have and be happy with it :) | 10:25 |
| zbr_ | stephenfin: i empathise with your pain... i know exactly what you mean. | 10:26 |
| *** salmankhan has joined #openstack-nova | 10:27 | |
| *** salmankhan has quit IRC | 10:28 | |
| *** salmankhan has joined #openstack-nova | 10:29 | |
| openstackgerrit | Eric Xie proposed openstack/nova master: Host CPU compatibility check does not make sense on AArch64; skip CPU comparison https://review.opendev.org/589769 | 10:29 |
| *** chenhaw has quit IRC | 10:33 | |
| *** lbragstad has quit IRC | 10:36 | |
| *** zhanglong has joined #openstack-nova | 10:37 | |
| *** ociuhandu has joined #openstack-nova | 10:39 | |
| *** pcaruana has quit IRC | 10:42 | |
| openstackgerrit | Eric Xie proposed openstack/nova master: Skip cpu comparison on AArch64 https://review.opendev.org/589769 | 10:48 |
| sean-k-mooney | zbr_: for what its worth i still dont know of any project that i have worked on that has tox -e linters | 11:07 |
| *** jdillaman has quit IRC | 11:08 | |
| sean-k-mooney | zbr_: i may have but if i did i was not aware of it. its not part of the pti https://github.com/openstack/governance/tree/master/reference/pti so its not require for project to implement and you are the first person who has raised it as a thing | 11:09 |
| sean-k-mooney | most project i was aware of if they ran addtional linters added them to the pep8 tox enve | 11:10 |
| zbr_ | sean-k-mooney: http://codesearch.openstack.org/?q=testenv%3Alinters&i=nope&files=tox.ini&repos= reports 201 repos, and is one of the few officially supported environments: https://docs.openstack.org/infra/openstack-zuul-jobs/jobs.html#job-openstack-tox-linters | 11:11 |
| sean-k-mooney | i belive neutron still adds extra linters to there pep8 tox env | 11:11 |
| zbr_ | mainly is seen as a replacement for the older pep8 | 11:11 |
| zbr_ | sean-k-mooney: that's a perfect alternative, mainly is the same, just a different name to avoid confusions. | 11:11 |
| zbr_ | i used pep8 too in several places, for convenience. | 11:12 |
| zbr_ | even if is wasn't really pep8, it was flake8 + 10 others inside. | 11:12 |
| sean-k-mooney | looking at that is mainly openstack ansible and windmil + some test projects | 11:13 |
| zbr_ | on at least one project I made an "alias" to point pep8 -> linters, just to keep it working for the user. i hate to force people to change habits, especially good ones. | 11:13 |
| sean-k-mooney | non of the core project or service project actully use linters which is why im not familar with it | 11:14 |
| zigo | eandersson: What package do you need to be updated in Debian? | 11:14 |
| zbr_ | sean-k-mooney: if you have pep8, keep using it and just document its more broad goal. | 11:14 |
| sean-k-mooney | zbr_: sure im not really against tox -e linters | 11:14 |
| zbr_ | sean-k-mooney: in fact I was considering altering the zuul jobs to introspect tox file and to run whatever they find linters or pep8. If I do this it would be much easier to projects to migrate to the more generic one. Now is almost impossible to remove openstack-tox-pep8 job as is deep inside defaults. | 11:17 |
| sean-k-mooney | its just 200 project repos which is about 50% openstack stack ansible does not mean its a common practice in openstack when we have thoasands of repos in opendev orgs | 11:17 |
| zbr_ | i already talked with infra about this about but i did not had time to go into action yet. | 11:17 |
| zbr_ | true | 11:17 |
| sean-k-mooney | zbr_: to do that you would need to modify the project testing interface | 11:18 |
| sean-k-mooney | which require a tc vote | 11:18 |
| zbr_ | that is why i was considering the smart linter idea, because it could allow people to adopt newer method without breaking existing users. | 11:18 |
| sean-k-mooney | zbr_: no | 11:19 |
| sean-k-mooney | that would be still a violation of the testing interface | 11:19 |
| sean-k-mooney | if you want to change it then you shoudl propose a governace motion via a patch | 11:19 |
| zbr_ | i know, but before working on such a change i wanted to get some feedback. | 11:20 |
| sean-k-mooney | min would be we should keep pep8 and have an optional seperate linters target | 11:20 |
| sean-k-mooney | *mine | 11:20 |
| zbr_ | we already have this, probably is more than an year old | 11:21 |
| sean-k-mooney | exitsting project that run addtionall linters in pep8 shoudl move them | 11:21 |
| sean-k-mooney | to the linter target | 11:21 |
| *** artom has quit IRC | 11:21 | |
| *** brinzhang has joined #openstack-nova | 11:30 | |
| *** ociuhandu has quit IRC | 11:31 | |
| *** derekh has quit IRC | 11:33 | |
| *** tbachman has quit IRC | 11:36 | |
| *** ociuhandu has joined #openstack-nova | 11:44 | |
| *** dviroel has joined #openstack-nova | 11:46 | |
| *** zhanglong has quit IRC | 11:49 | |
| *** shilpasd has joined #openstack-nova | 11:51 | |
| *** udesale has joined #openstack-nova | 11:51 | |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: functional: Unify '_wait_until_deleted' implementations https://review.opendev.org/689181 | 11:53 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: functional: Unify '_build_minimal_create_server_request' implementations https://review.opendev.org/695024 | 11:53 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: functional: Make '_IntegratedTestBase' subclass 'InstanceHelperMixin' https://review.opendev.org/689182 | 11:53 |
| *** jraju__ has joined #openstack-nova | 11:53 | |
| *** links has quit IRC | 11:53 | |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: functional: Remove 'get_invalid_image' https://review.opendev.org/697454 | 11:58 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: functional: Unify '_wait_until_deleted' implementations https://review.opendev.org/689181 | 12:00 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: functional: Unify '_build_minimal_create_server_request' implementations https://review.opendev.org/695024 | 12:00 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: functional: Make '_IntegratedTestBase' subclass 'InstanceHelperMixin' https://review.opendev.org/689182 | 12:00 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: functional: Remove 'get_invalid_image' https://review.opendev.org/697454 | 12:00 |
| *** artom has joined #openstack-nova | 12:08 | |
| *** zbr_ is now known as zbr|out | 12:13 | |
| *** shilpasd has quit IRC | 12:20 | |
| *** yan0s has joined #openstack-nova | 12:25 | |
| *** larainema has quit IRC | 12:26 | |
| openstackgerrit | Merged openstack/nova master: Integrate 'pre-commit' https://review.opendev.org/665518 | 12:26 |
| *** brinzhang has quit IRC | 12:33 | |
| *** rcernin has quit IRC | 12:52 | |
| *** pcaruana has joined #openstack-nova | 12:54 | |
| *** ociuhandu has quit IRC | 13:06 | |
| *** eharney has quit IRC | 13:06 | |
| *** tbachman has joined #openstack-nova | 13:22 | |
| *** belmoreira has joined #openstack-nova | 13:25 | |
| *** bhagyashris has quit IRC | 13:27 | |
| *** ociuhandu has joined #openstack-nova | 13:27 | |
| *** udesale has quit IRC | 13:30 | |
| *** abhishekk has joined #openstack-nova | 13:35 | |
| *** udesale has joined #openstack-nova | 13:39 | |
| *** mriedem has joined #openstack-nova | 13:54 | |
| *** derekh has joined #openstack-nova | 13:56 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova stable/train: Cache security group driver https://review.opendev.org/697475 | 14:02 |
| *** shilpasd has joined #openstack-nova | 14:07 | |
| shilpasd | mriedem: requesting to review 'https://review.opendev.org/#/c/612626/ | 14:09 |
| *** eharney has joined #openstack-nova | 14:09 | |
| openstackgerrit | sean mooney proposed openstack/nova master: support pci numa affinity policies in flavor and image https://review.opendev.org/674072 | 14:09 |
| shilpasd | bauzas: requesting you to review 'https://review.opendev.org/#/c/650188/8 Allow compute nodes to use DISK_GB from shared storage RP' as per your priorities | 14:10 |
| bauzas | shilpasd: ack | 14:10 |
| shilpasd | bauzas: thank you | 14:10 |
| shilpasd | @nova core: please review 'https://review.opendev.org/#/c/650188/8 Allow compute nodes to use DISK_GB from shared storage RP' | 14:11 |
| *** cgoncalves has quit IRC | 14:13 | |
| *** mkrai has joined #openstack-nova | 14:16 | |
| *** ociuhandu has quit IRC | 14:16 | |
| stephenfin | Is anyone else seeing this message when running 'tox -e py36 <whatever>' http://paste.openstack.org/show/787167/ ? | 14:17 |
| mnaser | eandersson: im just about ready to give up on rabbit clusters | 14:19 |
| *** belmoreira has quit IRC | 14:21 | |
| mriedem | shilpasd: comments on https://review.opendev.org/#/c/694462/ | 14:24 |
| *** belmoreira has joined #openstack-nova | 14:24 | |
| shilpasd | mriedem: thank you for review, will work on them | 14:25 |
| openstackgerrit | Matt Riedemann proposed openstack/nova stable/stein: Cache security group driver https://review.opendev.org/697480 | 14:25 |
| mriedem | stephenfin: trying it | 14:26 |
| *** Luzi has quit IRC | 14:28 | |
| mriedem | efried: this is why that multiple possible networks found thing is intermittent https://bugs.launchpad.net/nova/+bug/1831048 | 14:29 |
| openstack | Launchpad bug 1844568 in tempest "duplicate for #1831048 [compute] "create_test_server" if networks is undefined and more than one network is present" [Medium,In progress] - Assigned to Rodolfo Alonso (rodolfo-alonso-hernandez) | 14:29 |
| mriedem | neutron tests create a new network at the same time we're creating a server and kaboom | 14:29 |
| mriedem | though we shouldn't be running tempest.api.network tests in nova-next, but it could fail during scenario runs or something i guess? | 14:30 |
| mriedem | stephenfin: i didn't get that problem | 14:30 |
| mriedem | i'm on ubuntu bionic | 14:30 |
| stephenfin | okay, it's a Fedora issue | 14:30 |
| stephenfin | mriedem++ thanks | 14:30 |
| *** zbr|out has quit IRC | 14:33 | |
| *** zbr has joined #openstack-nova | 14:34 | |
| *** pcaruana has quit IRC | 14:38 | |
| mriedem | i wonder if the nova-next job hits that more often because of how we do concurrency differently in that job from others? | 14:40 |
| *** ociuhandu has joined #openstack-nova | 14:40 | |
| mriedem | i think tempest-full runs api tests concurrently and scenario tests serially, and i think nova-next runs them all concurretly | 14:40 |
| *** zbr_ has joined #openstack-nova | 14:41 | |
| mriedem | yeah so i bet a network scenario test creates a network while the compute api tests are running and it blows up | 14:43 |
| sean-k-mooney | mriedem: for the senario test do we not run those with concurancy 1 | 14:44 |
| *** zbr has quit IRC | 14:44 | |
| *** nweinber has joined #openstack-nova | 14:44 | |
| sean-k-mooney | but yes i can see how it could fial in if a neutron test created a network in paralle with a compute test although ideally it would do that in a different tenant so that it could not affect other tests | 14:45 |
| mriedem | there is probably a scenario test that creates a public network | 14:46 |
| mriedem | and yes we run all tests, api and scenario, concurrently in nova-next | 14:46 |
| sean-k-mooney | ah ok so we dont do the two pahse execution we do in tempst full wehre it runs all test excpet the senario tests first with concurrency and then runs the senario tests serially | 14:47 |
| sean-k-mooney | ya that would proably make it more likely to fail in nova-next | 14:47 |
| *** zbr_ has quit IRC | 14:49 | |
| mriedem | all things i just said above | 14:49 |
| mriedem | efried: gibi: so i think it was actually enabling tempest.scenario.test_minbw_allocation_placement.MinBwAllocationPlacementTest.test_qos_min_bw_allocation_basic in nova-next again that is making this worse | 14:50 |
| mriedem | that test creates a public network | 14:51 |
| mriedem | and everything that failed in this job was right around the time that test was running https://zuul.opendev.org/t/openstack/build/b7872ac3886e4cc7a060c1376a2a3395/log/job-output.txt#79124 | 14:51 |
| mriedem | which is also our spike in failures http://logstash.openstack.org/#dashboard/file/logstash.json?query=message%3A%5C%22Details%3A%20%7B'code'%3A%20409%2C%20'message'%3A%20'Multiple%20possible%20networks%20found%2C%20use%20a%20Network%20ID%20to%20be%20more%20specific.'%7D%5C%22%20AND%20tags%3A%5C%22console%5C%22%20AND%20voting%3A1&from=7d | 14:51 |
| *** lbragstad has joined #openstack-nova | 14:52 | |
| *** zbr has joined #openstack-nova | 14:56 | |
| *** ociuhandu has quit IRC | 14:57 | |
| *** cgoncalves has joined #openstack-nova | 14:57 | |
| *** ociuhandu has joined #openstack-nova | 14:57 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Skip test_minbw_allocation_placement in nova-next job https://review.opendev.org/697491 | 14:57 |
| mriedem | gibi: efried: stephenfin: dansmith: if you wanna help the gate and love patriotism ^ | 14:57 |
| stephenfin | I hate patriotism, but I do have the feels for the gate | 14:58 |
| stephenfin | yuuup, +2 | 14:59 |
| stephenfin | lyarwood: What was the reason for the request for configurables here? https://review.opendev.org/#/c/669674/3/nova/compute/manager.py@2613 | 15:01 |
| stephenfin | I want to -1 that patch _because_ of the seemingly extraneous knob but I could missing something | 15:01 |
| *** rpittau is now known as rpittau|afk | 15:03 | |
| lyarwood | stephenfin: looking | 15:07 |
| *** jraju__ has quit IRC | 15:08 | |
| gibi | mriedem: you are right. at the same time of the skip the test we need to keep an eye on the real fix https://review.opendev.org/#/c/682964 | 15:10 |
| mriedem | lyarwood: stephenfin: i left several comments in there too, | 15:11 |
| mriedem | blindly retrying on *any* exception when doing something like deleting an attachment makes me nervous because if cinder returns a 404 because the original request completed and then we keep retrying, we're just going to keep retrying and getting 404s until we exhaust our retries | 15:12 |
| stephenfin | good point | 15:12 |
| lyarwood | stephenfin: no specific reason other than a personal dislike of hardcoded retry values tbh | 15:12 |
| mriedem | iow, can we scope those retries to just 500 errors? | 15:12 |
| stephenfin | and I have a personal dislike of knobs that no one ever touches | 15:12 |
| stephenfin | Unstoppable force, meet immovable object :) | 15:13 |
| lyarwood | Meets the guy with +2 over the guy with +1 so you win | 15:13 |
| lyarwood | mriedem: yeah that's fair, I think a previous PS did previously and I've likely missed that cinder_exception.ClientException covers both? | 15:13 |
| lyarwood | yeah it's the base, gah my bad. | 15:14 |
| mriedem | right so https://github.com/openstack/python-cinderclient/blob/5.0.0/cinderclient/exceptions.py#L242 for 404 will create a NotFound(ClientException) and we'd retry on that | 15:15 |
| mriedem | so we need to scope the retries to ClientExceptions with code==500 only imo | 15:15 |
| *** dpawlik has quit IRC | 15:16 | |
| mriedem | would also be nice to eventually add long_rpc_timeout to cinder for apis like this that have been known to take awhile | 15:16 |
| mriedem | i know we've seen attachment delete timeout in the gate | 15:16 |
| mriedem | surely red hat has some people working on cinder yeah? | 15:16 |
| lyarwood | yup we do, I can follow up with them about that | 15:17 |
| mriedem | https://bugs.launchpad.net/cinder/+bug/1763712 is where i suggested using long_rpc_timeout in cinder | 15:17 |
| openstack | Launchpad bug 1763712 in Cinder "Unable to update the attachment.: MessagingTimeout" [Medium,Confirmed] | 15:17 |
| mriedem | it shouldn't be that hard to add since the cinder rpc stuff is likely very similar to nova's | 15:17 |
| *** ociuhandu has quit IRC | 15:21 | |
| *** ociuhandu has joined #openstack-nova | 15:22 | |
| mriedem | gibi: on https://review.opendev.org/#/c/693248/ can't we just hard-code the server created to use the net0 network - that's the one that has the port with the qos allocations | 15:32 |
| mriedem | oh well i guess shared != external | 15:34 |
| mriedem | so we got the shared public external network and nova puked because by default non-admins can't create servers on external networks | 15:35 |
| *** udesale has quit IRC | 15:37 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova stable/rocky: Cache security group driver https://review.opendev.org/697505 | 15:39 |
| *** abhishekk has quit IRC | 15:41 | |
| *** mkrai has quit IRC | 15:42 | |
| *** mkrai_ has joined #openstack-nova | 15:42 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Regression test for bug 1849657 https://review.opendev.org/693248 | 15:44 |
| openstack | bug 1849657 in OpenStack Compute (nova) train " allocation key is missing from the binding:profile of the neutron qos port when the server is created by a non-admin user" [Medium,Fix committed] https://launchpad.net/bugs/1849657 - Assigned to Balazs Gibizer (balazs-gibizer) | 15:44 |
| *** belmoreira has quit IRC | 15:47 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: WIP: log when loading security group driver https://review.opendev.org/652783 | 15:49 |
| *** belmoreira has joined #openstack-nova | 15:51 | |
| efried | mriedem: ack, thanks for that. | 15:53 |
| efried | my cold has decided to kill me, so I may be sparse today. | 15:54 |
| mriedem | RIP | 15:54 |
| mriedem | efried: fyi i've got a thing in the nova meeting agenda for today but likely not going to be able to attend, it's just a question about if a spec is needed for that filter i'm working on | 15:55 |
| efried | ack | 15:56 |
| mriedem | also, the price is right is on in 4 minutes | 15:56 |
| mriedem | good time to get on the couch with a wubby | 15:56 |
| *** mlavalle has joined #openstack-nova | 15:57 | |
| efried | stephenfin: https://review.opendev.org/#/c/696507/ if you want to update that commit message quick I'll fast approve, no need to rebase anything. | 16:00 |
| efried | do we still say things like $show is on at $time? Who watches anything on a broadcast schedule? | 16:01 |
| stephenfin | okidok | 16:02 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: nova-net: Remove SG tests that don't apply to neutron https://review.opendev.org/696507 | 16:03 |
| stephenfin | efried: ^ | 16:03 |
| efried | stephenfin: +A, thanks for accommodating my pickiness. | 16:04 |
| stephenfin | thanks for the review (y) | 16:04 |
| mordred | efried: I think we maybe contracted the same plague | 16:04 |
| mordred | mriedem: do we need an sdk release for the ironic patch we landed for you? | 16:05 |
| efried | I suspect I actually got two things back to back. Which isn't supposed to happen. | 16:05 |
| *** mkrai_ has quit IRC | 16:05 | |
| mriedem | mordred: at some point, but the nova blueprint that needs it isn't approved yet so it's not a rush | 16:07 |
| mriedem | efried: i wouldn't dvr the price is right because i only watch it like twice a year | 16:07 |
| *** jdillaman has joined #openstack-nova | 16:07 | |
| mriedem | about the same amount of times i buy bacon - usually in the same week | 16:08 |
| *** dave-mccowan has joined #openstack-nova | 16:08 | |
| mriedem | ah the holidays, a time for bacon and day time tv game shows | 16:08 |
| *** yan0s has quit IRC | 16:10 | |
| efried | wow, I buy bacon weekly, in multiple pounds. | 16:10 |
| mordred | my biggest issue with bacon is that it's never possible to buy enough | 16:12 |
| *** bbowen has joined #openstack-nova | 16:12 | |
| mriedem | no one else in my house will eat it (now that mortimer the dog is dead anyway) so i'm not making that smelly mess for myself every day | 16:13 |
| efried | I make the whole mess at once and bag it. Bacon is a food that loses almost nothing reheated. | 16:14 |
| *** maciejjozefczyk has quit IRC | 16:14 | |
| mriedem | reheated in the microwave? | 16:14 |
| mriedem | blasphemy | 16:14 |
| *** ociuhandu has quit IRC | 16:23 | |
| *** jangutter has quit IRC | 16:25 | |
| *** igordc has joined #openstack-nova | 16:27 | |
| *** shilpasd has quit IRC | 16:30 | |
| dansmith | not blasphemy, plus it means bacon more often | 16:31 |
| dansmith | BACON AT EVERY MEAL (tm) | 16:31 |
| efried | Okay, I updated the meeting agenda. I'm going to go be miserable somewhere for a while. | 16:32 |
| openstackgerrit | Matt Riedemann proposed openstack/nova stable/stein: Improve metadata server performance with large security groups https://review.opendev.org/695925 | 16:34 |
| *** tesseract has quit IRC | 16:39 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova stable/rocky: Improve metadata server performance with large security groups https://review.opendev.org/697517 | 16:40 |
| *** gyee has joined #openstack-nova | 16:41 | |
| melwitt | mriedem: I went out on a limb and proposed a backport to queens that landed in rocky, for cleaning up placement consumer records that no longer have allocations https://review.opendev.org/697398 I had to modify it a lot because the code was in different files in queens | 16:41 |
| *** slaweq_ has joined #openstack-nova | 16:41 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova stable/queens: Improve metadata server performance with large security groups https://review.opendev.org/697518 | 16:42 |
| *** openstackgerrit has quit IRC | 16:42 | |
| melwitt | not sure whether that's going to fly but I figured I'd try because it's a pretty big unbounded table grow that otherwise has to be cleaned up manually | 16:43 |
| *** nicolasbock has joined #openstack-nova | 16:44 | |
| mriedem | queens is EM so that's pretty low priority to address but fine to post if you're doing it for downstream anyway and if others want to use it | 16:45 |
| melwitt | ah, I forgot it's EM. ok | 16:46 |
| melwitt | understood | 16:46 |
| *** damien_r has quit IRC | 16:49 | |
| mriedem | dansmith: how do you feel about backporting this? https://review.opendev.org/#/c/696953/ | 16:52 |
| mriedem | seems ok since it's tied to a long-standing bug but wanted a 2nd opinion | 16:52 |
| dansmith | mriedem: yeah, I mean... as long as the old version has a sufficient oslo.messaging and the config knob, I can't really think of any reason not to do tose | 16:53 |
| dansmith | *those | 16:53 |
| *** openstackgerrit has joined #openstack-nova | 16:53 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova stable/pike: Improve metadata server performance with large security groups https://review.opendev.org/697523 | 16:53 |
| mriedem | lyarwood: i'd be +2 on this https://review.opendev.org/#/c/696953/ but i'm not sure how pedantic you want to be about using the correct source commit hash | 16:56 |
| mriedem | given train and stein had conflicts which you've already resolved i'm assuming you don't want to redo all of that | 16:57 |
| *** dave-mccowan has quit IRC | 16:58 | |
| mriedem | nvm i just +2ed | 16:59 |
| *** dave-mccowan has joined #openstack-nova | 17:00 | |
| mriedem | dansmith: you want to get this https://review.opendev.org/#/c/696339/ and this then https://review.opendev.org/696953 | 17:01 |
| *** slaweq_ has quit IRC | 17:02 | |
| *** ociuhandu has joined #openstack-nova | 17:02 | |
| dansmith | yar | 17:03 |
| lyarwood | mriedem: sorry was on a call, I really don't care about the source commit hash with backports given the Change IDs tbh. That said I have no idea how I ended up using the wrong one for this. | 17:06 |
| lyarwood | mriedem: and thanks | 17:06 |
| *** dave-mccowan has quit IRC | 17:10 | |
| *** salmankhan has quit IRC | 17:13 | |
| *** dtantsur is now known as dtantsur|afk | 17:19 | |
| *** lennyb has quit IRC | 17:20 | |
| *** lennyb has joined #openstack-nova | 17:26 | |
| *** lennyb has quit IRC | 17:32 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova stable/pike: rt: only map compute node if we created it https://review.opendev.org/676463 | 17:33 |
| *** lennyb has joined #openstack-nova | 17:36 | |
| *** lpetrut has quit IRC | 17:40 | |
| *** lennyb has quit IRC | 17:41 | |
| *** ccamacho has quit IRC | 17:46 | |
| *** lennyb has joined #openstack-nova | 17:46 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova stable/ocata: Add functional regression test for bug 1849409 https://review.opendev.org/690746 | 17:54 |
| openstack | bug 1849409 in OpenStack Compute (nova) queens "openstack server list --deleted --limit -1 hangs" [High,In progress] https://launchpad.net/bugs/1849409 - Assigned to Matt Riedemann (mriedem) | 17:54 |
| openstackgerrit | Matt Riedemann proposed openstack/nova stable/ocata: Fix listing deleted servers with a marker https://review.opendev.org/690747 | 17:54 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: functional: Make '_IntegratedTestBase' subclass 'InstanceHelperMixin' https://review.opendev.org/689182 | 17:57 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: functional: Remove 'get_invalid_image' https://review.opendev.org/697454 | 17:57 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: functional: Add unified '_build_server' helper function https://review.opendev.org/697537 | 17:57 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: functional: Add unified '_(build|create)_flavor' helper functions https://review.opendev.org/697538 | 17:57 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: functional: Add '_delete_server' to 'InstanceHelperMixin' https://review.opendev.org/697539 | 17:57 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: functional: Add '_create_server' helper https://review.opendev.org/697540 | 17:57 |
| *** derekh has quit IRC | 18:00 | |
| stephenfin | sean-k-mooney: One comment on https://review.opendev.org/#/c/674072/ | 18:05 |
| *** lennyb has quit IRC | 18:06 | |
| *** lpetrut has joined #openstack-nova | 18:07 | |
| stephenfin | sean-k-mooney: also on https://review.opendev.org/#/c/687957/ | 18:16 |
| stephenfin | and with that... | 18:16 |
| * stephenfin -> 🏠 | 18:16 | |
| *** ociuhandu has quit IRC | 18:17 | |
| *** awalende has quit IRC | 18:20 | |
| *** awalende has joined #openstack-nova | 18:21 | |
| *** awalende has quit IRC | 18:25 | |
| *** jdillaman has quit IRC | 18:34 | |
| *** artom has quit IRC | 18:35 | |
| *** artom has joined #openstack-nova | 18:35 | |
| sean-k-mooney | stephenfin: yep ill take a look and adress them today. just back form dinner so ill work on that shortly | 18:35 |
| *** ralonsoh has quit IRC | 18:37 | |
| *** dave-mccowan has joined #openstack-nova | 18:38 | |
| *** jdillaman has joined #openstack-nova | 18:48 | |
| *** martinkennelly has quit IRC | 18:50 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Add resource provider allocation unset example to troubleshooting doc https://review.opendev.org/696582 | 18:50 |
| *** lennyb has joined #openstack-nova | 18:53 | |
| *** ociuhandu has joined #openstack-nova | 19:07 | |
| efried | mriedem, smcginnis, jungleboyj: Any ideas on how to make sure we've tested https://review.opendev.org/697134 through os-brick? | 19:17 |
| *** jmlowe has quit IRC | 19:19 | |
| mriedem | efried: i commented but tl;dr i can't think of anything | 19:19 |
| mriedem | this is assuming that all of os-brick is using privsep and not any rootwrap helpers for some of the backends in os-brick somewhere | 19:20 |
| mriedem | we can see that it's fine for lvm and rbd though | 19:20 |
| mriedem | the libvirt driver uses os-brick, the ceph job uses the rbd volume type and backend, and all other jobs are using lvm | 19:20 |
| mriedem | if there is something else in brick not using privsep then we likely won't see it here, but once we land this i'd think 3rd party CIs in cinder would be failing and alerting to cinder team | 19:21 |
| mriedem | though if cinder's 3rd party ci's are anything like ours, there are probably many that fail often so people don't pay attention | 19:21 |
| mriedem | the quobyte ci might be a decent indication and it failed but it also didn't report anything | 19:22 |
| mriedem | kaisers: ^ | 19:22 |
| efried | thanks for the look mriedem | 19:24 |
| mriedem | looking at the hyperv logs, and i noticed this the other day as well, they seem to hit https://review.opendev.org/#/q/topic:bug/1748697+(status:open+OR+status:merged) quite a bit | 19:25 |
| mriedem | doing cold migration testing and the scheduler picks the current host which triggers a reschedule | 19:26 |
| efried | ttx: If you concur, my philosophy is that we should merge this now to give some soak time for 3pCIs to uncover issues. We can always revert if we need to. | 19:26 |
| mriedem | 2019-12-05 11:43:22.672 2556 2225548250976 MainThread ERROR nova.compute.manager [req-3e316bf9-f63f-4388-8da2-108d7781d6f8 14ffcc57bb934290aa4ec7ba0ff79a98 6fec721e534d443f9aa4123acb1d9d20 - default default] [instance: ebcd3e84-9ee7-455d-be7a-849338e9781e] Error: Instance rollback performed due to: Unable to migrate instance (ebcd3e84-9ee7-455d-be7a-849338e9781e) to current host (n-h1-697134-2).: nova.exception.InstanceFaultR | 19:26 |
| mriedem | ack: Instance rollback performed due to: Unable to migrate instance (ebcd3e84-9ee7-455d-be7a-849338e9781e) to current host (n-h1-697134-2). | 19:26 |
| jungleboyj | efried: I concur with mriedem 's analysis. | 19:28 |
| efried | thanks jungleboyj | 19:28 |
| jungleboyj | Unfortunately the CIs aren't super reliable so what kind of flags it will send up I don't know. | 19:28 |
| jungleboyj | It should be covered by the check for RBD and LVM though. | 19:29 |
| jungleboyj | So, that is a good start. | 19:29 |
| mriedem | hemna_ should be able to just tell us if there is anything in os-brick that isn't using privsep | 19:29 |
| jungleboyj | I feel like we got things moved over. | 19:30 |
| *** ociuhandu has quit IRC | 19:31 | |
| hemna_ | I don't think any of the connectors were using rootwrap, but I'd have to look closely. | 19:31 |
| *** mvkr has quit IRC | 19:31 | |
| *** dave-mccowan has quit IRC | 19:36 | |
| jungleboyj | hemna_: Have I mentioned it is good to have you back? | 19:37 |
| efried | mriedem: I don't know if we're talking about different things that could (n)ever work by filtering GET /a_c with (required or forbidden) COMPUTE_SAME_HOST_COLD_MIGRATE. I tried to explain myself again. | 19:39 |
| efried | We don't have "conditional traits". We can't say "exclude if rp_uuid=$self and !COMPUTE_SAME_HOST_COLD_MIGRATE". Without that conditional, saying required=!COMPUTE_SAME_HOST_COLD_MIGRATE will never, ever make sense. Ever. | 19:40 |
| mriedem | i replied, think i got what you're saying | 19:43 |
| hemna_ | :) thanks man | 19:43 |
| sean-k-mooney | efried: well required=!COMPUTE_SAME_HOST_COLD_MIGRATE litrally would mean a host that cant support same host cold migration but ya we can tmake that require ment condionaly only if rp_uuid is a specific value and ignore it otherwsie for the same allocation candiate | 19:46 |
| efried | right | 19:46 |
| hemna_ | from what I can tell, most stuff works through the Executor, which defaults to privsep, or the privileged/rootwrap.execute, which also defaults to privsep | 19:46 |
| efried | mriedem: before I dive back into the nova side, is it using the trait? | 19:47 |
| efried | (for the post-filter, that is) | 19:47 |
| mriedem | https://review.opendev.org/#/c/676022/ is a backportable workaround that is not, but if we don't care about backportability for the fix, then i will abandon. the patch that comes after that https://review.opendev.org/#/c/695220/ uses the trait yes and has a functional test to show it working. | 19:48 |
| mriedem | well, it's using a custom trait for now since the os-traits patch isn't released | 19:48 |
| mriedem | same idea | 19:48 |
| efried | okay, I didn't see a Depends-On at the top so that's what I was asking. Will dig in. | 19:49 |
| mriedem | i left a draft proposed comment for the os-traits change if it will work for you | 19:49 |
| efried | I'm responding. But maybe easier to discuss here... | 19:50 |
| efried | That's a reasonable walkthrough of a specific scenario, but my reasoning was much simpler than that. | 19:50 |
| mriedem | just tell me what to write | 19:50 |
| efried | let me talk this out first | 19:51 |
| efried | If I'm on a host and doing a cold migrate, the condition I want to express is "if SHCM is not supported by $me, exclude $me from the results". | 19:51 |
| mriedem | correct | 19:52 |
| efried | but we don't have any placement way to say that | 19:52 |
| mriedem | not unless there is some !in_tree logic in GET /a_c i'm not aware of | 19:52 |
| sean-k-mooney | right we would have to do too quires. one to determin if we support X and then a second with either this host included or excluded | 19:52 |
| efried | Exactly, point being that the GET /a_c query wouldn't involve the SHCM trait; it would involve the host (RP (tree)) we want to exclude. | 19:53 |
| efried | ...assuming !in_tree was a thing | 19:54 |
| * efried looks | 19:54 | |
| *** damien_r has joined #openstack-nova | 19:54 | |
| sean-k-mooney | i think that was aded but the in paramter of traits was not | 19:54 |
| efried | we were going to do something like that for CERNs server groups case, right? | 19:54 |
| mriedem | i don't remember | 19:55 |
| sean-k-mooney | for anti affinity i think | 19:55 |
| mriedem | there is no !in_tree semantics documented in the GET /a_c reference | 19:55 |
| efried | nor in the gabbits, so yeah, I don't think that's a thing. | 19:55 |
| sean-k-mooney | we may have drop the propsoal since we did not need it in train | 19:56 |
| efried | regardless, the point is that we don't expect that trait to ever make sense in a GET /a_c query because we have no way to express the SAME_HOST part of it in GET /a_c | 19:57 |
| mriedem | as for anti-affinity....there is a member_of=!in, so for server groups you could create a provider aggregate for any host a member of that group is on and then when scheduling others you'd say !in for any other provider aggregate that represents other hosts in the group that has members, maybe - or not, it's all confusing and a tangent to what i'm trying to solve | 19:57 |
| efried | it's, like, a tautological impossibility. | 19:57 |
| mriedem | well, saying "no never because we can't ever" and "because GET /a_c doesn't have some semantics today" is a conflict, but sure | 19:58 |
| mriedem | i agree today it's not possible | 19:58 |
| mriedem | anyway, that's kind of why i didn't really want to put a bunch of words in a comment in os-traits about the state of how things are done between nova and placement today | 19:59 |
| mriedem | it's super duper tight coupling | 19:59 |
| efried | it's tight coupling between os-traits and placement, not anything and nova. | 20:00 |
| mriedem | efried: if you're asking for a comment about why the trait can't be used in GET /a_c then that seems like something that should go in the nova change that's using the trait | 20:00 |
| mriedem | because that is the code that would eventually be changed, not where the trait lives in os-traits | 20:00 |
| mriedem | i mean, if you're asking about a reminder to yourself if someone tries to do this some day | 20:00 |
| efried | that would also be good. | 20:01 |
| eandersson | This RabbitMQ issue is so weird. | 20:02 |
| eandersson | The compute queues only are getting messages, but they are staying as un'ackd. | 20:02 |
| sean-k-mooney | eandersson: have you restarted the nova compute agent | 20:02 |
| *** rcernin has joined #openstack-nova | 20:02 | |
| eandersson | We suspect RabbitMQ still, but it's weird that it is only affectin compute. | 20:03 |
| eandersson | Yea sean-k-mooney they are kept as unac'kd even after restarting the agent. So for sure a RabbitMQ issue, but don't know what triggers it. | 20:03 |
| efried | mriedem: responded x2 | 20:03 |
| mriedem | efried: so to recap, what i'd like to do is (1) remove the mention from the os-traits commit message about eventually doing GET /a_c or whatever, (2) *not* leave a coupled comment next to the trait, and instead (3) put a comment about that in the nova patch https://review.opendev.org/#/c/695220/ | 20:03 |
| efried | mriedem: (2) do leave a comment, (3) do put a comment. | 20:03 |
| efried | They're different comments | 20:04 |
| sean-k-mooney | eandersson: oh ok so its not the issue where the compute agent does not recreate the topic queue if the rabbmq server goes offline | 20:04 |
| *** dosaboy has quit IRC | 20:04 | |
| sean-k-mooney | eandersson: im not sure what that issue is then | 20:05 |
| *** igordc has quit IRC | 20:05 | |
| efried | (2) I suggested in the os-traits patch, just talks about GET /a_c. (3) should have your specific libvirt scenario described | 20:05 |
| openstackgerrit | Matt Riedemann proposed openstack/os-traits master: Add COMPUTE_SAME_HOST_COLD_MIGRATE trait https://review.opendev.org/666604 | 20:07 |
| mriedem | done | 20:08 |
| mriedem | artom: dansmith: shall i just abandon the backportable workaround option that is https://review.opendev.org/#/c/676022/ and focus on the trait-based master-only solution to the extremely latent bug? | 20:09 |
| mriedem | if it's this latent people obviously don't care enough so backports are a meh to me at this point | 20:09 |
| efried | mriedem: +2, thanks for bearing with me. | 20:09 |
| mriedem | same | 20:10 |
| *** jmlowe has joined #openstack-nova | 20:12 | |
| dansmith | mriedem: sounds like that would sidestep the whole argument, so.. yes? | 20:12 |
| efried | It's got a bug heat of 32 fwiw. | 20:13 |
| efried | Multiple people commented on it over the almost-2y it's been open. | 20:13 |
| efried | so having a backportable solution doesn't seem like a terrible idea to me. | 20:14 |
| efried | but I need to relook at how ugly it is. | 20:14 |
| mriedem | i've abandoned | 20:14 |
| mriedem | people can cherry pick it downstream if they really need it | 20:14 |
| efried | okay | 20:14 |
| *** ceryx is now known as ccstone | 20:15 | |
| efried | mriedem: I guess you're going to rebase and clean up the other one now, so I should wait to review? | 20:15 |
| efried | yeah | 20:16 |
| mriedem | i'm not going to get to that today but it won't be much different | 20:16 |
| mriedem | probably crank it out in the wee morn | 20:16 |
| efried | I didn't open any of the files, but the commit message at least needs an overhaul. | 20:16 |
| mriedem | ubetcha | 20:17 |
| efried | okay, let's see if I can think clearly enough to get back to rg/rp mappings... | 20:17 |
| *** rcernin has quit IRC | 20:18 | |
| efried | mriedem: if you're feeling magnanimous, you could hit the bottom three patches here, fairly simple: https://review.opendev.org/#/c/696418/ | 20:18 |
| mriedem | oh god request groups | 20:19 |
| mriedem | i think melwitt said she wanted to learn more about this part of the code | 20:19 |
| efried | hahaha | 20:19 |
| efried | In my IRC client, melwitt shows up a nice grasshopper green. Coincidence? | 20:20 |
| mriedem | as in the kung fu grasshopper pupil green? | 20:21 |
| *** awalende has joined #openstack-nova | 20:21 | |
| mriedem | or the "oh god request groups, i think i'm going to be sick" green | 20:21 |
| *** awalende has quit IRC | 20:25 | |
| mriedem | gibi: a few nits in https://review.opendev.org/#/c/696245/ if you want to start a FUP patch for that series | 20:32 |
| openstackgerrit | Eric Fried proposed openstack/nova master: WIP: Use provider mappings from Placement (mostly) https://review.opendev.org/696992 | 20:34 |
| *** damien_r has quit IRC | 20:34 | |
| *** bbowen has quit IRC | 20:42 | |
| efried | meeting now | 21:00 |
| *** jdillaman has quit IRC | 21:01 | |
| *** eharney has quit IRC | 21:06 | |
| *** dosaboy has joined #openstack-nova | 21:09 | |
| efried | mriedem: The vote in the meeting was unanimous: do a spec for the ironic owner filter | 21:14 |
| efried | (unanimous: both of us) | 21:14 |
| sean-k-mooney | im not sure i normally get a vote so it was also unilatreral | 21:14 |
| sean-k-mooney | but close enough | 21:15 |
| *** jdillaman has joined #openstack-nova | 21:15 | |
| efried | We don't really vote officially on things like that anyway, so it was all opinion | 21:16 |
| efried | and you know what they say about opinions. | 21:16 |
| sean-k-mooney | :) as an fyi i will be going on vacation in about a week so im going to rebase the two feature im trying to get merged into a chain since they will conflict if i dont | 21:17 |
| sean-k-mooney | for what its worth of the two option i kind of prefer the tradtional filter for filtering nodes by owner | 21:20 |
| sean-k-mooney | if we did it a placemnt way i woudl thing an aggreate feel more natual for grouping RP the a custom trait | 21:21 |
| *** jaosorior has joined #openstack-nova | 21:22 | |
| sean-k-mooney | anyway that is just my gut reaction so i have not really tought about it much | 21:22 |
| efried | sean-k-mooney: we've already established that a trait won't work without hackitude. | 21:27 |
| sean-k-mooney | ack ya noticed the comment form mriedem after i wrote that | 21:27 |
| *** ociuhandu has joined #openstack-nova | 21:41 | |
| *** stephenfin has quit IRC | 21:50 | |
| efried | dansmith: TypeError: Object of type 'datetime' is not JSON serializable | 21:52 |
| *** dasp_ has joined #openstack-nova | 21:52 | |
| efried | This on a cast of prep_resize | 21:52 |
| efried | The payload appears to have datetime.datetime objects in the image meta | 21:53 |
| efried | what's odd is, this wasn't failing before I changed something in a totally different place | 21:53 |
| *** jaosorior has quit IRC | 21:53 | |
| dansmith | efried: nothing obvious, other than that oslo.serialization has some quiet handling of that | 21:54 |
| *** dasp has quit IRC | 21:55 | |
| dansmith | and there was also some proposed change recently specifically about that, but I think we determined it wasn't going to be a problem | 21:55 |
| *** stephenfin has joined #openstack-nova | 21:57 | |
| efried | that's pretty bizarre | 21:57 |
| dansmith | what is? | 21:57 |
| efried | Is it possible this stack trace is a red herring and the problem is really somewhere else? | 21:58 |
| dansmith | isn't that pretty much always a true statement? :) | 21:58 |
| melwitt | mriedem, efried: lol, you rascals (just read the mentions about request groups) | 22:08 |
| efried | you got ToRed | 22:09 |
| efried | as my father would say | 22:09 |
| efried | (Transfer of Responsibility) | 22:09 |
| *** nweinber has quit IRC | 22:09 | |
| efried | dansmith: I think my venv might have just been out of date. Repro'd same result against master. Rebuilding... | 22:14 |
| efried | yuh, that cleared it up. | 22:16 |
| sean-k-mooney | stale pyc files | 22:17 |
| sean-k-mooney | maybe | 22:17 |
| sean-k-mooney | still an odd error | 22:18 |
| efried | no, don't we get bad magic number when that happens? In this case I'm betting it was a downrev of oslo.serialization or similar. | 22:18 |
| efried | don't care enough to track it down exactly. | 22:18 |
| *** bbowen has joined #openstack-nova | 22:19 | |
| *** ociuhandu has quit IRC | 22:20 | |
| *** rcernin has joined #openstack-nova | 22:28 | |
| openstackgerrit | Eric Fried proposed openstack/nova master: Use provider mappings from Placement (mostly) https://review.opendev.org/696992 | 22:43 |
| efried | mriedem, dansmith, sean-k-mooney, gibi, stephenfin: I think this is done ^ | 22:44 |
| efried | It uses placement 1.34 to get rid of the hack where we were calculating mappings based on allocations, in all code paths except revert_resize. | 22:44 |
| efried | and knocks down another two microversions in the parity gap. | 22:45 |
| sean-k-mooney | oh thi si sremoving the code we had on the nova side to compute that and using the info returned form placement correct | 22:53 |
| efried | yeah, unfortunately it doesn't remove the code yet, cause it's still needed by revert_resize. Haven't figure out how we're going to fix that yet. Maybe I leave that to gibi :P | 22:54 |
| sean-k-mooney | will we need to keep it for upgrade too? | 22:54 |
| sean-k-mooney | for n-1 | 22:54 |
| efried | I wouldn't have thought so. The data is identical (for existing use cases), just the method of computing that changed. | 22:55 |
| efried | We no longer support downrev placements, you gotta upgrade placement first. | 22:55 |
| sean-k-mooney | sure but did we ever need to look this up on the compute node or was it only used in the schduler | 22:56 |
| efried | um | 22:56 |
| efried | yeah, I think we wanted to be able to use it from the compute | 22:56 |
| efried | but hadn't yet. | 22:56 |
| sean-k-mooney | ok if we havent yet its not an upgrade issue :) | 22:57 |
| sean-k-mooney | we will have the placment native way before we do | 22:57 |
| efried | Like, to correlate VGPUs with the proper mdevs, and eventually to make sure we pin CPUs from the right NUMA nodes. | 22:57 |
| sean-k-mooney | yep that is what i was thinking of | 22:57 |
| sean-k-mooney | we will need to use the mapping when doing the physical assignment on the compute node | 22:58 |
| sean-k-mooney | to make sure we assign the resocue that corralates with the allocation | 22:58 |
| efried | actually, I guess bw gets around that today because the mapping is stuffed into the binding profile, so (I'm guessing) the compute pulls it from there. | 22:58 |
| efried | to... figure out which NIC to assign? | 22:58 |
| efried | start talking network stuff, I hear woh woh woh | 22:58 |
| sean-k-mooney | in the sriov case maybe | 22:58 |
| sean-k-mooney | in the ovs case it does not matter | 22:58 |
| sean-k-mooney | actully in the sriov cas ethe port request has the pf netdev name and we add that to the pci_request object | 23:00 |
| sean-k-mooney | so again stuffing stuff in the vif object to avoid the problem | 23:00 |
| efried | I think ima rebase on the "skip the bw test" patch, and put one on top unskipping to prove it works. | 23:01 |
| efried | so I don't have to recheck a zillion times on that stupid multi-network bug. | 23:01 |
| *** tkajinam has joined #openstack-nova | 23:07 | |
| openstackgerrit | Eric Fried proposed openstack/nova master: Use Placement 1.34 (string suffixes & mappings) https://review.opendev.org/696418 | 23:08 |
| openstackgerrit | Eric Fried proposed openstack/nova master: refactor: RequestGroup.is_empty() and .strip_zeros() https://review.opendev.org/696991 | 23:08 |
| openstackgerrit | Eric Fried proposed openstack/nova master: Tie requester_id to RequestGroup suffix https://review.opendev.org/696946 | 23:08 |
| openstackgerrit | Eric Fried proposed openstack/nova master: Use provider mappings from Placement (mostly) https://review.opendev.org/696992 | 23:08 |
| openstackgerrit | Eric Fried proposed openstack/nova master: Restore test_minbw_allocation_placement in nova-next job https://review.opendev.org/697586 | 23:08 |
| efried | mriedem, gibi: FYI, re-restoring that minbw test via https://review.opendev.org/#/c/697586/ | 23:13 |
| efried | It's at the top of that series for now so I can prove the top patch works, can move it later if necessary. | 23:14 |
| efried | and with that, I'm outta here o/ | 23:15 |
| openstackgerrit | sean mooney proposed openstack/nova master: Block rebuild when NUMA topology changed https://review.opendev.org/687957 | 23:21 |
| openstackgerrit | sean mooney proposed openstack/nova master: Disable NUMATopologyFilter on rebuild https://review.opendev.org/689861 | 23:21 |
| openstackgerrit | sean mooney proposed openstack/nova master: support pci numa affinity policies in flavor and image https://review.opendev.org/674072 | 23:22 |
| sean-k-mooney | also rebased that on top of the same skip patch to avoid the rechecks | 23:23 |
| *** avolkov has quit IRC | 23:26 | |
| *** nicolasbock has quit IRC | 23:29 | |
| *** ociuhandu has joined #openstack-nova | 23:30 | |
| *** dviroel has quit IRC | 23:35 | |
| *** ociuhandu has quit IRC | 23:35 | |
| *** tosky has quit IRC | 23:38 | |
| *** abaindur has joined #openstack-nova | 23:40 | |
| *** abaindur has quit IRC | 23:44 | |
| *** abaindur has joined #openstack-nova | 23:45 | |
| *** mdbooth has quit IRC | 23:49 | |
| *** mdbooth has joined #openstack-nova | 23:50 | |
| *** mvkr has joined #openstack-nova | 23:55 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!