Tuesday, 2020-08-04

*** k_mouza has joined #openstack-nova00:01
*** avolkov has quit IRC00:03
*** k_mouza has quit IRC00:06
*** k_mouza has joined #openstack-nova00:16
*** brinzhang0 has joined #openstack-nova00:19
*** k_mouza has quit IRC00:21
*** brinzhang_ has quit IRC00:22
*** songwenping_ has joined #openstack-nova00:29
*** songwenping__ has quit IRC00:32
*** eharney has joined #openstack-nova00:36
openstackgerritTony Su proposed openstack/nova master: Provider Config File: Functions to merge provider configs to provider tree  https://review.opendev.org/67652200:49
openstackgerritTony Su proposed openstack/nova master: Provider Config File: Enable loading and merging of provider configs  https://review.opendev.org/69346000:49
*** spatel has joined #openstack-nova00:57
*** songwenping__ has joined #openstack-nova01:13
*** songwenping_ has quit IRC01:17
*** songwenping_ has joined #openstack-nova01:22
*** songwenping__ has quit IRC01:25
*** spatel has quit IRC01:33
*** songwenping__ has joined #openstack-nova01:38
*** songwenping_ has quit IRC01:41
*** songwenping_ has joined #openstack-nova01:53
*** songwenping__ has quit IRC01:56
*** sapd1_x has joined #openstack-nova02:02
*** bauzas has quit IRC02:14
*** tetsuro has quit IRC02:19
*** bauzas has joined #openstack-nova02:20
*** mkrai has joined #openstack-nova02:26
*** rcernin has quit IRC02:27
*** bauzas has quit IRC02:27
*** gyee has quit IRC02:29
*** bauzas has joined #openstack-nova02:29
*** rcernin has joined #openstack-nova02:30
*** bauzas has quit IRC02:42
*** bauzas has joined #openstack-nova02:43
*** songwenping__ has joined #openstack-nova02:45
*** yaawang has quit IRC02:47
*** yaawang has joined #openstack-nova02:47
*** songwenping_ has quit IRC02:48
tony_sustephenfin: gibi: the last 3 patches for provider-config-file are ready for a new round of review with comments answered. Thanks.02:49
tony_suI checked zuul failure and found no relation to us.02:50
*** bauzas has quit IRC02:50
*** bauzas has joined #openstack-nova02:53
*** bauzas has quit IRC02:58
*** bauzas has joined #openstack-nova02:58
*** songwenping_ has joined #openstack-nova03:28
openstackgerritrenminmin proposed openstack/nova master: SRIOV: Fix instance with macvtap port live migration failed  https://review.opendev.org/73843203:28
*** songwenping__ has quit IRC03:30
*** hongbin has joined #openstack-nova03:35
*** psachin has joined #openstack-nova03:37
*** vishalmanchanda has joined #openstack-nova03:42
*** songwenping__ has joined #openstack-nova03:47
*** songwenping_ has quit IRC03:50
*** dave-mccowan has quit IRC04:02
*** sapd1_x has quit IRC04:05
*** songwenping_ has joined #openstack-nova04:08
*** hamalq has joined #openstack-nova04:09
*** hamalq has quit IRC04:09
*** hongbin has quit IRC04:10
*** hamalq has joined #openstack-nova04:10
*** songwenping__ has quit IRC04:11
*** hamalq has quit IRC04:17
*** k_mouza has joined #openstack-nova04:17
*** ratailor has joined #openstack-nova04:21
*** k_mouza has quit IRC04:21
*** ratailor has quit IRC04:26
*** songwenping__ has joined #openstack-nova04:28
*** songwenping_ has quit IRC04:31
*** evrardjp has quit IRC04:33
*** evrardjp has joined #openstack-nova04:33
*** songwenping_ has joined #openstack-nova05:03
*** songwenping__ has quit IRC05:06
*** xiaolin has quit IRC05:10
*** songwenping__ has joined #openstack-nova05:18
*** songwenping_ has quit IRC05:21
*** songwenping_ has joined #openstack-nova05:26
*** songwenping__ has quit IRC05:30
*** udesale has joined #openstack-nova05:36
*** Yumeng has joined #openstack-nova05:41
*** songwenping__ has joined #openstack-nova05:46
*** songwenping_ has quit IRC05:49
*** songwenping__ has quit IRC05:50
*** songwenping__ has joined #openstack-nova05:50
*** ircuser-1 has joined #openstack-nova05:59
*** belmoreira has joined #openstack-nova06:15
*** xek has joined #openstack-nova06:19
devfaz_hi, just run into an issue with no longer existing server groups. I had to evacuate some instances, but they failed, because the server group no longer exists. Just googled a bit and found https://bugs.launchpad.net/nova/+bug/1298509. I understand, that it should be possible to delete a server group with instances, but there should be also a way to update / remove the entry from the instances -06:26
openstackLaunchpad bug 1298509 in OpenStack Compute (nova) ""nova server-group-delete" allows deleting server group with members" [Wishlist,Opinion]06:26
devfaz_else the makes the instances unbootable.06:26
*** eharney has quit IRC06:35
*** devfaz_ is now known as devfaz06:39
gibidevfaz: do you have a stack trace from the log with the failure? I've quickly tried with resize and that worked with deleted server group06:50
devfazgibi: one moment06:51
*** slaweq has joined #openstack-nova06:52
*** eharney has joined #openstack-nova06:53
devfazgibi: no stack-trace, just Filtering removed all hosts for the request with instance ID 'adddf2c9-0252-4463-a97c-f1ec209d9f49'. Filter results: ['AvailabilityZoneFilter: (start: 2, end: 2)', 'ComputeFilter: (start: 2, end: 2)', 'ComputeCapabilitiesFilter: (start: 2, end: 2)', 'ImagePropertiesFilter: (start: 2, end: 2)', 'ServerGroupAntiAffinityFilter: (start: 2, end: 2)',06:55
devfaz'ServerGroupAffinityFilter: (start: 2, end: 0)']06:55
gibidevfaz: I think it worth a bug report. I think nova needs to ignore delete server groups during scheduling06:56
devfazand in the "server show", i get as fault-value. Instance group 4b9a2cc5-cc44-470e-9ad0-68dcc9f8c60e could not be found.06:56
devfazgibi: ok, i will create a new one06:57
devfazthx a lot!06:57
*** links has joined #openstack-nova06:57
*** mvorwerk has joined #openstack-nova07:04
devfazhttps://bugs.launchpad.net/nova/+bug/189024407:05
openstackLaunchpad bug 1890244 in OpenStack Compute (nova) "nova scheduler should ignore removed groups" [Undecided,New]07:05
devfazgibi: fyi07:05
*** mvorwerk_ has joined #openstack-nova07:09
*** mvorwerk has quit IRC07:09
*** mkrai has quit IRC07:10
*** mkrai_ has joined #openstack-nova07:10
openstackgerritBence Romsics proposed openstack/nova master: doc: Add IPv6 metadata address  https://review.opendev.org/74449207:10
*** dtantsur|afk is now known as dtantsur07:16
*** tesseract has joined #openstack-nova07:17
*** xek has quit IRC07:22
*** rcernin has quit IRC07:22
*** sapd1_x has joined #openstack-nova07:23
*** mkrai_ has quit IRC07:30
*** tosky has joined #openstack-nova07:48
*** ralonsoh has joined #openstack-nova07:50
*** ralonsoh has quit IRC07:50
*** ralonsoh has joined #openstack-nova07:52
*** martinkennelly has joined #openstack-nova07:54
*** mkrai has joined #openstack-nova07:58
*** xek has joined #openstack-nova08:06
*** mkrai has quit IRC08:09
openstackgerritXinran WANG proposed openstack/os-resource-classes master: Add new resource class for QAT card.  https://review.opendev.org/72631408:09
*** mkrai has joined #openstack-nova08:10
*** xek has quit IRC08:18
*** jhesketh has quit IRC08:24
*** xek has joined #openstack-nova08:37
*** priteau has joined #openstack-nova08:43
*** derekh has joined #openstack-nova08:47
*** k_mouza has joined #openstack-nova08:53
*** tetsuro has joined #openstack-nova08:55
*** rcernin has joined #openstack-nova08:59
*** nightmare_unreal has joined #openstack-nova09:06
*** avolkov has joined #openstack-nova09:08
*** xek has quit IRC09:08
*** jangutter has quit IRC09:11
*** jangutter has joined #openstack-nova09:11
*** lpetrut has joined #openstack-nova09:12
*** rcernin has quit IRC09:16
*** ociuhandu_ has joined #openstack-nova09:21
*** ociuhandu has quit IRC09:21
*** yaawang has quit IRC09:23
*** yaawang has joined #openstack-nova09:26
lyarwoodgibi: https://review.opendev.org/#/c/744506/ - morning, when you have time this should fix the lower-constraints job on master at least for now09:38
* lyarwood does note that some of the stable branches are now failing09:38
lyarwoodhttps://zuul.opendev.org/t/openstack/builds?job_name=openstack-tox-lower-constraints&project=openstack%2Fnova for context09:39
*** ralonsoh has quit IRC09:40
*** ralonsoh has joined #openstack-nova09:41
*** jangutter has quit IRC09:46
*** jangutter has joined #openstack-nova09:46
*** k_mouza has quit IRC09:47
*** k_mouza has joined #openstack-nova09:59
elodlyarwood: it seems every job have some *constraint related issue now (but some are not visible as does not cause failure), see discussion from infra channel yesterday: http://eavesdrop.openstack.org/irclogs/%23openstack-infra/%23openstack-infra.2020-08-03.log.html#t2020-08-03T16:22:0510:03
elodlyarwood: the interesting thing is that I cannot reproduce that locally :/10:03
*** yaawang has quit IRC10:04
*** yaawang has joined #openstack-nova10:05
*** xek has joined #openstack-nova10:11
*** udesale_ has joined #openstack-nova10:12
*** tkajinam has quit IRC10:12
lyarwoodelod: ack thanks10:13
lyarwoodelod: I was eventually able to reproduce the master issue yesterday on a 18.04 vm but yeah it wasn't easy at all10:13
*** udesale has quit IRC10:14
elodelod: oh, sounds good! \o/10:15
elodlyarwood: ^^^ :]10:15
elodlyarwood: also there's a new release of pip, there's an interesting change: "Correctly find already-installed distributions with dot (.) in the name and uninstall them when needed. "  ( https://pip.pypa.io/en/stable/news/#id1 )10:16
elodespecially as the failure came when already installed packages were reinstalled (without constraints)10:16
*** belmoreira has quit IRC10:17
*** k_mouza has quit IRC10:21
*** jhesketh has joined #openstack-nova10:21
*** sapd1_x has quit IRC10:24
lyarwoodelod: ah that is interesting10:26
*** k_mouza has joined #openstack-nova10:27
*** ociuhandu_ has quit IRC10:30
*** ociuhandu has joined #openstack-nova10:31
*** songwenping_ has joined #openstack-nova10:33
elodlyarwood: well, it seems something changed, but I still see the issue in zuul jobs :S10:35
*** songwenping__ has quit IRC10:36
*** sapd1_x has joined #openstack-nova10:36
*** ociuhandu has quit IRC10:36
elodlyarwood: do you have somewhere the steps, how the failure can be reproduced locally?10:36
lyarwoodelod: I didn't write them down sorry, I just built an env using virt-builder and installed tox directly from pypy instead of packages10:40
lyarwoodelod: iirc I had to bump MarkupSafe to workaround another issue10:40
*** tetsuro has quit IRC10:44
elodlyarwood: ok, no problem. actually I did the same, installed latest pip and tox from pypi. worth to mention that once it worked for me as in zuul, but then I couldn't reproduce it again with the steps I thought it should be reproducable :S10:49
*** xek has quit IRC10:50
*** rcernin has joined #openstack-nova10:56
*** dklyle has quit IRC10:56
*** songwenping__ has joined #openstack-nova11:03
gibidevfaz: thanks11:03
sean-k-mooneygibi: stephenfin alex_xu could ye take a lok at https://review.opendev.org/#/c/739131/ im trying to move on to numa in placment work so if i can close that out it would make me happy11:05
gibilyarwood: thanks. I've approved https://review.opendev.org/#/c/744506/11:06
*** songwenping_ has quit IRC11:06
sean-k-mooneythat said gibi i just booted my sriov servers so ill be deploying your sriov detach patches while i rebase some os-vif patches. ill let you know what i find in my testing11:07
gibisean-k-mooney: thanks a lot for those tests11:08
gibisean-k-mooney: I'm looking at https://review.opendev.org/#/c/739131/ now11:08
*** mkrai has quit IRC11:11
*** mkrai_ has joined #openstack-nova11:11
*** jangutter has quit IRC11:11
*** jangutter has joined #openstack-nova11:12
*** eharney has quit IRC11:13
*** Luzi has joined #openstack-nova11:20
*** tosky_ has joined #openstack-nova11:20
*** tosky has quit IRC11:20
*** tosky_ is now known as tosky11:20
*** luyao has quit IRC11:22
*** ociuhandu has joined #openstack-nova11:23
*** ociuhandu has quit IRC11:24
*** ociuhandu has joined #openstack-nova11:25
*** udesale has joined #openstack-nova11:27
*** udesale_ has quit IRC11:27
*** ociuhandu has quit IRC11:30
*** udesale_ has joined #openstack-nova11:31
*** udesale has quit IRC11:32
*** eharney has joined #openstack-nova11:32
openstackgerritHarshavardhan Metla proposed openstack/nova stable/rocky: [stable-only] Moved the quoted section  https://review.opendev.org/74468111:32
*** sapd1_x has quit IRC11:36
*** udesale_ has quit IRC11:38
*** ociuhandu has joined #openstack-nova11:40
*** udesale has joined #openstack-nova11:41
*** mkrai_ has quit IRC11:45
*** k_mouza has quit IRC11:47
gibisean-k-mooney: I have left comments in https://review.opendev.org/#/c/744506/11:50
*** belmoreira has joined #openstack-nova11:51
*** rcernin has quit IRC11:53
sean-k-mooneygibi: did you? that is the lower constrits fix :)11:53
sean-k-mooneyyou mean https://review.opendev.org/#/c/73913111:54
*** brinzhang_ has joined #openstack-nova11:57
*** raildo has joined #openstack-nova11:58
*** brinzhang0 has quit IRC12:00
gibiI've mixed up the links12:02
gibiI did left some review on lookup nic patch https://review.opendev.org/#/c/739131/12:02
sean-k-mooneyyep reading them now12:03
*** takamatsu has joined #openstack-nova12:04
*** artom has joined #openstack-nova12:10
*** k_mouza has joined #openstack-nova12:12
openstackgerritLee Yarwood proposed openstack/nova master: WIP zuul: Migrate to zuulv3 and break up the nova-live-migration job  https://review.opendev.org/71160412:13
*** tosky has quit IRC12:14
*** tosky_ has joined #openstack-nova12:14
*** tosky_ is now known as tosky12:15
*** dave-mccowan has joined #openstack-nova12:15
*** belmoreira has quit IRC12:23
*** ralonsoh_ has joined #openstack-nova12:26
*** ralonsoh__ has joined #openstack-nova12:28
*** ralonsoh has quit IRC12:30
sean-k-mooneygibi: thanks i have responded to the comments ill quickly adress the comparison change since i just forgot to fully revert that and ill re layout the types traits12:30
*** ralonsoh_ has quit IRC12:31
sean-k-mooneygibi: over all i did not see any functional changes requested so i think the patch is still fucntionally correct as is and the change are jsut style related for the most part right?12:31
*** xek has joined #openstack-nova12:33
*** arxcruz is now known as arxcruz|off12:43
*** ralonsoh__ is now known as ralonsoh12:44
openstackgerritLee Yarwood proposed openstack/nova master: WIP zuul: Migrate to zuulv3 and break up the nova-live-migration job  https://review.opendev.org/71160412:48
*** yaawang has quit IRC12:50
*** yaawang has joined #openstack-nova12:51
*** nweinber has joined #openstack-nova12:52
openstackgerritMerged openstack/nova stable/stein: objects: Update keypairs when saving an instance  https://review.opendev.org/74326412:55
*** eharney has quit IRC12:55
*** eharney has joined #openstack-nova12:56
gibisean-k-mooney: I'm on a call I will get back to you in an hour12:56
sean-k-mooneygibi:  no rush12:56
sean-k-mooneyi should have your comments adress by then :)12:56
openstackgerritsean mooney proposed openstack/nova stable/train: Silence amqp heartbeat warning  https://review.opendev.org/72805712:58
lyarwooddoes anyone know if there's a way of reproducing zuul jobs locally?13:04
lyarwood./me is pretty sure there isn't13:04
*** mgoddard has quit IRC13:07
lyarwoodsean-k-mooney: ^ any ideas?13:08
artomlyarwood, IIRC I asked in #infra a while ago - "no" was the answer13:09
lyarwoodartom: yup thanks, I'll keep spamming small changes then13:11
sean-k-mooneylyarwood: not really you can technically just run the playbooks locally13:11
*** mgoddard has joined #openstack-nova13:11
lyarwoodsean-k-mooney: yeah it's more the job definitions that I need to test at this point13:11
sean-k-mooneylyarwood: but the issue is creating the inventory file and runing them is non trivial13:12
lyarwoodsean-k-mooney: just feels wrong spamming zuul13:12
artomlyarwood, why small changes?13:12
sean-k-mooneylyarwood: for what its worth its not that hard to deploy a zuul instance using docker-compose13:12
sean-k-mooneybut mimicing the upstream enve is still a little more inovled13:12
sean-k-mooneylyarwood: i assume you are doint what i do and disablig all the other jobs when your deveolping one13:13
lyarwoodsean-k-mooney: yup13:13
sean-k-mooneylyarwood: also if you  want to make it go faster you can cheat and use the experimental pipeline13:13
sean-k-mooneyin which case you also need to disbale the experimental josb other then your own13:14
sean-k-mooneylyarwood: zuul will also do basic syntax checking too so if youy have a typo in the yaml file it will somethime cacht that before runnign your job13:14
lyarwoodsean-k-mooney: yup cool13:17
openstackgerritLee Yarwood proposed openstack/nova master: WIP zuul: Migrate to zuulv3 and break up the nova-live-migration job  https://review.opendev.org/71160413:17
lyarwoodartom: well incremental changes then as I'm slowly working out how to covert the jobs13:17
lyarwoodsomething I'd normally do locally but have to do in the open thanks to zuul now :|13:18
artomlyarwood, tbh, I don't think anyone will look, unless they understand it's a WIP and want to check in/help13:18
artomAka no shame13:18
sean-k-mooneyartom: i think lyarwood just did not want to waste gate resouces13:19
*** songwenping__ has quit IRC13:19
artomsean-k-mooney, ah, yeah. Well, what are you gonna do13:20
*** songwenping__ has joined #openstack-nova13:20
sean-k-mooneydisable all jobs you are not updatinging and ask stephenfin to run unit test locally :P13:20
*** songwenping__ has quit IRC13:21
sean-k-mooneyyou can replicate the gate as i said but its a lot of setup if you dont do this regularly13:21
*** songwenping__ has joined #openstack-nova13:21
* stephenfin notes machines are cheaper than stephenfin :)13:22
sean-k-mooneythat is true13:22
openstackgerritStephen Finucane proposed openstack/nova master: doc: Update references to image properties  https://review.opendev.org/74419813:22
openstackgerritStephen Finucane proposed openstack/nova master: libvirt: Drop support for UML  https://review.opendev.org/74323013:22
openstackgerritStephen Finucane proposed openstack/nova master: libvirt: Drop support for Xen  https://review.opendev.org/74323113:22
openstackgerritStephen Finucane proposed openstack/nova master: libvirt: Remove 'hypervisor_version' from 'libvirt_info'  https://review.opendev.org/74419913:22
sean-k-mooneystephenfin: https://www.sciencealert.com/images/How-Much-Are-We-Worth-V2-large.jpg13:23
sean-k-mooneythats even before you take into account your value as a software engineer or a good person13:24
sean-k-mooneymachines are cheap in comparison :P13:24
*** lbragstad_ has joined #openstack-nova13:24
kashyapsean-k-mooney: Heh; I never realized the 0.2mg of gold even13:24
*** lbragstad has quit IRC13:26
*** sapd1_x has joined #openstack-nova13:26
artom"It would take 40,000 people to get enough gold for one uk sovereign coin"13:29
artomChallenge accepted!13:29
*** hoonetorg has quit IRC13:36
*** hoonetorg has joined #openstack-nova13:39
*** lbragstad_ has quit IRC13:41
*** mvorwerk has joined #openstack-nova13:43
*** mvorwerk_ has quit IRC13:45
*** lbragstad has joined #openstack-nova13:46
*** mvorwerk has quit IRC13:47
*** mvorwerk has joined #openstack-nova13:48
stephenfinartom the terrible13:49
artomGreat Uncle Ivan would be proud13:49
*** jangutter has quit IRC13:54
*** jangutter has joined #openstack-nova13:55
*** mlavalle has joined #openstack-nova14:00
*** Yumeng has quit IRC14:04
*** tbachman has quit IRC14:09
*** tbachman has joined #openstack-nova14:10
*** dave-mccowan has quit IRC14:25
*** Luzi has quit IRC14:27
ralonsohhello folks14:29
ralonsohwe are hitting in the Neutron CI14:29
ralonsoha problem with grenade jobs14:30
ralonsohhttps://026716e2072b41f3360b-f5b932bfaec6245f8b3ddc87df48d7a4.ssl.cf2.rackcdn.com/640258/23/check/neutron-grenade-multinode/bcc8e1e/controller/logs/grenade.sh_log.txt14:30
ralonsohjust an example14:30
*** dougsz has joined #openstack-nova14:30
*** dklyle has joined #openstack-nova14:31
ralonsohwhen retrieving the RP for VCPU14:31
ralonsohopenstack resource provider list -f value | head -n1 | cut -d ' ' -f 114:31
ralonsohthat returns nothing14:31
*** psachin has quit IRC14:33
*** udesale_ has joined #openstack-nova14:35
ralonsohstephenfin, hi ^^14:37
gibiralonsoh: placement log stars at 13:43 and the failed query starts at 2020-08-04 13:42:39.14014:38
*** udesale has quit IRC14:38
gibisorry, never mind14:39
gibithe placement log ends at https://www.sciencealert.com/images/How-Much-Are-We-Worth-V2-large.jpg14:39
gibibah14:39
gibiso the placement log ends 13:43 so it should have some clue in it14:39
*** donnyd has joined #openstack-nova14:40
ralonsohgibi, ok I took a look at the placement logs14:40
ralonsohhttps://026716e2072b41f3360b-f5b932bfaec6245f8b3ddc87df48d7a4.ssl.cf2.rackcdn.com/640258/23/check/neutron-grenade-multinode/bcc8e1e/controller/logs/screen-placement-api.txt14:40
ralonsohI don't know why is failing14:40
ralonsohkeystoneauth1.exceptions.catalog.EndpointNotFound: internal endpoint for identity service not found14:40
gibithe config looks similar before and after the placement restart based on the log14:44
*** brinzhang_ has quit IRC14:47
*** mvorwerk has quit IRC14:49
gibikeystone log seems normal around that time14:52
ralonsohyes, I don't see any error there14:53
openstackgerritLee Yarwood proposed openstack/nova master: WIP zuul: Migrate to zuulv3 and break up the nova-live-migration job  https://review.opendev.org/71160414:55
gibinova compute also fails as gets back the same HTTP 500 from placement than the grenade script14:56
gibiralonsoh: neutron server also gets eystoneauth1.exceptions.catalog.EndpointNotFound: internal endpoint for identity service not found from keystone14:59
gibiaround the same time Aug 04 13:42:19.14:59
ralonsohgibi, I'm trying to find why placement stops replying15:00
gibiso this is not a placement issue but something is probably wrong with keystone15:00
ralonsohok15:00
*** artom has quit IRC15:03
*** artom has joined #openstack-nova15:04
*** derekh has quit IRC15:05
*** derekh has joined #openstack-nova15:05
ralonsohgibi, just one question15:08
gibisure15:08
ralonsohwho sets this RP?15:08
ralonsohbecause I see n-conductor starting just at this moment15:08
ralonsohhttps://026716e2072b41f3360b-f5b932bfaec6245f8b3ddc87df48d7a4.ssl.cf2.rackcdn.com/640258/23/check/neutron-grenade-multinode/bcc8e1e/controller/logs/screen-n-cond.txt15:08
ralonsoh13:41:14 ~ 1515:09
gibithe RP is created by n-cpi15:10
gibin-cpu15:10
gibiwhich fails to create it15:10
gibias placement returns http 50015:10
gibibut even if the RP would exists the grenade script cannot read it as it also gets http 500 from placement15:11
ralonsohexactly15:11
gibibased on the exception placement cannot find the internal endpoints in keystone15:12
gibialso around the same time neutron also tries and fails to find the internal endpoints in keystone (independendly from placement)15:13
ralonsohI think, according to the timestamps that this problem could be due to https://review.opendev.org/#/c/744507/15:14
ralonsohthis is just a guess, I'll try that in a patch15:14
gibiculd be a change in the middleware yes15:15
*** lpetrut has quit IRC15:15
*** sdmitriev has quit IRC15:16
*** mvorwerk has joined #openstack-nova15:19
*** openstackgerrit has quit IRC15:20
*** mvorwerk has quit IRC15:25
*** mvorwerk has joined #openstack-nova15:27
*** mvorwerk has quit IRC15:32
*** mvorwerk has joined #openstack-nova15:32
*** k_mouza has quit IRC15:40
*** lpetrut has joined #openstack-nova15:43
* gibi gives up for today15:52
*** k_mouza has joined #openstack-nova15:54
prometheanfiredo we still need the nova client to evacuate (do the docs need updating) https://docs.openstack.org/nova/ussuri/admin/evacuate.html15:55
sean-k-mooneyprometheanfire: yes15:55
sean-k-mooneyi started a patch a year ago but never got aroudn to finishing it15:56
sean-k-mooneyhttps://review.opendev.org/#/c/643578/15:56
sean-k-mooneyi have local change to change it back to evacuate but i never finished renaming it back15:56
prometheanfireah, kk thanks :D15:57
sean-k-mooneyif you feel like updating it feel free. i guess i can try and finish it again15:59
sean-k-mooneymore urgent things keep coming up15:59
sean-k-mooneybut it should be done sooner rather then later16:00
prometheanfireeh, was more a curiousity, trying to wean off project clients and all16:02
sean-k-mooneyya that is why i created the patch in the first place16:02
sean-k-mooneyi wrote it after we had the denver fourm session on closing the gaps16:02
sean-k-mooneythen it didnt really get reviewed for a few months and i kind of lost interest16:03
prometheanfireyarp16:04
*** derekh has quit IRC16:15
*** lpetrut has quit IRC16:21
*** mlavalle has quit IRC16:22
*** mlavalle has joined #openstack-nova16:23
*** ociuhandu has quit IRC16:27
*** dougsz has quit IRC16:38
*** hamalq has joined #openstack-nova16:38
*** gregwork has joined #openstack-nova16:39
*** hamalq_ has joined #openstack-nova16:41
*** hamalq has quit IRC16:44
*** gyee has joined #openstack-nova16:49
*** openstackgerrit has joined #openstack-nova16:49
openstackgerritElancheran S proposed openstack/nova master: Removes the delta file once image is extracted  https://review.opendev.org/73442116:49
*** priteau has quit IRC16:51
*** priteau has joined #openstack-nova16:52
*** xek has quit IRC16:55
*** mvorwerk has quit IRC16:57
*** mvorwerk has joined #openstack-nova16:57
*** dtantsur is now known as dtantsur|afk17:00
*** ralonsoh has quit IRC17:00
*** ralonsoh has joined #openstack-nova17:01
*** mvorwerk has quit IRC17:05
*** mvorwerk has joined #openstack-nova17:05
*** ralonsoh has quit IRC17:06
dansmithlyarwood: in case you didn't notice, that failure you're seeing appears to be a race on the glance side that I opened a bug for and have a fix up for,17:07
*** ralonsoh has joined #openstack-nova17:07
dansmithbut it's a pretty fundamentally-broken thing on the glance side so the fix is non-trivial and will likely take a while to get agreement on and land17:07
dansmithlyarwood: if it's happening a lot, then I guess we could move that to non-voting and add back the base ceph job for the time being, but... it's nice to keep the pressure up for a fix too :/17:08
lyarwooddansmith: yeah no issues, that's only the second hit tha tI had seen against the job17:08
dansmithack17:09
lyarwooddansmith: so I'm happy to leave it voting for now17:09
dansmithit's actually cool,17:09
dansmithbecause I filed that bug as "I only saw this when something else was broken, but clearly there's a real race here" and the fact that we're hitting it in the happy path is sweet sweet vindication :P17:09
lyarwood^_^17:10
lyarwoodhave you closed my bug out as a dup already?17:10
lyarwoodif not I can do it now17:10
dansmithno, is that what you want?17:11
*** nightmare_unreal has quit IRC17:11
dansmithyou've got links to logs which is good, but I guess maybe the dup linkage will keep it handy enough17:11
lyarwoodtrue but I can just copy that across17:11
lyarwoodfeel free to close it as a dup17:12
dansmithack17:12
*** mvorwerk has quit IRC17:13
*** udesale_ has quit IRC17:16
*** mvorwerk has joined #openstack-nova17:23
*** tesseract has quit IRC17:23
*** mvorwerk has quit IRC17:27
*** priteau has quit IRC17:33
*** k_mouza has quit IRC17:36
*** sapd1_x has quit IRC17:45
*** lpetrut has joined #openstack-nova17:49
*** mvorwerk has joined #openstack-nova17:49
*** lpetrut has quit IRC17:50
*** mvorwerk has quit IRC17:53
*** links has quit IRC18:05
*** mvorwerk has joined #openstack-nova18:14
*** mvorwerk has quit IRC18:21
*** songwenping_ has joined #openstack-nova18:38
*** dougsz has joined #openstack-nova18:40
*** songwenping__ has quit IRC18:41
sean-k-mooneygibi: finally got around to testing the WIP attach/detach patch. i commented no the review but http://paste.openstack.org/show/796572/ are the results it looks like thre are still issues with macvtap and direct phsyical.18:45
*** k_mouza has joined #openstack-nova18:48
*** songwenping_ has quit IRC18:52
*** songwenping_ has joined #openstack-nova18:52
*** markvoelker has joined #openstack-nova18:56
*** dougsz has quit IRC19:05
*** k_mouza has quit IRC19:07
*** vishalmanchanda has quit IRC19:12
*** dougsz has joined #openstack-nova19:20
*** dougsz has quit IRC19:24
*** mtreinish has quit IRC19:27
*** ralonsoh has quit IRC19:47
*** mvorwerk has joined #openstack-nova19:52
openstackgerritGhanshyam Mann proposed openstack/nova master: migrate testing to ubuntu focal  https://review.opendev.org/73812619:54
*** nweinber has quit IRC20:09
*** mvorwerk has quit IRC20:41
*** avolkov has quit IRC20:48
*** maciejjozefczyk has quit IRC20:56
*** grandchild has joined #openstack-nova21:05
*** raildo has quit IRC21:08
*** grandchild has quit IRC21:19
*** markvoelker has quit IRC21:30
*** martinkennelly has quit IRC21:44
*** slaweq has quit IRC21:58
*** ociuhandu has joined #openstack-nova22:15
*** ociuhandu has quit IRC22:20
openstackgerritsean mooney proposed openstack/nova master: Lookup nic feature by PCI address  https://review.opendev.org/73913122:24
openstackgerritsean mooney proposed openstack/nova master: Lookup nic feature by PCI address  https://review.opendev.org/73913122:27
sean-k-mooneystephenfin: gibi ^ adressed your comments then did a rebase22:30
*** tosky has quit IRC22:50
*** tbachman has quit IRC22:55
*** dpawlik2 has quit IRC22:55
*** bnemec-pto has quit IRC22:55
*** kevinbenton has quit IRC22:55
*** tobberydberg_ has quit IRC22:55
*** sorrison has quit IRC22:55
*** dansmith has quit IRC22:55
*** frickler has quit IRC22:55
*** Corwin has quit IRC22:55
*** tkajinam has joined #openstack-nova22:55
*** tbachman has joined #openstack-nova22:57
*** dpawlik2 has joined #openstack-nova22:57
*** bnemec-pto has joined #openstack-nova22:57
*** kevinbenton has joined #openstack-nova22:57
*** tobberydberg_ has joined #openstack-nova22:57
*** sorrison has joined #openstack-nova22:57
*** dansmith has joined #openstack-nova22:57
*** frickler has joined #openstack-nova22:57
*** Corwin has joined #openstack-nova22:57
*** mlavalle has quit IRC22:59
openstackgerritsean mooney proposed openstack/nova master: remove deprecated schduler filters  https://review.opendev.org/74480023:11
sean-k-mooneygmann: that os-vif failure is real23:35
sean-k-mooneygmann: ip route change on of there funciton to return an empty list instead of raise an excption23:35
sean-k-mooneygmann: im going to fix it23:35
gmannsean-k-mooney: ohk, I thought it is something constraint i made incompatible for bionic and focal.23:36
sean-k-mooneyam well im testing on focal23:37
sean-k-mooneyso it might be related to focal23:37
sean-k-mooneyin any case ill fix it23:38
gmannbut the current failure is on bionic as current PS is without depends-on23:38
sean-k-mooneyoh ok then its both23:38
gmannok23:39
sean-k-mooneyiproute basically used to raise ipexc.NetlinkError23:39
sean-k-mooneyif you looked up an interface that did not exist23:39
sean-k-mooneynot it returns an empty list23:39
sean-k-mooneyso i guess we just dont cap that in upper-constiratins or a new release has come out23:40
sean-k-mooneylet me check23:40
sean-k-mooneyya july 27th23:40
sean-k-mooneyhttps://pypi.org/project/pyroute2/#history23:40
sean-k-mooney0.5.1323:41
gmannyeah that is what installed on failing jobs23:42
sean-k-mooneyya 0.5.12 proably will work.23:42
sean-k-mooneylet me stash my change and ill down grade it locally23:42
sean-k-mooneyya 0.5.12 works23:44
gmannhttps://review.opendev.org/#/c/743277/23:45
gmannsean-k-mooney: it is better to run os-vif unit test on requirement gate23:45
sean-k-mooneywe could they are really fast23:46
sean-k-mooneySum of execute time for each test: 0.3669 sec.23:46
sean-k-mooneyless then a second23:46
sean-k-mooneywell + installing packages :)23:47
sean-k-mooneyanyway give me 15 mins and ill file a bug and submit the fix to make it work fine with both23:48
gmannsean-k-mooney: thanks i am going for walk so no hurry.23:51
gmannsean-k-mooney: adding job https://review.opendev.org/#/c/744803/123:51
*** hamalq_ has quit IRC23:52
sean-k-mooneycool that will fail until we merge the os-vif fix but ill comment on that with the depens-on link once its pushed23:54
gmannyeah23:55
sean-k-mooneydid you bump MarkupSafe in one fo the lower constratins jobs23:57
sean-k-mooneyi think i need to do that too23:57
gmannyeah - for focal what all needed are in this - https://review.opendev.org/#/c/738130/5/lower-constraints.txt23:57
gmannthey passed with 0.5.1223:58
sean-k-mooneyyep just found it23:58

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!