Friday, 2022-09-23

opendevreviewBrian Rosmaita proposed openstack/nova master: Correct reST markup in config help string  https://review.opendev.org/c/openstack/nova/+/85901002:46
opendevreviewJunbo Jiang proposed openstack/nova master: Test overcommit status when choose numa nodes  https://review.opendev.org/c/openstack/nova/+/85849502:54
opendevreviewRajesh Tailor proposed openstack/nova master: Update Availability zone doc page  https://review.opendev.org/c/openstack/nova/+/84646303:37
opendevreviewRajesh Tailor proposed openstack/nova master: Fix typos in nova docs  https://review.opendev.org/c/openstack/nova/+/85867303:39
opendevreviewMerged openstack/nova master: Update nova-manage doc page  https://review.opendev.org/c/openstack/nova/+/85689403:41
auniyal_Hi #openstack-nova 10:31
auniyal_regarding error: service catalog is empty10:31
auniyal_I am writing a functional test, to create a snapshot of instance whose image has property "os_require_quiesce" and should boot-from-volume.10:31
auniyal_so while creating snapshot I can test _set_quiesced functionality.10:31
auniyal_https://opendev.org/openstack/nova/src/branch/master/nova/virt/libvirt/driver.py#L323810:31
auniyal_I have this functional test  - https://paste.opendev.org/show/bY6ZjvBzDO4QXbzrpQ70/10:31
auniyal_It has 2 WAY's10:31
auniyal_WAY 1: boot from volume as I want to write, but its failing and giving error: https://paste.opendev.org/show/bMRo6x3aDgKmgDbQbadr/10:31
auniyal_WAY 2: use CINDER fixture to get volume, Error: https://paste.opendev.org/show/bj553NIDlVAw7sKkVZfF/10:31
sean-k-mooneyyou shoudl be using the cinder fixture yes10:32
sean-k-mooneyyour not actully usin gthe cidner fixture in this test10:33
sean-k-mooneyhttps://paste.opendev.org/show/bY6ZjvBzDO4QXbzrpQ70/10:33
sean-k-mooneyyoru using a uuid from it10:33
sean-k-mooneybut you have not actully used the cinder fixture to provide a fake sinder10:33
sean-k-mooney*cinder10:33
auniyal_in WAY 2, line 5210:34
sean-k-mooneyright now your test is trying to actully call keystone 10:34
sean-k-mooneythats not using the fixture10:34
sean-k-mooneyon line 5210:34
sean-k-mooneyits just geting a constnat that is defiend in it10:34
auniyal_okay, but shouldn't it be treated as volume while instance creation, (fake volume)10:35
auniyal_or I should add some other property as well10:36
sean-k-mooneyadd   self.useFixture(nova_fixtures.CinderFixture(self)) to the setUp10:36
sean-k-mooneyon line 2010:37
sean-k-mooneyand from nova.tests import fixtures as nova_fixtures10:37
sean-k-mooneyah you have that on line 410:38
sean-k-mooneyto enable a fixture you actullly need to do self.useFixture10:38
sean-k-mooneyalso why did you comment out base.ServersTestBase, and integrated_helpers.InstanceHelperMixin10:39
auniyal_actually, CinderFixture is already added in inherited class 10:40
auniyal_in here - https://opendev.org/openstack/nova/src/commit/aad31e6ba489f720f5bdc765c132fd0f059a0329/nova/tests/functional/integrated_helpers.py#L120810:40
sean-k-mooneyright but your not ment to be inheriting form that10:41
auniyal_okay, so I should inherit  base.ServersTestBase, and integrated_helpers.InstanceHelperMixin10:42
auniyal_and add CinderFixtute10:42
sean-k-mooneyyes as i said a few time in the past  integrated_helpers._IntegratedTestBase does not use the fake libvirt implemeattion10:42
sean-k-mooneythe bug your working on only happens in the libvirt driver10:43
sean-k-mooneyso you cant use that10:43
sean-k-mooneywhich is why i perviouly told you to use base.ServersTestBase, and integrated_helpers.InstanceHelperMixin10:43
auniyal_actually, I tried that as well, so thats why, only commented and not removed from test10:45
auniyal_it failes with - https://paste.opendev.org/show/bL7nGtDSyTzc11Utb0AA/ 10:46
sean-k-mooneyyes that is a diffent issue11:02
sean-k-mooneywe need to mock out the calls to check for secure boot11:02
sean-k-mooneythat is at least using the libvirt driver which is good11:03
auniyal_secure boot, by adding 'os_secure_boot': 'required', in image properties 11:08
sean-k-mooneyno11:08
sean-k-mooneyif you read the traceback you will see it failing in the driver code11:08
sean-k-mooneyspecificaly its trying to parse supprot for secure boot11:09
sean-k-mooneythe fake libvirt fixture is likely not faking that properly11:09
sean-k-mooneyso either you need to moack out the supports_secure_boot function or update the data the fixture is provideing11:10
sean-k-mooneythe libvirt fixture shoudl be mockign this out 11:11
sean-k-mooneyhttps://github.com/openstack/nova/blob/f8c91eb75fc5504a37fc3b4be1d65d33dbc9b511/nova/tests/fixtures/libvirt.py#L1993-L204511:11
sean-k-mooneywhich makes me thing that the libvirt fixture is not currently in use11:12
*** dasm|off is now known as dasm14:02
*** dasm is now known as dasm|off21:10
clarkbDoes anyone here know why the Nodepool CI job that tests against openstack using devstack is suddenly tripping over the check at https://opendev.org/openstack/nova/src/branch/master/nova/network/neutron.py#L603-L613 when this code doesn't appear to have changed recently?22:59
clarkbhttps://zuul.opendev.org/t/zuul/build/74fab5fdddee4c3d88e71e40ad6795a7/log/docker/nodepool_nodepool-launcher_1.txt#1345 is the nodepool side of things reporting the error22:59
clarkbSince the code hasn't chagned as far as I can tell I'm thinking the policy may have? But I'm not seeing where the policy might be set22:59
clarkbhrm 909b0b02470dc795fd3d2775ee33864b055dd678 changed the default check_str from project admin to admin23:04
clarkbBut I think we've been able to do this successfully more recently than when that change landed23:05
clarkbSorry here is where we log that error message https://zuul.opendev.org/t/zuul/build/74fab5fdddee4c3d88e71e40ad6795a7/log/syslog#40077 which then maps back to that nodepool error (which is far more terse as that is what the sdk gives us)23:10
clarkbIt seem that both the recent failures and the most recent successful devstack installs for these jobs installed the same version of nova: aad31e6ba4 Merge "Update nova-manage doc page"23:22
clarkbgmann: you've been pushing the rbac stuff along do you know if anything changed for that in the last day ?23:31
gmannclarkb: policy is changed to admin from project admin means any admin can access it, so it is made more broader access than restrictive. also we have the old policy supported so it should work as it is23:34
gmannmay be we need to check if any change in token accessing it? 23:35
clarkbgmann: I don't think anything changed in how we access it unless openstacksdk just made a release /me checks23:36
clarkbno the sdk updated a month ago23:36
gmannclarkb: here, non admin is trying to access it https://zuul.opendev.org/t/zuul/build/74fab5fdddee4c3d88e71e40ad6795a7/log/syslog#4006623:36
gmann'is_admin': False, 23:37
clarkbgmann: yes, but that was working yesterday23:37
clarkbis it possible to be a project admin but not an admin?23:38
gmannno, project admin is nothing but admin with project_id matching 23:39
gmannadmin is just role 'admin' match so any project _id so every project admin is admin23:40
gmannI think 'is_admin':False is changed somewhere in sdk or so23:41
clarkbgot it23:41
gmannit should be true 23:41
clarkbI'm now trying to compare the successful run to the failed one more broadly23:41
clarkbto see if there are differences23:41
clarkbBoth the successful and failed jobs have this problem in the nova logs. But the failed one also has nova.exception.VirtualInterfaceCreateException: Virtual Interface creation failed and eventlet timeouts23:47
clarkbis it posible that rbac error is just noise? And the real issue is that nova does go ahead and try to create virtual interfaces anyway but fails?23:49
clarkbgmann: ok, I think https://zuul.opendev.org/t/zuul/build/74fab5fdddee4c3d88e71e40ad6795a7/log/syslog?severity=0#84665-84692 might be the actual fatal bit (I don't understand why we get the rbac errors but I'm thinking they may juts be noise now)23:52
gmannhumm, not sure why rbac error that is confusing then23:56
clarkbgmann: I guess it is also possible that openstacksdk is probing the nova api to determine what actions it can take?23:57
clarkbbut I agree it is confusing23:57
gmannyeah, may be23:58

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!