Thursday, 2022-02-03

*** amoralej|off is now known as amoralej07:26
*** hemna8 is now known as hemna07:37
opendevreviewyuval proposed openstack/nova master: Lightbits LightOS driver  https://review.opendev.org/c/openstack/nova/+/82160610:05
opendevreviewyuval proposed openstack/nova master: Lightbits LightOS driver  https://review.opendev.org/c/openstack/nova/+/82160610:15
opendevreviewBalazs Gibizer proposed openstack/placement master: Refactor trait normalization  https://review.opendev.org/c/openstack/placement/+/82584711:02
opendevreviewBalazs Gibizer proposed openstack/placement master: Extend the RP db query to support any-traits  https://review.opendev.org/c/openstack/placement/+/82584811:02
opendevreviewBalazs Gibizer proposed openstack/placement master: DB layer should only depend on trait id not names  https://review.opendev.org/c/openstack/placement/+/82649011:02
opendevreviewBalazs Gibizer proposed openstack/placement master: Enhance doc of _get_trees_with_traits  https://review.opendev.org/c/openstack/placement/+/82578011:02
opendevreviewBalazs Gibizer proposed openstack/placement master: Extend the RP tree DB query to support any-traits  https://review.opendev.org/c/openstack/placement/+/82584911:02
opendevreviewBalazs Gibizer proposed openstack/placement master: Add any-traits support for listing resource providers  https://review.opendev.org/c/openstack/placement/+/82649111:03
opendevreviewBalazs Gibizer proposed openstack/placement master: Add any-traits support for allocation candidates  https://review.opendev.org/c/openstack/placement/+/82649211:03
opendevreviewBalazs Gibizer proposed openstack/placement master: Remove unused compatibility code  https://review.opendev.org/c/openstack/placement/+/82649311:03
opendevreviewBalazs Gibizer proposed openstack/placement master: Add microversion 1.39 to support any-trait queries  https://review.opendev.org/c/openstack/placement/+/82671911:03
opendevreviewStephen Finucane proposed openstack/nova master: docs: Follow-ups for cells v2, architecture docs  https://review.opendev.org/c/openstack/nova/+/82733611:42
artomI guess we'll need a tracker for the test_tagged_attachment failures :(11:56
opendevreviewArtom Lifshitz proposed openstack/nova master: DNM: Testing change to test_tagged_attachment in tempest  https://review.opendev.org/c/openstack/nova/+/82754912:27
gibiartom: yes please :)12:46
gibiartom: and thanks for trying out if switching away from q35 helps12:46
artomgibi, yeah, just trying to gather data points12:47
gibiartom: I will push a tempest change up that will add more logs around that curl command that is used to verify the metadata12:57
gibias the current code simply drops the exception and returns false so we don't see what fails12:57
artomgibi, yeah, I think the most useful piece of information would be what the metadata API returns12:58
artomAlso, https://bugs.launchpad.net/nova/+bug/1959899 is the tracker12:58
artomAnd I sent an email to the ML12:58
gibiartom: thanks!12:58
*** amoralej is now known as amoralej|lunch13:00
opendevreviewBalazs Gibizer proposed openstack/nova master: DNM: troubleshoot nova-next tagged attach test  https://review.opendev.org/c/openstack/nova/+/82766113:10
*** dasm|off is now known as dasm|rover13:14
bauzasdumb question here, but I can't find any docs about how to test our working Tempest branches with it, I guess we need to just use a venv with pip -e tempest ?13:25
bauzasand then running tempest against our new test classes ?13:26
gibibauzas: you want to run tempest against a nova stable branch?13:27
bauzasgibi: no I'm working on adding a new tempest test for https://specs.openstack.org/openstack/nova-specs/specs/yoga/approved/boot-vm-with-unaddressed-port.html#id1113:27
bauzasgibi: so I added a new tempest scenario and I want to test it locally13:28
bauzasagainst some devstack env13:28
bauzasso I guess I'll just create a build subdir and pip -e the source directly13:28
bauzaswith a venv 13:28
gibiso you have a devstack with the new nova code and with the new tempest code. Then 13:28
bauzasyup13:28
gibitox  -evenv -- tempest run --regex <new test case>13:28
gibiin the tempest source tree13:29
bauzasoh man, I haven't thought about it13:29
bauzasI was about to create the venv by hand 13:29
gibi:)13:29
bauzasbut yeah, sounds what I thought, just magically done with toix13:29
bauzastox13:29
gibiyepp13:29
bauzasack, thanks13:30
gibiif you build you devstack with tempest enabled the tempest is properly preconfigured by devstack so you only need to run it13:30
* bauzas worked on OpenStack since 9 years now but is a total noob with Tempest contributions13:30
bauzasgibi: oh good catch13:30
gibiI have a similar blindspot with deployment tools like devstack, kolla, tripleoo, etc13:31
bauzasgibi: I was stupidely about to run tempest on my laptop *against* my devstack vm13:31
* bauzas facepalms13:31
gibibauzas: that would probably work but need a bit more setup13:31
bauzasgibi: yup, I was about to configure etc/tempest13:31
gibias you need a populated tempest.confg13:31
bauzas:)13:31
gibiyepp13:31
bauzasgosh, I feel stupid13:31
bauzasI know tempest is delivered with devstack13:31
bauzasI even ran it a couple of times13:32
bauzasbut I never tweaked it13:32
bauzasI was able to read tempest tests13:32
bauzasbut I never contributed to tempest surprinsingly13:32
bauzasgmann: don't look at me like this :D13:32
* bauzas new hides13:34
bauzasnow*13:34
gibi:D13:34
gibidmitriis: went through your series again, looks good. I left some question along the way. 14:14
gibidmitriis: does we have neutron dependencies we need to land first? or are those already landed?14:15
yuvalHey, Is there anyway to tell zuul to install os-brick from master and not pypi?14:18
yuvalI added "Depends-On:" in the commit msg but didnt do the trick14:18
*** amoralej|lunch is now known as amoralej14:19
gibiyuval: probably need to add 14:28
gibirequired-projects:14:28
gibi  -os-brick 14:28
gibito the job config14:28
gibirequired-projects:14:28
gibi  - openstack/os-brickj14:28
* gibi cannot type14:28
yuvalhmm someone use this option lately so I can see an example?14:29
yuvalused14:29
gibiyuval: https://github.com/openstack/neutron/blob/c7f35d3870cb20de997231f2b502973fbcd0c3e7/zuul.d/tempest-singlenode.yaml#L272-L278 I stole the idea from here14:30
yuvalThanks!14:31
dmitriisgibi: RE the depends-on, had a discussion here https://review.opendev.org/c/openstack/nova/+/824833/1/nova/network/neutron.py#669 with sean-k-mooney. So https://review.opendev.org/c/openstack/neutron/+/808961 depends on the Nova change. As such, we don't have Neutron changes that need to be landed first.14:38
dmitriisthe VNIC type is already in the neutron lib because of the past Ironic work and we're just reusing it14:39
gibidmitriis: cool, thanks for the info14:39
artomHuh, so https://review.opendev.org/c/openstack/nova/+/827549 passed14:41
artomLooks like q35 *is* the culprit14:42
opendevreviewIlya Popov proposed openstack/nova master: Fix to implement 'pack' or 'spread' VM's NUMA cells  https://review.opendev.org/c/openstack/nova/+/80564914:42
opendevreviewyuval proposed openstack/nova master: Lightbits LightOS driver  https://review.opendev.org/c/openstack/nova/+/82160614:44
yuvalgibi: I added as you mentioned ^14:45
gibiyuval: does your patch depends on a new os-brick feature?14:46
yuvalyes14:47
gibiyuval: ok. so what you did not with zuul allows you to test the new os-brick feature together with the nova feautre14:48
gibiyuval: but the final solution will be to merge the os-brick change first, then release os-brick, then bump the requirement to use the new os-brick release 14:48
sean-k-mooneygibi: yep was talking to yuval  in parrallel about that14:58
sean-k-mooneyyuval: if you dont feel comforatable creatign the release patch i can submit it if you are willing to take it over and or respond to any question the maintaienr have14:58
gibiack14:59
sean-k-mooneygibi: os-brick is mainly maintained by cidner write14:59
yuvalyes, thank you both14:59
sean-k-mooneyi know its kind fo shared owner ship but officaly its a cinder deliverbale in governace so there ptl/release leaision need to approve?14:59
yuvalsean-k-mooney: its ok, let me do some checking. there are 2 followups I need to add to my driver before they release14:59
gibisean-k-mooney: yepp it is under cinder15:00
sean-k-mooneyyuval: ok well its proably good to start the process early.  looking at the patch delta https://github.com/openstack/os-brick/compare/5.1.0...master it should be a feature bump to 5.2.015:01
sean-k-mooneyi think it should be uncontoversal15:01
sean-k-mooneyjust add another release to https://github.com/openstack/releases/blob/master/deliverables/yoga/os-brick.yaml and follow up with the os-brick/cinder folks on #openstack-cinder15:02
sean-k-mooneyyuval: unless you ment there are followup to the os-brick part15:03
sean-k-mooneyin which case wait for those obviously if what is there is not sufficent to be useable15:03
yuvalyes - that follow ups to the os-brick15:03
dmitriisgibi: RE https://review.opendev.org/c/openstack/nova/+/824834/5..8/nova/pci/devspec.py#322, the problem here is that I cannot do a check during PciDeviceSpec object creation because it gets details from passthrough_whitelist in nova.conf, meanwhile during matching I have access to the device json dict which comes based on info from Libvirt. We need15:22
dmitriisinfo from Libvirt because it parses the VPD binary and extracts all the fields. So I can't check the presence of a serial at the whitelist parsing time without having to parse VPD (which belongs in Libvirt as we agreed in the past). Could logging a warning here be a compromise?15:22
gibidmitriis: ahh I got you, you are right. Then we cannot reject such config at startup. 15:23
sean-k-mooneydmitriis: ya you would have to have the whitelist parsing like quiry sysfs which is not the right approch15:24
gibidmitriis: with the log the problem is that it will be logged at each match call which could be noisy15:24
gibidmitriis: let's keep it as is now. maybe mention it in the documentation (if not yet mentioned)15:25
dmitriisgibi, sean-k-mooney: yeah, if I could check for the serial presence easily without parsing, it would be doable but unfortunately vpd is a binary blob in sysfs15:25
dmitriisgibi: could also do a debug or info level message at least15:26
gibidmitriis: go with a debug then15:26
dmitriisgibi: ack, I mentioned this in the "limitations" note in the doc change and also in the conf module doc15:27
gibidmitriis: cool15:28
gibithen it is settle15:28
gibid15:28
dmitriisgibi: ack, will also document this in the Neutron guide since other features cover the compute part as well15:29
sean-k-mooneyya proably debug makes sense but i have not got that far in the change set sorry15:40
sean-k-mooneyi have been looking at stephens docs patchs and some downstream stuff so this is sitll on my todo list15:41
dmitriissean-k-mooney: ack, np15:49
sean-k-mooneystephenfin: by the way i think we should exclude that failign test in nova-next for now until we find a workaround15:57
stephenfinI agree15:57
stephenfinwhat does gibi think?15:57
sean-k-mooneyartom: started a mail thread on it but  its a q35 issue15:57
artomsean-k-mooney, yeah, my latest DNM patch that removed the q35 machine type from nova-next passed15:58
gibisean-k-mooney: do we have the result back from the testing that proves that it is q35?15:58
gibiartom: ohh15:58
gibiartom: but you also added the waiters in the same patch isn't it?15:58
sean-k-mooneyi think those are seperate15:58
artomgibi, waiters were there before the q35 removal, and they failed15:58
sean-k-mooneyah15:59
gibiartom: ok then q35 it is15:59
sean-k-mooneyso i think this runs in other test jobs if it does i think we can skip it in nova-next15:59
sean-k-mooneywhich is the only q35 one for now15:59
gibiI'm OK to remove the test temporarily from nova-next while we figure out how to fix it15:59
sean-k-mooneyartom: are you going to try any of my suggestions form the mail16:00
artomsean-k-mooney, I haven't read it yet16:00
sean-k-mooneyno worries16:00
gibibtw, my dnm patch also passed nova-next and it only added logs to tempest :/ 16:00
sean-k-mooneyyou can see on one of stephens patchs that it passed in check and failed in gate16:01
sean-k-mooneyso it not a 100% failure just common16:01
gibiyeah16:01
yuvalis there a nova-meeting today?16:01
sean-k-mooneyno16:01
sean-k-mooneyits on tuseday16:02
sean-k-mooneybut you can still bring stuff up any time16:02
yuvalohh ok sorr16:02
gibiwhich also means passing on non q35 might be just luck :/16:02
sean-k-mooneywell maybe but the other jobs seam to be ok16:02
sean-k-mooneyi guess we could check logstash and confirm16:03
artomgibi, huh... I mean, it was never 100%, but this does seem like a weird coincidence16:03
artomI wonder if we can check the qemu and/or libvirt versions in ubuntu16:03
artomWhat changed and when16:03
gibiOK, the tagged attach runs in tempest-integrated-compute and that is nicely green16:03
sean-k-mooneythey are in the devstack logs16:03
sean-k-mooneyif you want to check but i doubt that is the problem16:04
*** whoami-rajat__ is now known as whoami-rajat16:12
artom_So one interesting thing is that in the console logs for a failing test_tagged_attachment, I'm seeing "[    5.322454] pcieport 0000:00:04.5: pciehp: Failed to check link status"16:28
sean-k-mooneyoh16:33
sean-k-mooneyso that could be related to the qemu patch16:33
sean-k-mooneyrealted to state tracking 16:33
artom_I'm going to try and see what's in the console for the passing run on gibi's patch16:37
*** artom_ is now known as artom16:37
rosmaitasean-k-mooney bauzas: do you need a pre-yoga-release release of os-brick so you can test lightbits code for nova?16:42
sean-k-mooneyrosmaita: yes16:43
sean-k-mooneywe do not allow code to changes to merge if they depend of unrelease libs16:44
rosmaitasean-k-mooney: ok, i will propose one today ... hopefully will get released right away, since it's not friday yet16:44
sean-k-mooneywell anytime before the non-client lib freeze is technically fine16:44
artomOh wait, we don't log the console by default, do we16:44
sean-k-mooneybut the nova patches wont pass ci until the release is done16:44
sean-k-mooneyrosmaita: so as long as there is a 5.2.0 before m3 it shoudl be ok16:45
sean-k-mooneythe sonner before m3 the less risk to the nova change16:45
rosmaitasean-k-mooney: ok, we are planning to release os-brick one week early this cycle (so next week)16:46
rosmaitaif that would be ok, i won't do a pre-release to avoid confusion16:46
sean-k-mooneyack yuval ^ are you ok with that16:46
sean-k-mooneyrosmaita: its release with intermediay so you can do addtional release at any point by the way16:47
sean-k-mooneybut next week likely will be fine16:47
yuvalyes, got it - we finish the followup til 10 feb - so it will leave window to merge the nova code till 2116:48
rosmaitathat sounds good, it would be better with the followup patches merged, i think16:48
spatelsean-k-mooney does multiple pci_alias address allow like this in nova.conf file ? - https://paste.opendev.org/show/812504/16:54
sean-k-mooneyyou can have multiple alsiases i need to check if its a multiopt like that or a json list or both16:56
sean-k-mooneyit should be in our docs but i dont recall off the top of my head16:56
sean-k-mooneyspatel: so yes https://docs.openstack.org/nova/latest/configuration/config.html#pci.alias16:56
sean-k-mooneythat sould work16:57
spatelnice thanks16:57
*** amoralej is now known as amoralej|off17:16
gibibauzas: left some comment for you in the ipless port patch 17:16
gibibauzas: nothing major17:16
opendevreviewMerged openstack/placement master: Extra tests around required traits  https://review.opendev.org/c/openstack/placement/+/82584618:27
opendevreviewMerged openstack/nova master: docs: Add new architecture guide  https://review.opendev.org/c/openstack/nova/+/81456318:28
opendevreviewMerged openstack/nova master: Add 'hw:vif_multiqueue_enabled' flavor extra spec  https://review.opendev.org/c/openstack/nova/+/79235618:51
opendevreviewmelanie witt proposed openstack/nova master: Raise InstanceNotFound on fkey constraint fail saving info cache  https://review.opendev.org/c/openstack/nova/+/82694219:37
admin1hi .. what does qemu unexpectedly closed the monitor mean during migration  ? log snippet here: https://gist.githubusercontent.com/a1git/3029cfd14883531c8ea7b12d0491d8bb/raw/74f57d9ff1f278f79dc0dca685f71508b779d40d/gistfile1.txt20:32
admin1 qemu-system-x86_64: Length mismatch: 0000:00:03.0/virtio-net-pci.rom: 0x40000 in != 0x80000: Invalid argument20:33
opendevreviewmelanie witt proposed openstack/nova master: Raise InstanceNotFound on fkey constraint fail saving info cache  https://review.opendev.org/c/openstack/nova/+/82694220:45
opendevreviewDmitrii Shcherbakov proposed openstack/nova master: Introduce remote_managed tag for PCI devs  https://review.opendev.org/c/openstack/nova/+/82483420:48
opendevreviewDmitrii Shcherbakov proposed openstack/nova master: Bump os-traits to 2.7.0  https://review.opendev.org/c/openstack/nova/+/82667520:48
opendevreviewDmitrii Shcherbakov proposed openstack/nova master: [yoga] Add support for VNIC_TYPE_SMARTNIC  https://review.opendev.org/c/openstack/nova/+/82483520:48
opendevreviewDmitrii Shcherbakov proposed openstack/nova master: Filter computes without remote-managed ports early  https://review.opendev.org/c/openstack/nova/+/81211120:49
frickleradmin1: https://bugs.launchpad.net/ubuntu/+source/qemu/+bug/171349020:57
*** dasm|rover is now known as dasm|off22:02
admin1frickler .. thanks .. i tried the migration again to another hypervisor with the exact same cpu and it worked without issues .. the original error was between E5-2660 v2 @ 2.20GHz -> E5-2670 v2 @ 2.50GHz  .. since it was an upgraded version of the cpu, it should have worked 22:20

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!