Thursday, 2022-07-28

opendevreviewmelanie witt proposed openstack/nova master: imagebackend: Cache the key manager when disk is encrypted  https://review.opendev.org/c/openstack/nova/+/82675601:39
opendevreviewOpenStack Proposal Bot proposed openstack/nova master: Imported Translations from Zanata  https://review.opendev.org/c/openstack/nova/+/85133704:34
gibigood morning06:09
bauzassean-k-mooney: gmann: gibi: thanks for your comments on https://review.opendev.org/c/openstack/nova/+/849133 will respin08:39
opendevreviewSylvain Bauza proposed openstack/nova master: api: Drop generating a keypair and add special chars to naming  https://review.opendev.org/c/openstack/nova/+/84913309:06
bauzasgibi: sean-k-mooney: gmann: reviews welcome on the respined keypair api change, just fixed gmann's points and some doc09:06
bauzashttps://review.opendev.org/c/openstack/nova/+/849133/7..809:07
sean-k-mooneythat still looks fine to me so readded +209:13
kashyapCan anyone figure out what's the failure here: https://zuul.opendev.org/t/openstack/build/de15983e71c8421c8623f892daaed41409:18
opendevreviewBalazs Gibizer proposed openstack/nova master: Allow enabling PCI tracking in Placement  https://review.opendev.org/c/openstack/nova/+/85046809:18
opendevreviewBalazs Gibizer proposed openstack/nova master: Retry /reshape at provider generation conflict  https://review.opendev.org/c/openstack/nova/+/85135809:19
opendevreviewBalazs Gibizer proposed openstack/nova master: Heal missing PCI allocation in the resource tracker  https://review.opendev.org/c/openstack/nova/+/85135909:19
gibisean-k-mooney: fyi ^^ I have preliminary allocation healing support09:19
gibisean-k-mooney: the yesterday's reshape headache was caused by a missing retry logic for reshape when the local provider tree cache is stale09:19
gibiso my code was correct :D 09:20
gibinow I will help auniyal then I will look at the keypair patch then look at the double mocking issue09:20
admin1sean-k-mooney, how do I validate "admin1: no in that config nova should upload the snapshot via the glace http api"  ?  .. it looks like its calling the http api and getting the error .. 09:22
sean-k-mooneyadmin1: did you check glance to see if the error is on its side.09:43
sean-k-mooneythe broken pip could be form reading the image from disk, uploading the image to glance or possible else where09:44
sean-k-mooneybut first stpe is proably to determin if there is an error on the glance side or if its just in nova09:45
kashyapbauzas: Since you looked at the master change, can you also please ACK the stable-{wallaby, xena, yoga} backports a the bottom here, please: https://review.opendev.org/q/topic:bug%252F198285309:55
kashyapMaster change merged09:55
bauzaskashyap: ack10:04
kashyapbauzas: gibi: Both of you gave +2, but neither set Workflow :) - https://review.opendev.org/c/openstack/nova/+/85120510:26
kashyap(stable/xena) Thanks10:26
bauzasbecause again, we need to hold for yoga10:27
bauzasdon't fight for xena, just relax with a yoga :p10:27
bauzasok, probably one of the worst puns I made10:28
kashyapHeh10:28
kashyapbauzas: Ah, yes.   I thought you +2ed yoga too10:29
bauzasI did +W for yoga10:29
bauzasnow that our master is merged10:29
kashyapYes, you did; I missed to refresh; thx!10:30
kashyapbauzas: Also check wallaby, please, while you have the context10:30
kashyapIt has gibi's ACK - https://review.opendev.org/c/openstack/nova/+/85120610:30
bauzasI'll visit the wallabies10:30
bauzasyou sur'ly (ussuri)10:31
bauzasand then I'll take the train10:32
bauzasoh, but again, I missed Victoria10:32
kashyapHeh10:34
kashyapThanks!10:34
kashyapYes10:34
opendevreviewBalazs Gibizer proposed openstack/nova master: use force down to stabilize the test  https://review.opendev.org/c/openstack/nova/+/85136810:38
stephenfingibi: sean-k-mooney: I missed your ping yesterday RE: the mock stuff. That sounds like a lot of work. Damn it /o\10:50
gibistephenfin: I'm just about to start looking into it to see how much work to fix it10:50
gibiso I hope I will have a better understanding by the end of today10:51
stephenfinJinx. I was about to say I can try to play around with it but I don't know if I can spend days at it, heh10:51
stephenfinYou saw efried's pointer to other projects that have solved this problem already?10:51
gibiyes I saw10:51
stephenfinsweet10:51
gibiwe need efried back in nova! 10:51
stephenfinI mean, it's not like he needs to sleep10:52
stephenfinYou can sleep when you're dead etc. etc. ;-)10:52
gibiyepp, exactly like that :D10:53
gibiI remember we had such poster in the office a couple of years back.10:53
gibibauzas, sean-k-mooney: can we land this? https://review.opendev.org/c/openstack/os-traits/+/850538 I hate to see the red CI in my series due to that10:57
sean-k-mooneyah that am ill review it now in a sec just finishing an email but ya we will need to do a releas but i can propose that once its merged11:01
bauzasgibi: just a +1 nit https://review.opendev.org/c/openstack/os-traits/+/85053811:02
bauzastl;dr: singular or plural ?11:02
bauzasif this is for the root RP, ie. the compute host itself, I guess we could make it plural11:03
gibiit will be on every PCI RP11:03
bauzasif this is for a nested RP 11:03
bauzasthen singular11:03
gibibut wont be on the root11:03
bauzasok, then you answered my question, will +211:03
gibithanks11:03
sean-k-mooneyi would go plural11:04
* bauzas was enough lazy to not look at the spec11:04
bauzassean-k-mooney: if this is a PCI RP, then singular11:04
sean-k-mooneybased on ACCELERATORS and REMOTE_MANAGED_PORTS11:04
bauzaslike "I can manage myself"11:04
sean-k-mooneythis is kind of like sheep11:05
* bauzas didn't want to derail the series for such a nit11:05
sean-k-mooney1 sheep 2 sheep11:05
bauzasdamn english folks11:05
sean-k-mooneyeither works but i think plural is more correct11:05
sean-k-mooneywell ok11:05
sean-k-mooneyno your right 11:05
sean-k-mooneysingulaer11:05
sean-k-mooneysicne we have 1 RP per PF11:05
sean-k-mooneyi was thinking about the VF inventories11:06
gibiwe have 1 PR per multiple VFs11:06
gibi:)11:06
gibiRP11:06
sean-k-mooneyya so this is correct as is11:06
gibiOK11:06
bauzasyeah11:06
bauzasI wasn't discussing about SRIOV11:06
bauzasthis is for a PCI ID11:06
gibibtw, bauzas, this trait was not mentioned in the spec so I added a comment to the merged spec now and I will push a follow up on the spec to sync it with the implementation reality11:07
bauzashence singular11:07
sean-k-mooneygibi: we can update the spec later 11:07
gibiyeah I11:07
sean-k-mooneybased on the final merged implemeantion11:07
gibiI'm planning to do so11:07
bauzasgibi: ok, so I wasn't lazy then :D11:07
bauzas11:07
bauzas:p11:07
gibiI'm collecting the comments there to know what to update11:07
sean-k-mooneywe also move the logic to the compute manager11:07
gibisean-k-mooney: yepp11:07
sean-k-mooneyi dont know if we eplxitly said tiwoudl be in the driver before but its good to document11:08
bauzasgibi: I'll try to look at your series before tuesday eob11:08
bauzasoh wait11:09
gibibauzas: when you look try to focus on the high level direction and architecture please11:09
bauzasgibi: https://github.com/openstack/os-traits/tree/master/os_traits/hw11:09
gibiwe discussed with sean-k-mooney that this is not a hw trait11:09
bauzascould be hw11:09
gibibut more like a capability trait11:09
gibiof the compute service11:09
bauzasmeh ok11:09
* bauzas needs to lunch11:09
opendevreviewMerged openstack/os-traits master: Add COMPUTE_MANAGED_PCI_DEVICE trait  https://review.opendev.org/c/openstack/os-traits/+/85053811:12
gibibauzas, sean-k-mooney: thanks!11:12
gibiI'm going to push a os-traits release11:13
sean-k-mooneylets wait a sec11:15
bauzasdamn11:15
bauzas| nova               | 11            | 22           | 50.0              |11:15
bauzas50% of blind rechecks11:15
bauzasman !11:15
sean-k-mooneyit would be nice to do https://review.opendev.org/c/openstack/os-traits/+/844336 too11:15
bauzasdon't people read our meeting ? :)=11:16
sean-k-mooneyricolin: ^ coudl you respin that quickly and remvoe the none11:16
sean-k-mooneywell11:17
sean-k-mooneyricolin: we could leave it i guess11:17
sean-k-mooneyah actully no11:17
sean-k-mooneyvioummu=non shouuld not force libvirt11:18
sean-k-mooneyso we should remove the trait and not request a trait if you set the exptra spec to none11:18
sean-k-mooneygibi: bauzas  alernitivly i could adress my own nit in that patch and ye could review11:19
gibisean-k-mooney: go for it11:19
gibiI can respin the releasenotes11:19
gibis/releasenotes/release/11:19
opendevreviewsean mooney proposed openstack/os-traits master: Add traits for vIOMMU  https://review.opendev.org/c/openstack/os-traits/+/84433611:21
sean-k-mooneyoh the depends on is wrong11:22
opendevreviewsean mooney proposed openstack/os-traits master: Add traits for vIOMMU  https://review.opendev.org/c/openstack/os-traits/+/84433611:22
sean-k-mooneyok ^ should be good to review11:23
* gibi clicks11:24
gibidone +211:27
gibistephenfin, sean-k-mooney: so far I fixed the duplicated mocking in libvirt.test_driver and all of them was either an unnecessary second mocking or can be fixed easily. So I think while it is manual work it can be done. I will try to fix them today and push a patch12:19
sean-k-mooneysound promising12:19
gibiI think it is worth to fix as there was really stupid mistakes caught by this. like mocking the same thing twice in two consecutive decorator and applying assert on the second mock :)12:21
opendevreviewribaudr proposed openstack/python-novaclient master: Microversion 2.91: Support specifying destination host to unshelve  https://review.opendev.org/c/openstack/python-novaclient/+/83165112:43
bauzasok, will rebase my novaclient change on top of ^12:48
opendevreviewribaudr proposed openstack/python-novaclient master: Microversion 2.91: Support specifying destination host to unshelve  https://review.opendev.org/c/openstack/python-novaclient/+/83165112:50
Ugglabauzas, hoping you will not have too many conflicts.12:52
bauzasUggla: nope, just one I guess12:52
bauzasfor the microversion number12:52
*** dasm|off is now known as dasm12:57
opendevreviewSylvain Bauza proposed openstack/python-novaclient master: Add support for 2.92 : keypair import mandatory  https://review.opendev.org/c/openstack/python-novaclient/+/85123113:01
bauzasUggla: actually, no merge conflict I got \o/13:01
bauzasjust a simple rebase13:01
Ugglabauzas, \o/13:01
opendevreviewAmit Uniyal proposed openstack/nova master: For evacuation, ignore if task_state is not None  https://review.opendev.org/c/openstack/nova/+/84888613:07
stephenfingibi: nice work :)13:33
gibiTIL: if there are both side_effect and return_value is defined on a mock then return_value is ignored14:12
gibibauzas: when you are around, could you hit https://review.opendev.org/c/openstack/os-traits/+/844336 ?14:14
bauzasI am and I can14:15
gibithank you14:15
gibiI will update the os-trait release patch once that lands14:15
bauzasdone14:15
gibiawesome thanks14:17
opendevreviewMerged openstack/os-traits master: Add traits for vIOMMU  https://review.opendev.org/c/openstack/os-traits/+/84433614:26
gibisean-k-mooney, bauzas: I've updated the os-traits release patch https://review.opendev.org/c/openstack/releases/+/85139014:30
efried:*14:33
gibio/14:33
gibiefried: how is life?14:34
efriedLiving the dream. Working on https://github.com/openshift/hive/ mostly. Enjoy it a lot.14:35
efriedWhat's new with y'all?14:35
gibigood to hear that14:38
gibiI got involved writing k8s operators to deploy OpenStack so I will look at hive at some point to learn some tricks :)14:39
gibiwhile also trying to make PCI tracking in Placement happen14:40
efriedNot gonna claim hive is the examplar of k8s operators, but it has some pretty cool stuff going on.14:44
efriedIn theory hive will deploy OpenStack -- though I've never tried it myself.14:44
whoami-rajathi #openstack-nova , wanted to request reviews on my feature, it's been sitting for 3 months without reviews and just wanted to get it in in the Zed cycle https://review.opendev.org/c/openstack/nova/+/83121914:47
whoami-rajat1) https://review.opendev.org/c/openstack/nova/+/82036814:47
whoami-rajat2) https://review.opendev.org/c/openstack/nova/+/83121914:47
whoami-rajat3) https://review.opendev.org/c/openstack/nova/+/83088314:47
dansmithwhoami-rajat: sorry I lost track of that.. tempest tests are now working?14:49
dansmithwhoami-rajat: the top patch is in merge conflict14:49
sean-k-mooneyi started reviewing on eof thos yesterday but was tied up with downstream stuff15:01
sean-k-mooneyoh it was the tempest patch15:01
sean-k-mooneydansmith: im pretty sure that passwords are optional for rebuild even if you orginaly set one but im not sure about what tempest needs15:03
sean-k-mooneyim expecting it to use the ssh key it has15:03
sean-k-mooneyand fall back to the default cirros one otherwise based on its config15:03
dansmithsean-k-mooney: yeah, but that code was copied from somewhere else, and it looked to me like it might be required in case they're using passwords instead of keys15:04
dansmithbut regardless, it's just not part of the test so the comment was irrelevant I think15:04
sean-k-mooneyack15:05
sean-k-mooneyi havent looked at the nova change yet15:05
sean-k-mooneyits on my radar15:06
sean-k-mooneywhoami-rajat:^15:06
sean-k-mooneywhat was for you15:07
whoami-rajatdansmith, yeah, tempest is working, i will rebase the nova patch, not sure if there is any change needed on the tempest patch based on the comments15:43
whoami-rajatsean-k-mooney, some part of the test is taken from rebuilding an image backed instance, and thanks for looking15:44
opendevreviewRajat Dhasmana proposed openstack/nova master: Add support for volume backed server rebuild  https://review.opendev.org/c/openstack/nova/+/82036816:14
opendevreviewRajat Dhasmana proposed openstack/nova master: Add conductor RPC interface for rebuild  https://review.opendev.org/c/openstack/nova/+/83121916:14
opendevreviewRajat Dhasmana proposed openstack/nova master: Add API support for rebuilding BFV instances  https://review.opendev.org/c/openstack/nova/+/83088316:14
whoami-rajatdansmith, ^ rebased16:14
dansmithack16:21
opendevreviewOliver Walsh proposed openstack/nova master: Skip cell0 in all-cells min version check  https://review.opendev.org/c/openstack/nova/+/85144017:21
opendevreviewOliver Walsh proposed openstack/nova master: Skip cell0 in all-cells min version check  https://review.opendev.org/c/openstack/nova/+/85144017:22
dansmithowalsh_: so your templated urls don't have DB names in them, it seems17:26
owalsh_dansmith: correct, has --database_connection='{scheme}://{username}:{password}@{hostname}/?{query}'17:27
dansmiththey have hostnames per cell, but I'm not exactly sure why.. are those pointing to hostnames that are VIPs for separate DB instances or something/17:27
owalsh_so on the cell1 conductor in nova.conf it the db connection will point to it's mariadb, cell0 is on a different mariadb17:27
owalsh_both are VIPs17:28
dansmithowalsh_: I need to see the full stack of where this is called from17:28
dansmithowalsh_: I guess the problem is that this is being called from a cell conductor and not a superconductor and that's the problem.. and I guess that's because the cell conductor has api_database configured and thus thinks it is supposed to do the fanout?17:29
dansmithbut I want to know what the operation is that gets us here17:29
dansmithactually,17:30
dansmiththe superconductor will be the same because templated urls are never going to work if you have DBs on different hostnames but try to use {hostname} since that will only ever resolve to one17:30
dansmithso you probably need to just not use {hostname} in the URLs if the DBs are at specific locations17:30
dansmithif you're using DNS names pointing to VIPs like cell1.foo and cell0.foo, then you don't need the template at all right?17:31
owalsh_full stack doesn't give any more info but I'll post it. It's called from utils.raise_if_old_compute() in service create() AFAICT17:31
dansmithokay, but need to know what's being done to know who is calling that and for why17:32
dansmithbut if we want to exclude cell0 from that check (which *is* specific to computes) we should do it there and not in this generalized method17:33
dansmithhowever, like I say, that's just punting the can down the road, because a superconductor arrangement like this with multiple cells will not work17:33
owalsh_ack, in tripleo superconductor will use the same DB server as cell0 so it happens to work17:33
dansmithokay17:34
dansmithbut if you use per-db hostnames, then no need for the {hostname} in the template at all right?17:34
dansmith(per-db hostnames being far superior, of course)17:34
dansmiththe template was really for the credentials and not the other things, I just added every part of the url into the templating engine for flexibility17:35
sean-k-mooney[m]im having some issues with my work laptop so im going to set up my personal one quickly so ill be on matrix for a bit rather then irc17:41
sean-k-mooney[m]i should see either ping 17:41
sean-k-mooney[m]but just an fyi17:41
*** gibi is now known as gibi_pto17:43
gibi_ptoI will be off tomorrow, but back on Monday17:43
opendevreviewBalazs Gibizer proposed openstack/nova master: Remove double mocking  https://review.opendev.org/c/openstack/nova/+/85144517:53
gibi_ptostephenfin, sean-k-mooney[m]: ^^ it is just a partial fix but I run out of time today and I will be off tomorrow so I pushed it. feel free to take over tomorrow if you have time17:54
sean-k-mooney[m]gibi_pto:  ack17:59
owalsh_dansmith: nova-conductor logs - https://paste.openstack.org/show/b85LsPayPl2QYN6RrDi1/, just noticed that it times out waiting for cell0 after 1 minutes so not fatal18:00
owalsh_dansmith: even if we just switch to the VIP hostnames might have issues if there is a firewall between the cell conductor and the cell0 db18:03
dansmithowalsh_: yeah, so making that compute-specific check might be good, just needs to be one level up18:06
dansmithI'll look at the logs in just a sec18:06
dansmithowalsh_: yeah it should handle the failure gracefully18:08
dansmithowalsh_: that's not enough to tell what's going on because of how the stack frame gets chopped for a thread, unfortunately18:09
dansmithcan you correlate that req-id with the api logs or something?18:09
dansmithowalsh_: nm, I got it.. on service startup18:18
owalsh_dansmith: hrmm, I guess it's not just the hostname that could be an issue. If cell0 username/password is different to the cell nova db it would also fail18:40
dansmithowalsh_: yep for sure, that's one of the compromises18:41
dansmithbut the assertion during design was that credentials are more per-host and less per-database18:41
owalsh_ack, IIRC for tripleo it's really just the {query} part that mattered as it included the local bind address for each host18:43
dansmithack18:43
owalsh_but now that has moved to a local conf file (pymysql version didn't support this at the time)18:43
owalsh_so could maybe just stop using cell templates, will take a look18:44
dansmithyeah, if possible I'm sure that'd be better18:44
opendevreviewMerged openstack/nova master: api: Drop generating a keypair and add special chars to naming  https://review.opendev.org/c/openstack/nova/+/84913319:09
owalsh_dansmith: re the api db connection currently being set on the cell conductor, I guess we want to keep that?20:19
dansmithowalsh_: "we" being redhat yeah, because we want the affinity check to work20:37
*** EugenMayer8 is now known as EugenMayer20:46
*** dasm is now known as dasm|off21:47

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!