Thursday, 2020-06-25

*** arjunbaindur has joined #openstack-nova00:05
*** arjunbaindur has quit IRC00:07
*** gyee has quit IRC00:07
*** arjunbaindur has joined #openstack-nova00:07
gmannmelwitt: +A, i was thinking to capture the im-not-found in _do_delete() also but if request reach there it should be a normal delete and not any race.00:33
gmannmelwitt: dansmith: elod finally this is ready, stable/stein unblocking gate, please review - https://review.opendev.org/#/c/737332/00:35
gmannthis makes the grenade job as n-v and depends-on fixes the lgeacy multinode jobs for 'virutalenv not found'00:36
melwittgmann: ah yeah. thanks!00:36
melwittgmann: ok cool, I was just about to ask if that was ready. I will look tomorrow if others don't beat me to it00:36
melwittoh, actually that's very easy so I'll look now00:37
melwittgmann: are we planning to backport that to queens too or?00:37
gmannmelwitt: thanks. yeah, and depends-on also merged to good to go00:37
gmannmelwitt: yes but stable/rocky and other EM stable gate is still blocked, we need this devstack fix to get in and then backport this. devstack fix which need more work - https://review.opendev.org/#/c/735615/00:38
melwittack00:39
gmanngate blocked means tempest jobs also for uwsgi issue00:39
melwittsigh.. yeah00:42
*** yaawang_ has joined #openstack-nova00:45
gmannalso train gate is up, passed on known failure of those 'virrualenv not found' and neutron-greande-multinode job - here is passing : https://review.opendev.org/#/c/735950/00:45
melwittgmann: cool.. I'm trying to figure out why the cherry pick validation is failing on that tho00:54
gmannmelwitt: its ussuri backport is still not merged - https://review.opendev.org/#/c/736073/00:55
melwittohhhh cool. guh, guess I needed a better error message :P00:55
gmannmelwitt: you are right, error message is not right one, this should be the error- https://github.com/openstack/nova/blob/1cae0cd7229207478b70275509aecd778ca69225/tools/check-cherry-picks.sh#L1301:11
melwittgmann: similar to that but not exactly -- that error is saying it's not anywhere, but in this case it's on master so it passes by that01:11
gmanni think it is not finding any hashes in line 7 and then  only going to check for the stable*only tag - https://github.com/openstack/nova/blob/1cae0cd7229207478b70275509aecd778ca69225/tools/check-cherry-picks.sh#L701:12
melwittyeah... but why I wonder? there's hashes in the commit message01:13
gmannyeah, not sure why.01:14
melwittwhen it try it locally it picks up hashes01:16
melwitt(when I run the git show ... manually)01:16
gmannyeah, same i tried and it picked both the hases01:18
gmannhashes01:18
melwittyeah01:18
gmannits failing same way even all previous branch backport are merged, this one should pass but fail - https://review.opendev.org/#/c/728057/01:19
openstackgerritMerged openstack/nova master: objects: Replace 'cpu_pinning_requested' helper  https://review.opendev.org/71469701:20
melwittuh oh01:21
*** lbragstad has joined #openstack-nova01:27
gmannmelwitt:  locally i ran full script and got the right error - "Cherry pick hash eedc0b5ff319b3cce42dba4c4720bcb98798e064 not on any master or stable branches"01:33
melwittoh yeah ok01:33
melwittweird01:34
melwittI wonder why it doesn't do that in gate01:34
melwittand why is that other change failing erroneously. I'm too tired to look right now01:34
gmannyeah, me too. will check in morning.01:36
melwitt+101:37
*** markvoelker has joined #openstack-nova01:39
*** markvoelker has quit IRC01:44
*** tbachman has quit IRC02:00
*** tbachman has joined #openstack-nova02:09
openstackgerritJinsheng Zhang proposed openstack/nova stable/rocky: Add API to support multiple boot-volumes with boot order selection  https://review.opendev.org/73789302:17
*** arjunbaindur has quit IRC02:46
*** hamalq has quit IRC02:51
*** hamalq has joined #openstack-nova02:53
*** hamalq has quit IRC02:58
*** nweinber has joined #openstack-nova02:58
*** hoonetorg has quit IRC03:02
*** rcernin has quit IRC03:14
*** nweinber has quit IRC03:15
*** hoonetorg has joined #openstack-nova03:15
*** rcernin has joined #openstack-nova03:16
*** lbragstad has quit IRC03:22
*** rcernin has quit IRC03:24
*** rcernin has joined #openstack-nova03:31
*** psachin has joined #openstack-nova03:34
*** chenhaw1 has joined #openstack-nova03:36
*** chenhaw has quit IRC03:37
*** chenhaw1 is now known as chenhaw03:37
openstackgerritJinsheng Zhang proposed openstack/nova-specs master: Add nova-support-multiple-boot-volume-with-boot-order-selection spec  https://review.opendev.org/73789703:40
*** markvoelker has joined #openstack-nova03:40
*** rcernin has quit IRC03:45
*** rcernin has joined #openstack-nova03:48
*** markvoelker has quit IRC03:50
*** udesale has joined #openstack-nova03:52
*** pmacdonnell has quit IRC03:56
*** rcernin has quit IRC03:56
*** ratailor has joined #openstack-nova04:00
*** arjunbaindur has joined #openstack-nova04:02
*** rcernin has joined #openstack-nova04:05
*** hamalq has joined #openstack-nova04:21
*** hamalq has quit IRC04:21
*** evrardjp has quit IRC04:34
*** evrardjp has joined #openstack-nova04:34
*** hamalq has joined #openstack-nova04:38
*** rnoriega- has joined #openstack-nova04:41
*** hamalq has quit IRC04:43
*** rnoriega_ has quit IRC04:43
*** jmlowe has quit IRC04:46
*** jmlowe has joined #openstack-nova04:50
*** ccamacho has quit IRC04:53
*** hamalq has joined #openstack-nova05:10
*** hamalq has quit IRC05:15
*** links has joined #openstack-nova05:32
*** zzzeek has quit IRC05:41
*** zzzeek has joined #openstack-nova05:41
*** dklyle has quit IRC05:50
*** links has quit IRC05:50
*** hamalq has joined #openstack-nova05:51
*** damien_r has joined #openstack-nova05:56
*** hamalq has quit IRC05:56
*** links has joined #openstack-nova05:59
*** damien_r has quit IRC06:00
*** damien_r has joined #openstack-nova06:03
*** rpittau|afk is now known as rpittau06:20
*** hamalq has joined #openstack-nova06:27
*** hamalq has quit IRC06:32
*** zzzeek has quit IRC06:36
*** zzzeek has joined #openstack-nova06:39
*** jsuchome has joined #openstack-nova06:50
*** hamalq has joined #openstack-nova06:52
openstackgerritJinsheng Zhang proposed openstack/nova master: Add API to support multiple boot-volumes with boot order selection  https://review.opendev.org/73791306:53
gibi_offsean-k-mooney, efried: placement data visualizer https://github.com/gibizer/osc-placement-tree06:54
*** gibi_off is now known as gibi06:55
*** hamalq has quit IRC06:58
*** nightmare_unreal has joined #openstack-nova07:05
*** ccamacho has joined #openstack-nova07:05
*** luksky has joined #openstack-nova07:09
*** dtantsur|afk has quit IRC07:10
*** rouk has quit IRC07:10
*** dtantsur has joined #openstack-nova07:13
*** ralonsoh has joined #openstack-nova07:17
*** slaweq has joined #openstack-nova07:27
*** tesseract has joined #openstack-nova07:33
*** zzzeek has quit IRC07:36
*** hamalq has joined #openstack-nova07:36
*** zzzeek has joined #openstack-nova07:37
*** hamalq has quit IRC07:41
*** tosky has joined #openstack-nova07:42
*** maciejjozefczyk has joined #openstack-nova07:43
*** hamalq has joined #openstack-nova07:55
*** damien_r has quit IRC07:59
*** hamalq has quit IRC08:00
*** damien_r has joined #openstack-nova08:01
*** JamesBenson has joined #openstack-nova08:02
openstackgerritJiri Suchomel proposed openstack/nova master: Remove deprecated nova.image.download hook  https://review.opendev.org/72533808:03
openstackgerritJiri Suchomel proposed openstack/nova master: Add ability to download Glance images into the libvirt image cache via RBD  https://review.opendev.org/57430108:04
*** ociuhandu has quit IRC08:05
*** JamesBen_ has quit IRC08:05
*** tbachman has quit IRC08:08
*** tbachman has joined #openstack-nova08:08
*** hamalq has joined #openstack-nova08:16
*** rcernin has quit IRC08:17
*** corvus has quit IRC08:17
*** hamalq has quit IRC08:21
*** hamalq has joined #openstack-nova08:25
*** hamalq_ has joined #openstack-nova08:27
*** corvus has joined #openstack-nova08:30
*** hamalq has quit IRC08:30
*** hamalq_ has quit IRC08:31
*** jawad_ax_ has joined #openstack-nova08:35
*** xek has joined #openstack-nova08:35
openstackgerritElod Illes proposed openstack/nova stable/stein: Check cherry-pick hashes in pep8 tox target  https://review.opendev.org/73792208:36
*** spatel has joined #openstack-nova08:37
*** jawad_axd has quit IRC08:39
*** spatel has quit IRC08:42
*** jmlowe has quit IRC08:48
*** jmlowe has joined #openstack-nova08:50
*** avolkov has joined #openstack-nova08:55
*** ociuhandu has joined #openstack-nova08:57
*** derekh has joined #openstack-nova08:58
*** tetsuro has quit IRC09:13
*** damien_r has quit IRC09:18
*** bhagyashris is now known as bhagyashris|afk09:55
*** hamalq has joined #openstack-nova09:57
*** hamalq has quit IRC10:01
*** hamalq has joined #openstack-nova10:13
*** hamalq has quit IRC10:17
*** rpittau is now known as rpittau|bbl10:20
*** tkajinam has quit IRC10:22
openstackgerritJinsheng Zhang proposed openstack/nova master: Add API to support multiple boot-volumes with boot order selection  https://review.opendev.org/73791310:30
*** ttsiouts has joined #openstack-nova10:41
sean-k-mooneygibi: oh nice. i still want to add __iter__ __repr__ and perhaps __getitem__ and __contains__10:44
sean-k-mooney__getitem__ would allow use ot use pt[uuid_or_name] instead of calling find10:44
sean-k-mooneyand __contains__ would allow "if uuid_or_name in pt"  instead of calling pt.exists(uuid_or_name)10:45
sean-k-mooney__contains__ is technically provided for free when you add __iter__ but it might be more effiecnt to do it myself10:47
*** martinkennelly has joined #openstack-nova10:54
gibisean-k-mooney: some of those could help with the readability of the code11:00
*** bhagyashris|afk is now known as bhagyashris11:00
sean-k-mooneygibi: yep that was the main idea11:06
sean-k-mooneyif there is a perfomance boost form any of this that is just a nice benifit but its mainly so i can tree the providertree or provider objects as standard python collections11:06
sean-k-mooneyinstead of having to figure out what we named the relevent fucntions11:07
sean-k-mooneymost/all of the functionality is already there just named differently11:08
sean-k-mooneygibi: im starting on the numa in placment implemantion at the moment and while im not going to commit to this im going to try an take a test driven developemnt appoch.11:15
sean-k-mooneyso im going to try and create a libvirt fucntional test that starts with a flat toplogy and  converts it to the numa form like we have for pcpus11:16
sean-k-mooneyim hoping adding the special fucntion will make implementing the reshape simpelr in the long run11:16
*** xek has quit IRC11:25
*** xek has joined #openstack-nova11:26
*** raildo has joined #openstack-nova11:39
openstackgerritBalazs Gibizer proposed openstack/nova master: Prevent libvirt driver starting on non Linux platform  https://review.opendev.org/73750811:49
*** udesale_ has joined #openstack-nova11:52
*** dpawlik6 has quit IRC11:54
*** udesale has quit IRC11:54
openstackgerritBalazs Gibizer proposed openstack/nova stable/ussuri: Guard against missing image cache directory  https://review.opendev.org/73799012:19
*** dpawlik6 has joined #openstack-nova12:19
openstackgerritStephen Finucane proposed openstack/nova master: Correct reported system memory  https://review.opendev.org/73382712:21
openstackgerritStephen Finucane proposed openstack/nova master: Prevent libvirt driver starting on non Linux platform  https://review.opendev.org/73750812:21
*** derekh has quit IRC12:30
*** rpittau|bbl is now known as rpittau12:42
*** xek has quit IRC12:47
*** derekh has joined #openstack-nova12:54
*** ttsiouts has quit IRC12:58
*** ttsiouts has joined #openstack-nova12:58
*** ttsiouts has quit IRC13:03
*** tobias-urdin has joined #openstack-nova13:13
tobias-urdinwhat populates ConsoleAuthToken.host field, I accidentally registered a compute node with the wrong IP configured and can't get console working after that13:15
tobias-urdinthe ip in the database compute_nodes is correct, but the generated entries in console_auth_tokens get's the wrong ip13:15
*** lbragstad has joined #openstack-nova13:17
*** psachin has quit IRC13:21
*** ttsiouts has joined #openstack-nova13:23
*** ratailor has quit IRC13:25
*** nweinber has joined #openstack-nova13:30
openstackgerritStephen Finucane proposed openstack/nova master: mypy: Add type annotations to 'nova.pci'  https://review.opendev.org/67620913:33
openstackgerritStephen Finucane proposed openstack/nova master: mypy: Add nova.cmd, nova.conf, nova.console  https://review.opendev.org/70565713:33
openstackgerritStephen Finucane proposed openstack/nova master: mypy: Add type annotations to top-level modules  https://review.opendev.org/70565813:33
openstackgerritStephen Finucane proposed openstack/nova master: objects: Use imports instead of type aliases  https://review.opendev.org/73801813:36
openstackgerritStephen Finucane proposed openstack/nova master: objects: Remove wrappers around ovo mixins  https://review.opendev.org/73801913:36
openstackgerritStephen Finucane proposed openstack/nova master: objects: Add type hints  https://review.opendev.org/73802013:36
*** dpawlik6 is now known as dpawlik-213:48
*** dpawlik-2 is now known as danpawlik13:48
openstackgerritStephen Finucane proposed openstack/nova master: virt: Add 'context', drop 'network_info' parameters for 'unrescue'  https://review.opendev.org/73038214:00
openstackgerritStephen Finucane proposed openstack/nova master: Add emulated TPM support to Nova  https://review.opendev.org/63136314:00
openstackgerritStephen Finucane proposed openstack/nova master: Add support for resize and cold migration of emulated TPM files  https://review.opendev.org/63993414:00
*** xek has joined #openstack-nova14:06
stephenfingibi: I've proposed adding the vTPM work to a runway14:07
stephenfinStill need to do the shelve/unshelve patches but that shouldn't block what's there getting in, IMO14:08
openstackgerritMerged openstack/nova master: Remove lxml deprecated methods  https://review.opendev.org/73747214:08
*** dklyle has joined #openstack-nova14:10
*** dklyle has quit IRC14:12
*** mriedem has joined #openstack-nova14:14
gibistephenfin: thanks! Sure if there are a set of meaningful patches that are ready then it is good for runway14:18
gibistephenfin: I will look at the queue after my call and move it to the slot14:19
*** markvoelker has joined #openstack-nova14:19
*** markvoelker has quit IRC14:24
*** mlavalle has joined #openstack-nova14:30
*** xek has quit IRC14:39
bauzasgibi: I'll need to be off by 6:30pm today so I'll be around the nova meeting by the first 30 mins14:54
gibibauzas: thanks for the heads up.14:54
bauzasnp14:55
gibibauzas: do you have any important stuff for the libvirt subteam?14:55
*** josephillips has joined #openstack-nova14:57
josephillipshey guys question is possible add a hw property that came from images after the vm is deployed?14:58
josephillipsor where this properties are stored after the deployment15:02
aarentsgibi: just to mention that I will need few cyle from dansmith & sean-k-mooney to finilize  https://review.opendev.org/#/c/736169/ and  https://review.opendev.org/#/c/734776/ in the coming days if possible15:04
gibiaarents: is this related to the libvirt subteam?15:05
sean-k-mooneyaarents: is that the paralle snapshot feature15:06
aarentsbauzas: not sure of peremiter of libvirt can we consider it is ?15:07
sean-k-mooneyya ill re review those today15:07
aarentssean-k-mooney: yep15:07
aarentssean-k-mooney: thanks15:07
sean-k-mooneybauzas: gibi  its not libvirt related it generic across all virt dirvers15:07
sean-k-mooneybauzas: gibi but dont let that stop you reviewing :)15:08
aarentsok15:08
bauzasgibi: aarents: ack, will try to look at both changes15:08
bauzasfor the scope of the subteam, this can be large15:08
bauzasI'm not opiniated on it15:09
sean-k-mooneyaarents: hehe i have draft comment on the first patch which i just pushed. the relese note comment is the only real one and its just on wording.15:10
gibiaarents: I just wanted to know how this connects to the topic with bauzas.15:11
gibiaarents: feel free to mention this during the meeint15:12
gibig15:12
gibimeeting15:12
gibiin the Open Discussion part15:12
*** jawad_ax_ has quit IRC15:16
*** xek has joined #openstack-nova15:17
*** jawad_axd has joined #openstack-nova15:18
*** bhagyashris is now known as bhagyashris|afk15:19
*** jawad_axd has quit IRC15:22
aarentsgibi: Thank you, I cannot attend, I have to pick my daughter from school, nevermind don't spend time on it during meeting, nothing disruptive/blocking15:23
aarentssean-k-mooney: thanks I will check15:23
*** udesale_ has quit IRC15:28
*** udesale has joined #openstack-nova15:34
gibiaarents: OK. thanks15:36
dansmithaarents: just two small things and then I'm +215:38
dansmithaarents: if you can get those done when you get back ping me and I'll circle back quickly15:38
gibinova team meeting starts in 15 minutes on #openstack-meeting-315:45
dansmithI might be in and out due to some local distraction, FYI15:49
dansmithnot sure there's much for me to say this week15:49
bauzasmaybe we can have a short meeting ?15:50
dansmithbeen recheck grinding my patches in the runway and working on fixing glance and devstack issues so we can have a ceph multistore job15:50
* bauzas sweats in his home office (context : living in EU)15:50
*** dklyle has joined #openstack-nova15:50
*** david-lyle has joined #openstack-nova15:52
dansmithbauzas: is it hot there?15:53
*** ttsiouts has quit IRC15:53
bauzasi can talk in Celsius, man15:53
*** jawad_axd has joined #openstack-nova15:53
*** david-lyle has quit IRC15:53
*** ttsiouts has joined #openstack-nova15:53
dansmithgonna be 30C here today15:54
bauzasbut I'll make an effort : 90 degrees15:54
dansmithah15:54
bauzasfortunately, the pool is open 24x715:54
sean-k-mooneydansmith: i hope you have ac or its at least dry heat15:54
sean-k-mooneydansmith: otherwise that is hell15:54
dansmithsean-k-mooney: it's dry, pretty comfortable really15:55
bauzassean-k-mooney: I don't have A/C at home and the inside temperature is 28C15:55
gibidansmith: ack15:55
dansmithwe chill the house down with a fan overnight so it's cold and it lasts most of the day until things start cooling back off again15:55
gibiI will aim for a short meeting15:55
* bauzas is used to live with this temperature inside15:55
dansmithbut we do have AC when necessary15:55
*** hamalq has joined #openstack-nova15:55
bauzasmany computers in a small room has a price15:55
bauzasand a window opening to the West too15:56
sean-k-mooneybauzas: ya the ceiling fan i installed in my ofice the fact i have roof windows works well.15:56
sean-k-mooneyjust opening roof windows make a surprising difference15:57
bauzasheh, in France we don't have ceiling fans, unless you wanna have a saloon15:57
bauzasor you're about your 90s15:57
bauzaswe prefer sweating15:57
*** jawad_axd has quit IRC15:57
sean-k-mooneybauzas: we dont have them in ireland normally either15:58
*** ttsiouts has quit IRC15:58
sean-k-mooneybauzas: i just didnt want to by an ac systme yet15:58
bauzasyeah me too15:58
sean-k-mooneyim currently planning to wait to get ac untill i also deside if im getting solar next year16:00
*** hamalq has quit IRC16:01
*** hamalq has joined #openstack-nova16:01
*** hamalq_ has joined #openstack-nova16:03
*** hamalq has quit IRC16:06
*** rpittau is now known as rpittau|afk16:11
jsuchome:q16:12
jsuchomeouch, wrong window :-)16:12
*** jawad_axd has joined #openstack-nova16:25
*** k_mouza has joined #openstack-nova16:29
*** ttsiouts has joined #openstack-nova16:29
openstackgerritsean mooney proposed openstack/nova stable/train: Silence amqp heartbeat warning  https://review.opendev.org/72805716:31
k_mouzagood afternoon all! quick question please. I have a plain and simple openstack stein environment and I'm integrating a Ceph cluster with it. Is there a clean way of moving all the existing VMs (that reside on the hypervisors' local disks) to Ceph? I've tried draining a single hypervisor, configuring it to use Ceph, but then the migration of VMs to it fails because it can't find that VM's disk (it's expecting it in Ceph already I think).16:32
k_mouzaI could snapshot everything and re-spin it up of course, but was wondering if there's anything faster than that. Thanks a lot! :)16:32
sean-k-mooneyk_mouza: are you trying to change the image backend16:33
sean-k-mooneye.g. form flat/qcow to rbd16:34
*** ttsiouts has quit IRC16:34
sean-k-mooneyi dont thik we support migration between hosts with different image backends at least i dont think we test it if we do16:35
*** yaawang_ has quit IRC16:35
sean-k-mooneyk_mouza: shelve and unshelve might be one way to do it but i have never tried that16:36
sean-k-mooneyk_mouza: the nova irc meeting is happeing right now so maybe someoen else will have a suggestion when that is over16:37
*** ociuhandu_ has joined #openstack-nova16:38
josephillipshey sean-k-mooney do you know if is posible change the HW property created by a image on a running vm?16:39
*** ociuhandu has quit IRC16:41
k_mouzasean-k-mooney: hmm, no, I haven't changed the image backend of the running VM. I will try shelving the VM before migrating it as well to see if that helps.16:44
*** gyee has joined #openstack-nova16:46
*** dtantsur is now known as dtantsur|afk16:48
*** ociuhandu_ has quit IRC16:48
k_mouzasean-k-mooney: shelving  and then un-shelving the VM did the trick! It picked the 2nd hypervisor and created the image in Ceph without issues. Thanks a lot for the tip!16:49
k_mouzaNow in order to control which hypervisor it's unshelved to, will need to disable and enable the corresponding nova-compute services?16:50
sean-k-mooneyjosephillips: only via a rebuild currently16:51
josephillipsrebuild wil destroy the data?16:52
josephillipsor change mac address?16:52
sean-k-mooneyjosephillips: i have been suggesting we should add a new api action to allow recreating a vm preseving its disk and other resouces but updating the flavor and image metadata16:52
sean-k-mooneyjosephillips: it wont change mac16:52
sean-k-mooneyit will destroy the root disk16:52
sean-k-mooneyand i dont think its supported for boot form volume16:52
*** ociuhandu has joined #openstack-nova16:53
sean-k-mooneyjosephillips: if you cant use rebuild today you have to do a db edit and then hard reboot16:53
*** udesale has quit IRC16:53
josephillipsis what i belive that modifying novadb16:53
sean-k-mooneyk_mouza: i meant on the host but glad shelviing worked16:53
josephillipswill be the remedy16:53
sean-k-mooneyjosephillips: what are you trying to change out of interest?16:54
sean-k-mooneyif i end up propsoinbg a spec for the recreate action i might include it as a use case16:54
josephillipsok hw_disk_bus=scsi16:54
josephillipsworks well fro new deployments16:54
josephillipsfor new deployment16:54
sean-k-mooneyah ok provided you are using disk lables or uuids to mount your files systems in fstabls changin the buss should be fine16:55
sean-k-mooneyif its a windows guest it might be unhappy16:55
josephillipsyeah i know16:55
*** yaawang_ has joined #openstack-nova16:55
josephillipsprobably should be need to replace grub.conf16:55
josephillipsbut is a change that we already know we have todo16:55
sean-k-mooneynormally grub.conf usses uuids by default16:56
sean-k-mooneyso it should be ok16:56
josephillipsjust we need replace for the running instances16:56
sean-k-mooneywe stoped using /dev/sd* names quite a whgile a go in grub by default16:56
josephillipsyeah but these cloud still have /dev/s..16:57
josephillipslol16:57
josephillipsso this hw metadata should be in novadb right16:57
*** jawad_axd has quit IRC16:57
*** ociuhandu has quit IRC16:58
sean-k-mooneyjosephillips: ya its the instance_system_metadata table i think17:00
sean-k-mooneyin the cell db17:00
*** derekh has quit IRC17:00
sean-k-mooneyi think you prefix the metadata key wiht img_ or iamge_17:00
*** akhil-g has joined #openstack-nova17:01
sean-k-mooneybasicaly that is where we store the cache copy of the iamge metadata17:01
gibisean-k-mooney: I have to leave now but if akhil-g joins then from my perspective it is OK to add a service up check in the rebuild codepath17:01
*** harsha24 has joined #openstack-nova17:01
sean-k-mooneygibi: ya i was thinking the same17:01
gibicool17:01
gibiI will not it in the bug tomorrow if nothing else happnes during my night17:01
gibiI will note it17:01
sean-k-mooneyby the way i jsut want to highligh this downstream bug for people interested in libvirt https://bugzilla.redhat.com/show_bug.cgi?id=184792417:02
openstackbugzilla.redhat.com bug 1847924 in openstack-nova "[SRIOV - Cold Migration] some issues after a server with a VF port is migrated" [High,New] - Assigned to smooney17:02
*** xek has quit IRC17:02
sean-k-mooneywe have a issue with how libvirt report data related to deivces and how its caching works17:02
sean-k-mooneyi will file an upstream bug for this17:02
*** ttsiouts has joined #openstack-nova17:03
sean-k-mooneybut while i think its an libvirt issue i think we also should work around it in nova until libvirt can be fixed17:03
sean-k-mooneyso if people see error message like "ibvirt.libvirtError: Node device not found: no node device with matching name 'net_enp7s0f3v1_ea_60_77_1f_21_50'"17:04
sean-k-mooneyin the nova compute log its this issue17:04
sean-k-mooneyharsha24: so there is not really a concept of an admin project17:08
sean-k-mooneywe can create a projet in keysonte and call it admin but htat does not change the permission in any way as far as i know17:09
sean-k-mooneythe roles/permmision are assoicated with the user not the porject17:10
sean-k-mooneyso the discription of https://bugs.launchpad.net/nova/+bug/1854053 is not clear17:10
openstackLaunchpad bug 1854053 in OpenStack Compute (nova) "_add_tenant_access silently ignores 403" [Undecided,In progress] - Assigned to Harshavardhan Metla (harsha24)17:10
harsha24so is the bug invalid17:10
sean-k-mooneyif you give a user the the admin role they shoudl be able to add teh project to a private flavor in my view and then other user in the prorject with "member" but not "admin" should be able to use it17:11
sean-k-mooneyso i think that bug is invaild yes17:12
sean-k-mooneymriedem: traiged it however so i guess he taught it was valid i need to read the irclogs to see why as the context is not directly in the bug17:13
sean-k-mooneyharsha24: ^17:13
sean-k-mooneyharsha24: im sure he had a good reason to make it traiged and therefor valid17:13
*** nightmare_unreal has quit IRC17:14
sean-k-mooneyok so this i a more subtel bug then it seams looking at http://eavesdrop.openstack.org/irclogs/%23openstack-nova/%23openstack-nova.2019-11-26.log.html#t2019-11-26T16:20:2417:15
harsha24I have gone through that irclogs and i have changed the code part which returns true in https://review.opendev.org/#/c/735068/17:16
sean-k-mooneyyou mean which raises failure17:16
harsha24yeah17:16
sean-k-mooneyyou did not update the comment by the way17:16
sean-k-mooneyyou are not defaulting to "it's ok" anymore you are raising a failure17:17
*** mgoddard has quit IRC17:18
*** k_mouza has quit IRC17:18
harsha24how to get pass the zuul code review17:19
sean-k-mooneyharsha24: are you asking how to get teh code merged17:20
sean-k-mooneyharsha24: if so then you need to get peopel to be interested and review the patch17:20
sean-k-mooneyan alternitive way to do this would be for nova to use its admin permisison to check if the porject exits in this case17:21
sean-k-mooneyim trying to see if that was discussed and discarded before17:21
harsha24sean-k-mooney you did not update the comment by the way17:22
harsha24which comment are you mentioning here17:22
stephenfingmann would be a good person to review that patch also17:22
sean-k-mooneyharsha24:  https://review.opendev.org/#/c/735068/3/nova/api/openstack/identity.py17:22
sean-k-mooneyharsha24: i left a comment on the code review17:23
harsha24is it ok with the failures in zuul pipeline checks17:23
*** mgoddard has joined #openstack-nova17:23
sean-k-mooneyharsha24: you have unit test failure you need to update nova.tests.unit.test_identity.IdentityValidationTest.test_unknown_id17:24
sean-k-mooneyfor the new behavior17:24
sean-k-mooneyso the py36 and py38 failures are correct17:24
sean-k-mooneyits the same issue for lower constratins and cover job17:25
harsha24where do I need to update the test case17:25
sean-k-mooneythe grenade job failure are likely not related to your change17:25
harsha24okay17:25
sean-k-mooneyhere https://github.com/openstack/nova/blob/master/nova/tests/unit/test_identity.py#L85-L9417:26
gmannstephenfin: ack, will do after rbac meeting17:26
sean-k-mooneyharsha24: you need to replace the self.assertTrue( with self.assertRaises like the test_no_project one above it17:26
harsha24ok got it Thank you17:27
harsha24can you review this too https://review.opendev.org/#/c/737215/17:28
*** martinkennelly has quit IRC17:29
sean-k-mooneyharsha24: i added stephenfin to https://review.opendev.org/#/c/737215/1 ill take a look. moving it out of the rdo section into a common section seams resonable but i have not looked to see if we shoudl cross freference it in the old section or not and if its correct in context17:32
sean-k-mooneyharsha24: so i wont review it fully now but ill review later17:33
harsha24okay17:33
sean-k-mooneyim not realy shure how that closes https://bugs.launchpad.net/nova/+bug/170099917:34
openstackLaunchpad bug 1700999 in OpenStack Compute (nova) "during nova service install ,an unneeded httpd conf bug fix causes openstack client cli crash" [High,In progress] - Assigned to Harshavardhan Metla (harsha24)17:34
sean-k-mooneyalthough i see that is what was suggesed in the bug17:34
harsha24this bug is actually caused by a bug fix of another bug17:35
sean-k-mooneywe dont often run true the manual install process so those guids can get out of data pretty quickly17:35
*** ttsiouts has quit IRC17:35
harsha24So, does this makes the bug invalid and the doc is pretty old ocata release17:36
sean-k-mooneynot nessisarly your updating the master doc17:37
sean-k-mooneynot the ocata one for what its worth17:37
sean-k-mooneybut its been at least 6 years since i manually did an openstack in stall so i can more or less tell you that the install guides are not hevilly tested so its not uncommon for them to be outdated and have bugs like this17:38
harsha24okay17:40
*** links has quit IRC17:41
mnasiadkaHi there17:57
mnasiadkaIs there any reason or known bug that nova-compute logs are stuck on "Creating image" while spawning instance? (Train)17:57
*** tesseract has quit IRC18:01
*** k_mouza has joined #openstack-nova18:07
*** jsuchome has quit IRC18:09
*** jmlowe has quit IRC18:11
*** harsha24 has quit IRC18:13
*** akhil-g has quit IRC18:15
*** spatel has joined #openstack-nova18:16
openstackgerritHarshavardhan Metla proposed openstack/nova master: moved the quoted section  https://review.opendev.org/73808118:19
*** jmlowe has joined #openstack-nova18:21
*** markvoelker has joined #openstack-nova18:21
*** markvoelker has quit IRC18:26
openstackgerritHarshavardhan Metla proposed openstack/nova master: Raising a failure in case of 403  https://review.opendev.org/73506818:29
*** k_mouza has quit IRC18:36
*** jawad_axd has joined #openstack-nova18:41
*** ttsiouts has joined #openstack-nova18:41
sean-k-mooneymnasiadka: kindof18:43
sean-k-mooneymnasiadka: https://bugs.launchpad.net/nova/+bug/1874032 https://review.opendev.org/#/c/734776/618:44
openstackLaunchpad bug 1874032 in OpenStack Compute (nova) "nova-compute become stuck when doing IO on busy file system" [Wishlist,In progress] - Assigned to Alexandre arents (aarents)18:44
sean-k-mooneymnasiadka: so if you are hitting ^ aarents almost has the fix ready18:45
mnasiadkasean-k-mooney: rather not the case, the disk is not i/o busy18:45
sean-k-mooneyin that case no im not aware of a bug where nova hangs on taking a snapshot18:45
mnasiadkaIt’s spawning a new vm, not a snapshot... then let me try to do some tracing what is it stuck on...18:46
sean-k-mooneyoh "openstack server create image" is how you create a snapshot sorry18:47
sean-k-mooneymnasiadka: so its hangin on actully creating the image on disk are you sueing the default qcow/flat image backend18:47
sean-k-mooneymnasiadka: i assume its not this https://bugs.launchpad.net/nova/+bug/188082818:49
openstackLaunchpad bug 1880828 in OpenStack Bundles "New instance is always in "spawning" status" [Undecided,New]18:49
*** raildo has quit IRC18:51
*** raildo has joined #openstack-nova18:51
mnasiadkasean-k-mooney: in my case it looks like it’s stuck on downloading image, because there’s only disk.info file and no image fragments anywhere18:53
*** eharney has quit IRC18:57
sean-k-mooneygibi: does my last comment #3 on https://bugs.launchpad.net/nova/+bug/1884068 make sense to you? i think we shoudl close that as nto a bug18:58
openstackLaunchpad bug 1884068 in OpenStack Compute (nova) "Instance stuck in build state when some/one compute node is unreachable" [Undecided,New]18:58
sean-k-mooneymnasiadka: it would be good to check the glance log then18:59
sean-k-mooneyand see if it handeled the requiest properly?18:59
*** ttsiouts has quit IRC19:15
*** jawad_axd has quit IRC19:15
*** markvoelker has joined #openstack-nova19:29
*** efried has quit IRC19:32
*** markvoelker has quit IRC19:34
*** efried has joined #openstack-nova19:45
*** ralonsoh has quit IRC19:45
*** bbowen_ has quit IRC19:47
*** ttsiouts has joined #openstack-nova19:49
*** ttsiouts has quit IRC19:54
*** josephillips has quit IRC19:55
*** ttsiouts has joined #openstack-nova19:57
mnasiadkasean-k-mooney: glance says it did, but I don’t trust it ;)20:00
*** dave-mccowan has quit IRC20:01
*** ttsiouts has quit IRC20:01
*** dave-mccowan has joined #openstack-nova20:05
*** efried has quit IRC20:15
*** efried has joined #openstack-nova20:24
*** jawad_axd has joined #openstack-nova20:32
*** ttsiouts has joined #openstack-nova20:33
*** arjunbaindur has quit IRC20:40
*** maciejjozefczyk has quit IRC20:42
*** nweinber has quit IRC20:46
*** markvoelker has joined #openstack-nova20:48
*** icarusfactor has joined #openstack-nova20:50
*** factor has quit IRC20:52
*** markvoelker has quit IRC20:53
*** jawad_axd has quit IRC21:06
*** bbowen_ has joined #openstack-nova21:06
*** ttsiouts has quit IRC21:06
mnaserhmm21:07
mnaserhttps://github.com/openstack/nova/blob/master/nova/scheduler/client/report.py#L1893 and https://github.com/openstack/nova/blob/master/nova/scheduler/client/report.py#L1941 and https://github.com/openstack/nova/blob/master/nova/scheduler/client/report.py#L1612 and https://github.com/openstack/nova/blob/master/nova/scheduler/client/report.py#L1744 all bomb out prettty hard if placement isn't available21:08
mnaserbecause json() fails to decode json content and it blows up in very bad ways21:08
mnaserdoes anyone know if there's a way of checking if the content is json first?21:10
mnaseri could try/except but eh21:11
*** raildo has quit IRC21:21
*** slaweq has quit IRC21:24
*** spatel has quit IRC21:26
*** slaweq has joined #openstack-nova21:31
*** slaweq has quit IRC21:35
dansmithmnaser: content-type?21:49
dansmithbut try..except around the .json is the python way21:50
mriedemseems like that would be a lot of moles to whack over time, i'm assuming you're getting html back? also, isn't there a retries wrapper on that?22:04
mriedemtwould be way down in ksa if there is22:05
*** ttsiouts has joined #openstack-nova22:09
dansmithI was just assuming that was coming straight from requests22:09
mriedemelse yeah you can check the response headers https://requests.readthedocs.io/en/master/user/quickstart/#response-headers22:09
dansmithbut yeah, looks like lots of assuming success there22:09
mriedem`r.headers.get('content-type')`22:09
mriedemi think our stuff uses ksa which wraps requests way down in the bowels22:09
dansmithack22:10
mriedemand i'm assuming there is a urllib3 Retry wrapper in the mix22:10
mriedemif retries timeout you get a different error, but i've also seen the weirdness where you get back like a 302 with html content assuming `if r:` (truthy) and then blow on on `r.json()`22:10
*** jmlowe has quit IRC22:22
*** jawad_axd has joined #openstack-nova22:24
*** mriedem has left #openstack-nova22:24
*** jmlowe has joined #openstack-nova22:25
*** tosky has quit IRC22:40
*** ttsiouts has quit IRC22:42
*** luksky has quit IRC22:50
*** jawad_axd has quit IRC22:56
*** mlavalle has quit IRC22:58
*** ttsiouts has joined #openstack-nova23:11
*** markvoelker has joined #openstack-nova23:15
*** ttsiouts has quit IRC23:15
*** markvoelker has quit IRC23:20
openstackgerritMerged openstack/nova master: Plumb image import functionality through our glance module  https://review.opendev.org/73155023:23
*** rchurch has quit IRC23:43
*** rchurch has joined #openstack-nova23:43
*** ttsiouts has joined #openstack-nova23:44
*** gyee has quit IRC23:59

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!