Tuesday, 2019-05-28

openstackgerritsean mooney proposed openstack/nova master: extend libvirt video model support  https://review.opendev.org/64773300:03
*** macza has quit IRC00:03
*** rcernin has quit IRC00:17
*** rcernin has joined #openstack-nova00:18
*** rcernin has quit IRC00:49
*** rcernin has joined #openstack-nova00:50
*** markvoelker has quit IRC01:05
*** whoami-rajat has joined #openstack-nova01:06
*** hongbin has joined #openstack-nova01:10
*** ricolin has joined #openstack-nova01:13
openstackgerritTakashi NATSUME proposed openstack/nova master: Remove mox in unit/network/test_neutronv2.py (14)  https://review.opendev.org/57602701:14
openstackgerritTakashi NATSUME proposed openstack/nova master: Remove mox in unit/network/test_neutronv2.py (15)  https://review.opendev.org/57603101:14
openstackgerritTakashi NATSUME proposed openstack/nova master: Remove mox in unit/network/test_neutronv2.py (16)  https://review.opendev.org/57629901:15
openstackgerritTakashi NATSUME proposed openstack/nova master: Remove mox in unit/network/test_neutronv2.py (17)  https://review.opendev.org/57634401:15
openstackgerritTakashi NATSUME proposed openstack/nova master: Remove mox in unit/network/test_neutronv2.py (18)  https://review.opendev.org/57667301:16
openstackgerritTakashi NATSUME proposed openstack/nova master: Remove mox in unit/network/test_neutronv2.py (19)  https://review.opendev.org/57667601:16
openstackgerritTakashi NATSUME proposed openstack/nova master: Remove mox in unit/network/test_neutronv2.py (20)  https://review.opendev.org/57668901:21
openstackgerritTakashi NATSUME proposed openstack/nova master: Remove mox in unit/network/test_neutronv2.py (21)  https://review.opendev.org/57670901:22
openstackgerritTakashi NATSUME proposed openstack/nova master: Remove mox in unit/network/test_neutronv2.py (22)  https://review.opendev.org/57671201:22
openstackgerritTakashi NATSUME proposed openstack/nova master: Fix cleaning up console tokens  https://review.opendev.org/63771601:23
openstackgerritTakashi NATSUME proposed openstack/nova master: Remove mox in virt/test_block_device.py  https://review.opendev.org/56615301:23
*** BjoernT has quit IRC01:24
openstackgerritTakashi NATSUME proposed openstack/python-novaclient master: Fix a description for config_drive parameter  https://review.opendev.org/65368301:26
openstackgerritTakashi NATSUME proposed openstack/nova master: Add a live migration regression test  https://review.opendev.org/64120001:26
*** guozijn has joined #openstack-nova01:44
*** BjoernT has joined #openstack-nova01:51
openstackgerritguangchao.pan proposed openstack/nova stable/ocata: OpenDev Migration Patch  https://review.opendev.org/66166201:56
*** tbachman has joined #openstack-nova01:57
openstackgerritguangchao.pan proposed openstack/nova master: Add a name for the automatically created volume  https://review.opendev.org/66009602:11
*** Spencer_Yu has joined #openstack-nova02:15
*** udesale has quit IRC02:15
openstackgerritArtom Lifshitz proposed openstack/nova master: [WIP] Revert resize: wait for events according to hybrid plug  https://review.opendev.org/64488102:27
openstackgerritArtom Lifshitz proposed openstack/nova master: Run revert resize tests in nova-live-migration  https://review.opendev.org/65349802:27
openstackgerritArtom Lifshitz proposed openstack/nova master: [DNM] use iptables in nova-multinode  https://review.opendev.org/66078202:27
*** gmann has quit IRC02:31
*** takashin has left #openstack-nova02:32
*** cfriesen has quit IRC02:42
*** _alastor_ has joined #openstack-nova02:43
*** _alastor_ has quit IRC02:47
*** hoonetorg has quit IRC02:56
*** markvoelker has joined #openstack-nova03:06
openstackgerritSeyeong Kim proposed openstack/nova stable/queens: Share snapshot image membership with instance owner  https://review.opendev.org/66166703:10
*** hoonetorg has joined #openstack-nova03:13
*** jamesdenton has quit IRC03:20
*** licanwei has joined #openstack-nova03:21
*** psachin has joined #openstack-nova03:21
*** markvoelker has quit IRC03:40
*** tbachman has quit IRC03:45
*** tbachman has joined #openstack-nova03:50
*** abhishekk has joined #openstack-nova04:09
*** ileixe has quit IRC04:09
*** ileixe has joined #openstack-nova04:11
*** ratailor has joined #openstack-nova04:19
*** imacdonn has quit IRC04:20
*** imacdonn has joined #openstack-nova04:21
*** pcaruana has joined #openstack-nova04:22
*** ykarel|afk has joined #openstack-nova04:31
*** ivve has quit IRC04:32
*** markvoelker has joined #openstack-nova04:37
*** psachin has quit IRC04:39
*** psachin has joined #openstack-nova04:40
Spencer_Yuhttps://bugs.launchpad.net/nova/+bug/183066904:40
openstackLaunchpad bug 1830669 in OpenStack Compute (nova) "Telemetry service can not get right "operator" of nova resources from notification" [Undecided,New]04:40
*** hongbin has quit IRC04:49
*** janki has joined #openstack-nova04:51
*** ykarel|afk is now known as ykarel05:10
*** markvoelker has quit IRC05:10
*** ykarel_ has joined #openstack-nova05:13
*** ykarel has quit IRC05:15
*** ykarel__ has joined #openstack-nova05:16
*** ykarel_ has quit IRC05:19
*** jchhatbar has joined #openstack-nova05:27
*** janki has quit IRC05:30
*** ileixe has quit IRC05:33
*** ivve has joined #openstack-nova05:38
*** BjoernT has quit IRC05:40
*** cfriesen has joined #openstack-nova05:40
*** sridharg has joined #openstack-nova05:43
*** lpetrut has joined #openstack-nova06:01
*** guozijn has quit IRC06:03
*** guozijn has joined #openstack-nova06:04
*** abhishekk has quit IRC06:06
*** markvoelker has joined #openstack-nova06:07
openstackgerritzhaixiaojun proposed openstack/nova master: Blacklist python-cinderclient 4.0.0  https://review.opendev.org/66157806:10
*** ykarel__ is now known as ykarel|afk06:14
*** Spencer_Yu has quit IRC06:15
*** ccamacho has joined #openstack-nova06:18
*** sridharg has quit IRC06:20
*** slaweq has joined #openstack-nova06:22
*** Spencer_Yu has joined #openstack-nova06:25
*** tetsuro has joined #openstack-nova06:25
*** Spencer_Yu has quit IRC06:30
*** dpawlik has joined #openstack-nova06:32
*** sridharg has joined #openstack-nova06:35
*** sridharg has quit IRC06:37
openstackgerritGuo Jingyu proposed openstack/nova master: Define and catch QemuGuestAgentNotRunning for set-password failure  https://review.opendev.org/66146606:38
*** markvoelker has quit IRC06:40
*** Spencer_Yu has joined #openstack-nova06:44
*** macza has joined #openstack-nova06:45
*** Spencer_Yu has quit IRC06:48
*** macza has quit IRC06:50
*** cfriesen has quit IRC06:50
*** ykarel|afk is now known as ykarel06:55
*** maciejjozefczyk has joined #openstack-nova06:57
*** Spencer_Yu has joined #openstack-nova06:57
openstackgerritGuo Jingyu proposed openstack/nova master: Define and catch QemuGuestAgentNotRunning for set-password failure  https://review.opendev.org/66146606:58
*** rpittau|afk is now known as rpittau07:02
*** awalende has joined #openstack-nova07:04
*** takamatsu has joined #openstack-nova07:07
*** tetsuro has quit IRC07:09
*** yikun has joined #openstack-nova07:09
*** jhesketh has quit IRC07:11
*** ricolin_ has joined #openstack-nova07:12
*** tesseract has joined #openstack-nova07:12
*** takamatsu has quit IRC07:13
*** ricolin has quit IRC07:15
*** jhesketh has joined #openstack-nova07:29
*** helenafm has joined #openstack-nova07:29
*** logan- has quit IRC07:33
*** logan- has joined #openstack-nova07:36
*** markvoelker has joined #openstack-nova07:37
openstackgerritAdrian Chiris proposed openstack/nova stable/stein: Allow driver to properly unplug VIFs on destination on confirm resize  https://review.opendev.org/66149507:39
*** xek_ has joined #openstack-nova07:48
openstackgerritAdrian Chiris proposed openstack/nova stable/rocky: Move get_pci_mapping_for_migration to MigrationContext  https://review.opendev.org/66149907:49
openstackgerritAdrian Chiris proposed openstack/nova stable/rocky: Allow driver to properly unplug VIFs on destination on confirm resize  https://review.opendev.org/66150007:49
*** tetsuro has joined #openstack-nova07:51
kashyapsean-k-mooney: I first checked in this channel where to put that doc, and was suggested the reference guide (doc/source/reference).07:57
gibiSpencer_Yu: replied in https://bugs.launchpad.net/nova/+bug/183066907:58
openstackLaunchpad bug 1830669 in OpenStack Compute (nova) "Telemetry service can not get right "operator" of nova resources from notification" [Undecided,New]07:58
*** ykarel is now known as ykarel|lunch08:00
kashyapsean-k-mooney: I think it actually belongs to the nova/doc/source/admin08:07
*** markvoelker has quit IRC08:10
*** gmann has joined #openstack-nova08:13
openstackgerritBalazs Gibizer proposed openstack/nova master: Prepare _heal_allocations_for_instance for nested allocations  https://review.opendev.org/63795408:13
openstackgerritBalazs Gibizer proposed openstack/nova master: pull out put_allocation call from _heal_*  https://review.opendev.org/65545908:13
openstackgerritBalazs Gibizer proposed openstack/nova master: nova-manage: heal port allocations  https://review.opendev.org/63795508:13
*** yan0s has joined #openstack-nova08:20
openstackgerritRodolfo Alonso Hernandez proposed openstack/os-vif stable/rocky: Prevent "qbr" Linux Bridge from replying to ARP messages  https://review.opendev.org/65569208:22
openstackgerritRodolfo Alonso Hernandez proposed openstack/os-vif stable/queens: Prevent "qbr" Linux Bridge from replying to ARP messages  https://review.opendev.org/65569408:23
*** awalende_ has joined #openstack-nova08:25
*** ralonsoh has joined #openstack-nova08:26
*** awalende has quit IRC08:29
openstackgerritKashyap Chamarthy proposed openstack/nova master: Document mitigation for Intel MDS security flaws  https://review.opendev.org/66157408:29
*** awalende_ has quit IRC08:30
*** tetsuro has quit IRC08:38
*** mgoddard has joined #openstack-nova08:41
mrch_this is funny, when you start an instance on a 100GB volume, fill it with >DATA< importatnt, its saved in ceph in raw, when you create a snapshot(in incance menu not volume) nova creates a 0Byte QCOW2 image snapshot and a volume snapshot (2x wtf?!), start instance from image snapshot and /var/lib/cinder/conversion/volume-XXXX will eat up your apinode root disk, thats dogsht isnt it? following is kind of decribing it, but volume to image08:47
mrch_is fixed already in rocky, vm on volume to image not, it produces raw: https://bugzilla.redhat.com/show_bug.cgi?id=1677054 Has anyone touched nova.conf qcow parameter and validated it:https://docs.openstack.org/nova/rocky/configuration/config.html08:47
openstackbugzilla.redhat.com bug 1677054 in openstack-glance "[osp 13]Creating images from cinder volumes with ceph backend is very inefficient" [Medium,New] - Assigned to cyril08:47
*** frankwang has joined #openstack-nova08:52
*** derekh has joined #openstack-nova08:52
*** sapd1_x has joined #openstack-nova08:53
*** tetsuro has joined #openstack-nova08:57
*** priteau has joined #openstack-nova08:58
ralonsohstephenfin, hi. How should I proceed here? https://github.com/openstack/os-vif/blob/stable/queens/tox.ini09:00
ralonsohstephenfin, in Queens there is no CONSTRAINTS_OPT=-c {env:UPPER_CONSTRAINTS_FILE:https://git.openstack.org/cgit/openstack/requirements/plain/upper-constraints.txt?h=stable/rocky}09:00
ralonsohstephenfin, and https://review.opendev.org/#/c/655694/ is failing because of sphinx09:01
ralonsohstephenfin, actually, in Queens, requirements doesn't have https://github.com/openstack/requirements/blob/master/upper-constraints.txt#L43109:02
*** markvoelker has joined #openstack-nova09:07
*** sapd1_x has quit IRC09:10
sean-k-mooneyralonsoh: stephenfin is at the cern openstackday09:10
ralonsohsean-k-mooney, hahaha now I remember09:10
sean-k-mooneyralonsoh: are you not currently backporting that09:10
sean-k-mooneythe upper constratits09:10
ralonsohsean-k-mooney, no, I shouldn't because is useless09:11
sean-k-mooneyno its not09:11
ralonsohsean-k-mooney, I can't use queens/requirements because sphinx is not limited in this version09:11
sean-k-mooneywhy would the upper-constratints be useless09:11
sean-k-mooneythen you need to update the requirements repo to limit it09:12
ralonsohsean-k-mooney, OK, and then submit a patch only for queens/os-vif to include it09:12
ralonsohsean-k-mooney, is that correct?09:12
*** tkajinam has quit IRC09:13
sean-k-mooneyya so cap sphix in the requrement repo for stable queens and then backport https://github.com/openstack/os-vif/commit/96b5a11d35d74faf7c9866dceef66984dbcddae609:14
sean-k-mooneyactully i can go start backporting ^09:14
sean-k-mooneywell if you dont get to it today09:14
sean-k-mooneyi need to go do something first but we shoudl not be capping locally in os-vif09:15
sean-k-mooneyralonsoh: actully sphinx is already capped in queens09:16
sean-k-mooneyhttps://github.com/openstack/requirements/blob/stable/queens/upper-constraints.txt#L36509:16
sean-k-mooneyos-vif just need to use the constratis file09:16
ralonsohsean-k-mooney, that's right09:16
ralonsohsean-k-mooney, I don't need to modify requirements09:16
sean-k-mooneyright just backport that patch09:16
ralonsohsean-k-mooney, I'll submit a patch for os-vif today modifying tox.ini09:16
sean-k-mooneyi whould have done that when i wrote it09:17
ralonsohsean-k-mooney, thanks!09:17
sean-k-mooneycan you submit it to all active stable brances09:17
*** boxiang has joined #openstack-nova09:17
ralonsohsean-k-mooney, hahahaha09:18
ralonsohsean-k-mooney, https://review.opendev.org/#/c/658780/09:18
sean-k-mooneyright i had tought you had done this already09:18
mrch_anyone tapped into ^10:4709:18
ralonsohsean-k-mooney, my short memory09:18
*** minmin has joined #openstack-nova09:18
*** jchhatba_ has joined #openstack-nova09:18
sean-k-mooneyralonsoh: it looks like you did not rebase ontop of the constratists fix when you updated https://review.opendev.org/#/c/655694/709:20
ralonsohsean-k-mooney, you are right09:21
openstackgerritRodolfo Alonso Hernandez proposed openstack/os-vif stable/queens: Prevent "qbr" Linux Bridge from replying to ARP messages  https://review.opendev.org/65569409:21
*** jchhatbar has quit IRC09:21
*** aarents__ has joined #openstack-nova09:23
openstackgerritBalazs Gibizer proposed openstack/os-traits master: Add REPORT_PARENT_INTERFACE_NAME_FOR_SRIOV_NIC trait  https://review.opendev.org/65885209:25
gibilyarwood: hi! I've replied in https://review.opendev.org/#/c/512553/12//COMMIT_MSG@12 If we could agree with the way forward then I can redo the patch series09:30
lyarwoodgibi: ack thanks, I'll check shortly09:31
*** ykarel|lunch is now known as ykarel09:33
kashyaplyarwood: Do you also have an opinion on the question I asked in the commit message: https://review.opendev.org/#/c/661574/ ("Document mitigation for Intel MDS security flaws")09:34
kashyap(Thanks for the review, BTW)09:34
lyarwoodkashyap: replied, lets open another review for the meltdown doc if you already have something written.09:39
kashyaplyarwood: Yeah, it would be another change indeed.  Just wanted to make sure if we _want_ to do it or not.09:39
*** markvoelker has quit IRC09:40
lyarwoodkashyap: I can't think why we wouldn't if you already have some text etc09:40
lyarwoodgibi: replied, I'd be happy with that approach.09:41
kashyaplyarwood: Heh, yeah.  (The text has been sitting there for a while)09:41
gibilyarwood: thanks. I will re-shuffle the changes accordingly09:43
*** jcosmao has joined #openstack-nova09:48
*** sapd1_x has joined #openstack-nova09:54
*** ricolin_ has quit IRC10:02
*** dpawlik has quit IRC10:06
*** cdent has joined #openstack-nova10:07
*** dpawlik has joined #openstack-nova10:18
*** frankwang has quit IRC10:19
*** aarents__ has quit IRC10:22
*** dpawlik has quit IRC10:22
*** tetsuro has quit IRC10:26
*** dpawlik has joined #openstack-nova10:35
*** markvoelker has joined #openstack-nova10:37
*** dpawlik has quit IRC10:40
*** jaypipes has joined #openstack-nova10:42
*** tbachman has quit IRC10:42
*** guozijn has quit IRC10:43
*** bbowen has quit IRC10:43
*** k4bi has quit IRC10:44
*** jaypipes has quit IRC10:46
*** odyssey4me has left #openstack-nova10:49
*** awalende has joined #openstack-nova10:52
*** jaypipes has joined #openstack-nova10:58
*** dpawlik has joined #openstack-nova11:02
*** sridharg has joined #openstack-nova11:06
*** markvoelker has quit IRC11:11
*** dave-mccowan has joined #openstack-nova11:13
*** psachin has quit IRC11:14
*** guozijn has joined #openstack-nova11:16
*** ttsiouts has joined #openstack-nova11:33
*** ratailor has quit IRC11:35
*** ttsiouts has quit IRC11:38
*** macza has joined #openstack-nova11:39
*** Spencer_Yu has quit IRC11:40
*** macza has quit IRC11:43
*** psachin has joined #openstack-nova11:57
*** bbowen has joined #openstack-nova11:58
*** aarents has joined #openstack-nova12:00
*** markvoelker has joined #openstack-nova12:06
*** tbachman has joined #openstack-nova12:07
*** lbragstad has joined #openstack-nova12:09
*** guozijn_ has joined #openstack-nova12:12
*** priteau has quit IRC12:13
*** priteau has joined #openstack-nova12:14
*** guozijn has quit IRC12:15
*** guozijn_ is now known as guozijn12:15
*** cmart has joined #openstack-nova12:26
*** _erlon_ has joined #openstack-nova12:26
*** derekh has quit IRC12:27
*** chason has joined #openstack-nova12:31
openstackgerritMerged openstack/nova stable/stein: [stable-only] Improve the reno for consoleauth upgrade check  https://review.opendev.org/66112312:33
artomcdent, you know, you'd think with an extensive portfolio of NFV customer who use NUMA but seldom participate upstream, you'd think RH would have a way of asking them en masse about their preferred use cases12:35
cdentone would hope so, but it seems hard for everyone, not just RH12:36
*** boxiang has quit IRC12:36
*** boxiang has joined #openstack-nova12:37
artomcdent, well, with the "upstream" operators, we can just send off a thing to the mailing list. It's not perfect, but it's a start12:37
artomTo my knowledge, no such mechanism exists for our customers12:37
sean-k-mooney we try to infer that based on the bugs that get reported but ya we dotn really have a good way of doing it12:37
cdentone gets the impression that the number of operators actively engaged with email is ... limited12:38
sean-k-mooneythere is proably some marketing list that you can opt in to get survays and such but i doubt that apporch would get much feedback12:39
artomI suspect the majority of operators are paying customers12:39
artomSo they expect their provider to do that work for them12:39
cdentI'm worried in this instance that we are solving a real/legit problem in the wrong place, but I have nothing other than "feelings" to support that12:40
artomAs we all12:41
cdentand I certainly don't have any internal customer stuff to support any of that: we continue to not expose any numa details12:41
sean-k-mooneywas tehre a partical thing that propted this topic?12:41
artomAnd I suspect this isn't the first or last occurence of such problem solving12:41
artomsean-k-mooney, https://review.opendev.org/#/c/658510/12:41
cdentsean-k-mooney: we're taling about can_split12:41
sean-k-mooneyof declaring that a resouce class can come form multiple rps for numa an dsuch12:41
cdentsean-k-mooney: I'm trying to make sure that we are solving for the real problem, rather than what is possible.12:42
cdentthere's lots of useful interaction on the spec, please join in if you've got thoughts12:42
artomWe do have a thing that analyses sosreports (our "all the things" automated log reporting tool for bugs)12:43
sean-k-mooneyill try too but it will be a while12:43
sean-k-mooneye.g later today/tomorrow12:43
artomWe could try to pull hardware/workload info out of that12:43
sean-k-mooneyim currentlytrying to find a downstream bug fix12:43
cdenti'm feeling a bit "sure we _can_ split, but do we want to?"12:43
artomThere's selection bias for those who actually report logs, but it's a start12:43
*** donnyd has joined #openstack-nova12:43
artomDon't think we could get instance to host mapping info out of it, though12:44
artom*report bugs12:44
sean-k-mooneycdent: the only use case i have for can split i think is when i ask for more cpu then might resonable fit on one numa node so i say you can split that if that is required12:44
sean-k-mooneybut that only really makes sese for non numa guests12:44
sean-k-mooney*sense12:45
artomWell that was the main driver IIUC - fitting non-NUMA guests on NUMA host when every host is presenting itself as a tree12:45
artomAnyways, need to drive kids to daycare12:46
sean-k-mooneyartom: right you only want to use can split for cpus ro memroy if you dont care about numa toplogy12:47
sean-k-mooneyall hosta are numa hosts even most high end mainstream desktop systems these days12:47
*** derekh has joined #openstack-nova12:57
*** cmart has quit IRC12:58
*** igordc has joined #openstack-nova12:59
*** sridharg has quit IRC12:59
*** dave-mccowan has quit IRC13:00
cdentsean-k-mooney: they are, but they don't have to declare that they are13:02
*** sridharg has joined #openstack-nova13:02
sean-k-mooneythat is true. i think its clean to always declare them as such but im not oposed to not doing that13:06
sean-k-mooneyi kind of always felt that the root resouce provdier shoudl not be owned by any one service and we should therefor not have inventories in it13:07
sean-k-mooneymainly to make it simpler for neutron cyborg and other serivce to creat resouces on the same host that are not managed by nova in plcement13:08
sean-k-mooneybut that is tangentel to split vs non split13:08
*** jchhatba_ has quit IRC13:08
*** jchhatba_ has joined #openstack-nova13:08
*** mriedem has joined #openstack-nova13:15
*** guozijn_ has joined #openstack-nova13:16
*** yonglihe_ has joined #openstack-nova13:17
*** beekneemech is now known as bnemec13:18
*** BjoernT has joined #openstack-nova13:19
*** guozijn has quit IRC13:19
*** guozijn_ is now known as guozijn13:19
*** purplerbot has quit IRC13:20
yonglihe_sean-k-mooney: would you like to put this on your review queue, thanks. https://review.opendev.org/#/c/658716/13:20
*** purplerbot has joined #openstack-nova13:20
*** priteau has quit IRC13:20
sean-k-mooneyah reporting the numa toplogy via the api sure ill take a look13:20
yonglihe_sean-k-mooney:  thanks, looking forward to your comments!13:21
*** psachin has quit IRC13:24
*** _alastor_ has joined #openstack-nova13:27
*** BjoernT has quit IRC13:32
*** bbowen has quit IRC13:34
*** guozijn_ has joined #openstack-nova13:35
*** guozijn has quit IRC13:37
*** guozijn_ is now known as guozijn13:37
*** guozijn_ has joined #openstack-nova13:40
*** BjoernT has joined #openstack-nova13:41
zigoWhen I attempt to migrate an instance, I get this in nova-api.log: http://paste.openstack.org/show/752159/13:42
zigoWhat's going on, and how to fix?13:42
*** guozijn has quit IRC13:42
*** guozijn_ is now known as guozijn13:42
*** rnoriega_ is now known as rnoriega|afk13:42
*** DinaBelova has joined #openstack-nova13:43
*** dkehn has joined #openstack-nova13:46
*** priteau has joined #openstack-nova13:46
*** rnoriega|afk is now known as rnoriega_13:47
*** rnoriega_ is now known as rnoriega13:51
*** jchhatba_ has quit IRC13:55
*** awalende has quit IRC13:57
*** awalende has joined #openstack-nova13:57
*** wwriverrat has joined #openstack-nova13:59
*** Woutifier has joined #openstack-nova14:00
*** awalende_ has joined #openstack-nova14:00
*** amodi has joined #openstack-nova14:01
*** awalende has quit IRC14:02
zigocdent: Any idea what can cause this? http://paste.openstack.org/show/752159/14:02
cdentzigo: looking14:02
zigoIs Nova looking for a server group that doesn't exist?14:03
*** awalende_ has quit IRC14:05
mriedemzigo: what release?14:06
zigomriedem: Rocky.14:06
* cdent passes ball to mriedem 14:06
zigo:P14:06
mriedemwas the server group deleted?14:06
cdentzigo: i would have flailed14:07
zigomriedem: I don't think so, it just went into our availability zone called "AZ3" ...14:07
zigoSo I get "properties group='AZ3'" when doing server show.14:08
*** rpittau is now known as rpittau|afk14:08
mriedemso it's blowing up here https://github.com/openstack/nova/blob/stable/rocky/nova/objects/request_spec.py#L523 which makes me think the request spec was stored with an instance group without a uuid14:10
mriedemis this an old instance?14:10
zigomriedem: No.14:11
zigoIt's a fairly recent deployment.14:11
aarentsHello! Do you still have any concern regarding this: https://review.opendev.org/#/c/659054 can we workflow+1 ? mriedem14:11
mriedemzigo: so you just created a server in a group and then tried to cold migrate or resize it and it blows up like this?14:12
zigomriedem: Someone created a server, the compute had a hardware issue, it rebooted, then I get no connectivity with that instance anymore (ovs-vsctl shows some qvo devices missing) so I'm trying to migrate it to fix the networking problem.14:13
zigoThen I get a 500 error ...14:14
zigoI'm trying to cold migrate indeed.14:14
zigoAnd the trace is what is shown in nova-api.log when doing "nova server migrate" of that instance.14:14
mriedemok are you able to dump the request_specs entry for that instance? it should be a json blob.14:15
zigomriedem: How do I do that?14:15
zigoYou mean debugging ?14:15
zigoOr just looking in the db?14:15
mriedemselect spec from nova_api.request_specs where instance_uuid=<instance id>;14:15
zigomriedem: http://paste.openstack.org/show/752161/14:18
*** itlinux has quit IRC14:19
mriedemi could see where we could hit an issue by setting an instance_group on the request spec without a uuid here https://github.com/openstack/nova/blob/stable/rocky/nova/objects/request_spec.py#L228 but that is meant to be some legacy code14:19
mriedemwhich is why i asked if it were an old instance14:19
zigomriedem: Migrating worked perfectly for other instances ...14:20
zigomriedem: How do I migrate to another availability zone?14:20
mriedemthe server group and the az are different things14:21
mriedemserver group is a grouping of ... servers. az is a grouping of compute hosts14:21
zigoRight.14:21
zigo:)14:21
mriedemsince this server was created in a specific az, you can't migrate it out of that az unless you bypass the az filter in the scheduler14:21
mriedemlike by forcefully bypassing the scheduler, which you can't do with cold migrate14:22
zigomriedem: I find it annoying that it seems like Nova picks-up an availability zone and stick every instance to it, even if in some cases, I don't want it to do that.14:22
mriedemthere is definitely a busted request spec for this instance though http://paste.openstack.org/show/752162/14:22
mriedemzigo: nova doesn't make servers go into an az by default14:23
zigoAh...14:23
zigo:)14:23
*** mlavalle has joined #openstack-nova14:23
mriedemthe user either requests an az during server create or the operator configures the cloud to default to a specific az14:23
mriedemin fact i have a docs patch for that :) https://review.opendev.org/#/c/650444/214:24
*** jdillaman has joined #openstack-nova14:24
*** guozijn has quit IRC14:24
*** guozijn has joined #openstack-nova14:24
sean-k-mooneyyonglihe_: comments are on the spec. mainly some typos other then that the content seams fine14:25
zigoWeird, the instance spec shows:14:25
zigo"group": [ "295c99ea-2db6-469a-877f-454a3903a8d8" ] (which has the name "dockerdev")14:25
zigoHowever, nova server show tells me: group='AZ3'14:25
mriedemzigo: i think somehow we're hitting this https://github.com/openstack/nova/blob/stable/rocky/nova/objects/request_spec.py#L228 and that's causing the problem, but i'm not sure how yet14:25
mriedemi can see AZ3 is the az from the request spec14:27
mriedem"availability_zone": "AZ3",14:27
zigoYes.14:27
*** dpawlik has quit IRC14:29
*** lpetrut has quit IRC14:30
mriedemi'm not sure what that group field is in nova server show...14:31
mriedemnova cli or osc?14:31
zigoosc14:32
mriedemzigo: do you know if this server has been moved before?14:32
zigomriedem: I don't think it has.14:32
zigoIt has not.14:32
mriedemdid you check the instance actions records?14:33
*** itlinux has joined #openstack-nova14:33
* zigo is checking 14:33
zigomriedem: Nothing except my attempts.14:34
mriedemand you're sure this instance was created from that rocky deployment?14:35
*** ykarel has quit IRC14:35
*** dasp has quit IRC14:36
mriedemi think we're somehow saving off a half-baked RequestSpec.instance_group after one failed attempt maybe and then that's causing a new issue loading the group from that busted request spec where the group.uuid isn't set14:37
zigomriedem: Yes, this cloud deployment has never been using something older.14:37
mriedemi.e. we're hitting https://github.com/openstack/nova/blob/stable/rocky/nova/objects/request_spec.py#L228, saving that, and then failing later here https://github.com/openstack/nova/blob/stable/rocky/nova/objects/request_spec.py#L52314:37
zigomriedem: Can I somehow just patch my request_spec db entry?14:38
mriedemyou'd have to load http://paste.openstack.org/show/752161/ from json, update the instance_group["nova_object.data"] and set the uuid field to "295c99ea-2db6-469a-877f-454a3903a8d8"14:39
mriedemto match that group scheduler hint14:39
mriedemand then serialize and update that db record14:39
mriedemcould also be hitting a reschedule loop which in rocky, the compute didn't pass the request spec back to conductor on reschedule (during resize/cold-migrate) so conductor has to build it's own request spec, that might be why we're only getting a half-baked version14:43
*** guozijn has quit IRC14:44
mriedemanyway, i'm not sure what the recreate is, but i can definitely see where we could not have a requestspec.instance_group.uuid so we should probably have a check for that in RequestSpec._from_db_object14:45
mriedemzigo: have you reported a bug?14:45
zigomriedem: I don't think I'd be a good reporter for this one, I don't know enough about the internals of this request_spec stuff to know what's going on.14:46
zigoThat's the first time I see this json output in fact.14:46
mriedemyou don't need to know the internals to report the bug, just what is happening and how you think you got here14:47
zigoOk.14:47
zigomriedem: Has nova moved to storyboard yet?14:47
mriedemno14:47
mriedemstill lp14:47
mriedemmy guess is something like this happened: 1. create server in a group, 2. cold migrate the server which fails on host A and does a reschedule to host B which maybe also fails (would be good to know if previous cold migration attempts failed with reschedules), 3. try to cold migrate again which fails with the instance_group.uuid thing14:48
*** tbachman has quit IRC14:49
mriedemthe reschedule might be the key b/c like i said conductor has to rebuild a request spec and i think that's probably where we're doing a partial build of the request spec but missing the group uuid14:49
*** AmanKSinha__ has joined #openstack-nova14:51
*** ykarel has joined #openstack-nova14:53
zigomriedem: https://bugs.launchpad.net/nova/+bug/183074714:56
openstackLaunchpad bug 1830747 in OpenStack Compute (nova) "Error 500 trying to migrate an instance after wrong request_spec" [Undecided,New]14:56
mriedemzigo: yup, thanks14:56
zigomriedem: I'm trying to add the uuid to the db entry, as you suggested.14:56
*** bbowen has joined #openstack-nova14:56
*** lpetrut has joined #openstack-nova14:59
*** dklyle has joined #openstack-nova14:59
*** cfriesen has joined #openstack-nova15:00
*** udesale has joined #openstack-nova15:00
*** hemna has joined #openstack-nova15:01
*** cmart has joined #openstack-nova15:02
zigomriedem: I think it all starts with this:15:03
zigo2019-05-28 15:02:35.534 30706 ERROR nova.compute.manager [instance: ae6f8afe-9c64-4aaf-90e8-be8175fee8e4] nova.exception.UnableToMigrateToSelf: Unable to migrate instance (ae6f8afe-9c64-4aaf-90e8-be8175fee8e4) to current host (clint1-compute-5.infomaniak.ch).15:03
zigo(not sure)15:03
*** ivve has quit IRC15:03
mriedemare you requesting a target host when doing the cold migration?15:04
zigoNop.15:08
zigoThere's 3 computes on this AZ.15:08
zigomriedem: I just migrated another VM on the same compute, and it went fine.15:09
zigoFor that one instance, I had request_spec: "instance_group": null15:09
mriedemyeah so that server wasn't in a group15:10
zigoRight.15:10
zigomriedem: Maybe I can just remove the group from that other instance then?15:10
zigo(that one failing ...)15:10
mriedemthat would break the affinity policy for that server15:10
*** yan0s has quit IRC15:11
mriedemzigo: i can generate a patch for you quick if you're in a position to try it15:13
zigoI can ... :)15:13
mriedemok i'll work on something quick15:13
zigoI can always apt-get install --reinstall python3-nova to go back to what it was.15:13
*** ykarel is now known as ykarel|away15:13
zigo(safely)15:13
zigomriedem: I'll have to go back home in 40 minutes though.15:14
openstackgerritMerged openstack/python-novaclient master: Add a description of --on-shared-storage  https://review.opendev.org/66152715:15
mriedemack, should have this up in 5 min15:16
*** hamzy has quit IRC15:18
openstackgerritAdam Spiers proposed openstack/nova master: extract baselineCPU API call from _get_cpu_traits()  https://review.opendev.org/66178215:18
*** hemna has quit IRC15:19
*** AmanKSinha__ has quit IRC15:19
openstackgerritAdam Spiers proposed openstack/nova master: extract baselineCPU API call from _get_cpu_traits()  https://review.opendev.org/66178215:20
openstackgerritMatthew Booth proposed openstack/nova master: Add functional test for bug 1550919  https://review.opendev.org/63129415:20
openstackbug 1550919 in OpenStack Compute (nova) "[Libvirt]Evacuate fail may cause disk image be deleted" [Medium,In progress] https://launchpad.net/bugs/1550919 - Assigned to Matthew Booth (mbooth-9)15:20
openstackgerritMatthew Booth proposed openstack/nova master: libvirt: Don't delete disks on shared storage during evacuate  https://review.opendev.org/57884615:20
*** hemna has joined #openstack-nova15:21
aspierskashyap: hope that refactoring is OK ^^^15:22
*** guozijn has joined #openstack-nova15:27
openstackgerritMatt Riedemann proposed openstack/nova master: WIP: Workaround missing RequestSpec.instance_group.uuid  https://review.opendev.org/66178615:27
mriedemzigo: ^ needs tests and to be prettied up but it should workaround the issue given the request spec you showed me15:27
kashyapaspiers: Hiya15:29
*** tbachman has joined #openstack-nova15:31
zigomriedem: Is this for nova-conductor ?15:31
zigoIn which node should I apply it?15:31
mriedemapi and conductor15:31
zigomriedem: Ok, then restart conductor and API, I guess ...15:32
mriedemyup15:32
*** mrch_ has quit IRC15:33
kashyapaspiers: Nice; no test to prove that "nothing is broken" with the refactoring, I presume?15:34
aspierskashyap: the existing tests should cover it. Refactoring => no change in functionality to test :)15:35
*** itlinux has quit IRC15:35
kashyapaspiers: Right15:35
kashyapI like the change, it makes things clearer.  (And I intend to refactor _get_guest_baseline_cpu_features() in turn later as part of the CPU modelling spec)15:36
*** ykarel|away has quit IRC15:38
*** lpetrut has quit IRC15:38
aspierskashyap: the follow-up patch to add the SEV trait will rename _get_cpu_traits() to _get_cpu_feature_traits() and _get_cpu_traits() will wrap around it15:38
*** guozijn has quit IRC15:40
kashyapaspiers: Yep, nod.15:40
aspierskashyap: coming up in a few secs15:40
gibimriedem: I've fixed your comments in https://review.opendev.org/#/c/652608/15:41
zigomriedem: I still get a 500 error ...15:41
*** macza has joined #openstack-nova15:41
*** jdillaman has quit IRC15:42
*** jdillaman has joined #openstack-nova15:42
mriedemzigo: do you have a paste of the logs?15:43
mriedemnote i added some debug logging15:43
zigomriedem: name "LOG" is undefined ...15:44
zigoProblem with the logging ... :P15:44
openstackgerritAdam Spiers proposed openstack/nova master: Provide HW_CPU_AMD_SEV trait when SEV is supported  https://review.opendev.org/63868015:44
*** macza has quit IRC15:44
*** JamesBenson has joined #openstack-nova15:44
mriedemah the LOG didn't exist in rocky...15:44
mriedemi'll remove the logging15:44
aspierskashyap: https://review.opendev.org/#/c/638680/15/nova/virt/libvirt/driver.py@963815:44
*** macza has joined #openstack-nova15:45
aspierskashyap: keeps the SEV bit nicely separated from the CPU feature code15:45
aspiersefried: this should make you happy too :)15:46
openstackgerritMatt Riedemann proposed openstack/nova master: WIP: Workaround missing RequestSpec.instance_group.uuid  https://review.opendev.org/66178615:46
mriedemzigo: ^15:46
mriedemgibi: huh i thought that was approved by now15:46
efriedaspiers: Sans click, I'm still gonna say "what about the HW_CPU_X86_AMD_SEV trait?"15:46
kashyapaspiers: A naming nit: "_kernel_supports_amd_sev" --> "_kernel_support_for_amd_sev"?15:47
aspiersefried: haha, thanks for the reminder15:47
gibimriedem: I would like to get it approved :)15:47
aspierskashyap: why?15:47
efriedaspiers: Maybe kashyap incorporated it in his patch, I haven't looked yet.15:47
kashyapaspiers: Maybe not.  It returns either true or false, so as it stands is okay :-)15:48
* aspiers finally goes to catch up on the epic traits renaming reviews15:48
zigomriedem: Thanks a lot, unfortunately, I have to go, so I'll try tomorrow.15:48
kashyapefried: Morning; I addressed your remarks and made them part of the older PS; and even added a note in your patch to adjust the Depends-On ID15:48
efriedkashyap: ack, saw it go by, haven't looked yet. Will take me a day or two to catch up from "holiday".15:49
*** hamzy has joined #openstack-nova15:49
efriedkashyap: and thank you :)15:49
kashyapefried: Take your sweet time15:49
* efried 's time is sweet15:49
aspiersefried: OK now here's a reoccurrence of that gerrit limitation we discussed before, but it's worse this time, because I'm not in control of all the reviews involved15:49
efriedaspiers: which one?15:50
efriedoh, can't branch upside down?15:50
aspiersright15:50
mriedemzigo: ack - also i have triaged how we get here in rocky15:50
mriedemzigo: will have the details in the bug report15:50
mriedemit15:50
mriedemit's the reschedule and such that is the problem as i suspected15:50
aspiers638680 depends on some of my stuff (e.g. the patch_open helper and the _get_cpu_traits() refactor I just submitted), but now it also needs to depend on kashyap's traits reworking15:50
mriedemrequest spec bites me in the ass yet again15:50
aspiersefried: which are distinctly orthogonal strands of development15:51
efriedaspiers: traits reworking in os-traits or traits reworking in nova?15:51
*** helenafm has quit IRC15:51
aspiersefried: ahhh good point! can use Depends-On here15:52
efriedaspiers: Well, theoretically yes15:52
aspiers... I think15:52
efriedexcept I figured out last week that it doesn't bloody work15:52
aspiers:-/15:52
aspiersI'll give it a go anyway15:52
efriedYou would have to hack up .zuul.yaml to make os-traits a required project for all the jobs.15:52
efriedwhich is a regal PITA15:53
aspierswhy?15:53
efriedbut go ahead and depends-on it and we'll just get the damn thing merged and released and requirementsed15:53
efriedwhy what?15:53
aspierswhy would .zuul.yaml need to be hacked?15:53
efriedbecause otherwise zuul will ignore your depends-on.15:53
mriedemdepends-on won't pull in your os-traits change w/o changing required-projects15:53
mriedemwe shouldn't do that anyway imo15:54
efriedand we don't want to make that ^ permanent, because we generally want to test against released os-traits15:54
mriedemb/c we could forget to release os-traits and bump the min required versions15:54
mriedemcorrect15:54
efriedmriedem: My take is that we should be allowed to do it as long as the dep switches off as soon as it merges15:55
mriedemthat's putting a lot of trust into people remembering all of these knobs15:55
efriedthat is, nova X depends on os-traits Y, so while Y is still open, X will build against it. As soon as Y merges, X goes back to testing against whatever the requirements-specified version is.15:55
aspiersare the zuul folks aware of this issue?15:55
mriedemaspiers: it's by design15:55
efriedaspiers: Yes, it's a feature, not a bug.15:56
efriedwhat mriedem said15:56
mriedemit's like how LIBS_FROM_GIT worked in the old days15:56
aspierswithout thinking hard or having the experience of you two, it sounds like a deficiency in the design?15:56
efriedaspiers: I agree it would be nice if there was a (straightforward) way around it, for just this reason.15:56
aspierslike mriedem says, requiring people to remember sounds like a UX bug to me15:57
efriedI want to make sure my nova patch will build against the os-traits I'm about to release, without having to release it first to try it.15:57
efriedI can test locally to some extent by hacking up my venv15:57
efriedbut I can't e.g. test the dsvms locally.15:57
efriedor even run all of unit and/or functional locally without the fire department standing by.15:57
aspiersis there a good reason *not* to honour Depends-On if the dependency is missing from required-projects?15:58
kashyapTrying to open nova/tests/unit/virt/libvirt/test_driver.py in GitHub tells me: "(Sorry about that, but we can’t show files that are this big right now.)"15:58
kashyap["But we can render lots of crap that clutters your view"]15:58
efriedaspiers: Point is, Depends-On will normally build against the dep, but block your patch from merging until the dep merges. If we allowed your patch to merge once the dep merges, world breaks because nova is still building against released os-traits and your os-traits patch hasn't been released yet.15:59
* efried <== meeting...15:59
*** cmart has quit IRC15:59
mriedemaspiers: this is not a new problem, this is how things have always worked for depending on library changes15:59
aspiersmriedem: OK thanks15:59
mriedemwhich is why i -1 changes that depend on the library change directly rather than the upper-constraints bump for whatever released version of the library contains that change15:59
mriedemyou can test the things in the gate with the required-projects hack16:00
openstackgerritBalazs Gibizer proposed openstack/nova master: cleanup evacuated instances not on hypervisor  https://review.opendev.org/51262316:01
openstackgerritBalazs Gibizer proposed openstack/nova master: Remove global state from the FakeDriver  https://review.opendev.org/65670916:01
openstackgerritBalazs Gibizer proposed openstack/nova master: Enhance service restart in functional env  https://review.opendev.org/51255216:01
openstackgerritBalazs Gibizer proposed openstack/nova master: Add functional test coverage for bug 1724172  https://review.opendev.org/51255316:01
openstackbug 1724172 in OpenStack Compute (nova) "Allocation of an evacuated instance is not cleaned on the source host if instance is not defined on the hypervisor" [Medium,In progress] https://launchpad.net/bugs/1724172 - Assigned to Balazs Gibizer (balazs-gibizer)16:01
aspierskashyap: see also https://github.com/isaacs/github/issues/58716:01
mriedembauzas: you may enjoy https://bugs.launchpad.net/nova/+bug/183074716:01
openstackLaunchpad bug 1830747 in OpenStack Compute (nova) "Error 500 trying to migrate an instance after wrong request_spec" [High,In progress] - Assigned to Matt Riedemann (mriedem)16:01
kashyapaspiers: Ah, thanks16:02
kashyapaspiers: It is the Website Obesity problem: https://idlewords.com/talks/website_obesity.htm16:02
aspierskashyap: although that's for diffs16:02
gibilyarwood: made it backportable as we discussed https://review.opendev.org/#/c/51262316:03
*** wwriverrat has quit IRC16:03
aspierskashyap: "I contend that text-based websites should not exceed in size the major works of Russian literature." ROFL16:03
kashyapaspiers: Indeed!16:04
aspiersThis page is amazing. "In a misguided attempt at cultural sensitivity, I have chosen to represent the consumer with a kangaroo."16:05
kashyapaspiers: I appreciate websites like npr.org (although, I only rarely read it) that provide plain text websites, without all the bloat that is, JavaScript and the advertizing bat shit16:05
kashyapaspiers: Yeah, it's a very well-written article.16:06
*** yonglihe_ has quit IRC16:06
*** tesseract has quit IRC16:06
aspiersI might have to watch the video16:07
*** ykarel|away has joined #openstack-nova16:09
*** ricolin_ has joined #openstack-nova16:10
mriedemgibi: i'll re-review your spec quick if you can review this quick https://review.opendev.org/#/c/661398/16:12
*** rha has quit IRC16:12
mriedem*not if, just pelase16:12
mriedem*please16:12
*** rha has joined #openstack-nova16:14
*** mrch_ has joined #openstack-nova16:14
mriedemgibi:  a few nits in your spec if you can respin quick, but you might be done already16:18
mriedemif so i can address those quick and +216:18
*** gyee has joined #openstack-nova16:20
*** maciejjozefczyk has quit IRC16:21
*** ivve has joined #openstack-nova16:22
openstackgerritMatt Riedemann proposed openstack/nova-specs master: Server move operations with ports having resource request  https://review.opendev.org/65260816:23
*** minmin has quit IRC16:31
*** itlinux has joined #openstack-nova16:35
*** hemna has quit IRC16:39
*** itlinux has quit IRC16:43
*** hemna has joined #openstack-nova16:46
cdentcfriesen: you might have thoughts on the discussion that starts near http://eavesdrop.openstack.org/irclogs/%23openstack-placement/%23openstack-placement.2019-05-28.log.html#t2019-05-28T16:20:5116:46
*** itlinux has joined #openstack-nova16:46
cfriesenlooking16:46
cdentcfriesen: the spec in question is https://review.opendev.org/65851016:47
cfriesencdent: there is a flaw in the current handling of 4K pages which means that you can't mix numa and non-numa instances using 4k pages on the same host.16:48
*** dpawlik has joined #openstack-nova16:48
*** wwriverrat has joined #openstack-nova16:54
cdentcfriesen: if you've got a chance to dig at that spec that would be great. i've got to take off for today16:55
openstackgerritAdam Spiers proposed openstack/nova master: Provide HW_CPU_X86_AMD_SEV trait when SEV is supported  https://review.opendev.org/63868016:55
*** wwriverrat has quit IRC16:55
cfriesencdent: will try.  I left a comment elaborating a bit on the 4k page thing16:56
cdentthanks16:56
*** cdent has left #openstack-nova16:57
aspiersefried, mriedem: https://review.opendev.org/#/c/638680/16 temporarily adds os-traits to .zuul.yaml. I've put W-1 since IIUC we don't want to merge it like that.16:57
aspierskashyap: I guess you should be aware too ^^^16:57
*** itlinux has quit IRC16:58
aspiersmriedem: you want the comment inline, or in the commit message?16:59
aspierswould be nice if there was a magic string in commit messages which prevented zuul from merging16:59
*** derekh has quit IRC17:00
mriedemaspiers: i have a magic -217:00
mriedemaspiers: inline17:00
*** ricolin_ has quit IRC17:00
mriedemand prefix your commit title with WIP:17:00
mriedemso -W isn't lost between rebases17:00
aspiersOK17:00
aspiersIIRC, -2 is sticky across patchsets and has to be explicitly removed?17:01
aspierswould be good if mortals could achieve something equivalent17:01
*** itlinux has joined #openstack-nova17:01
aspiersI'm suggesting it in #zuul17:01
aspiersprobably more of a Gerrit thing actually17:04
*** sapd1_x has quit IRC17:05
*** sridharg has quit IRC17:05
openstackgerritAdam Spiers proposed openstack/nova master: WIP: Provide HW_CPU_X86_AMD_SEV trait when SEV is supported  https://review.opendev.org/63868017:06
*** irclogbot_3 has quit IRC17:17
*** irclogbot_3 has joined #openstack-nova17:19
openstackgerritAdam Spiers proposed openstack/nova master: WIP: Provide HW_CPU_X86_AMD_SEV trait when SEV is supported  https://review.opendev.org/63868017:19
efriedaspiers: I'm pretty confused about the rebasing state of all your patches.17:25
aspiersefried: how can I help with that?17:25
efriedare you working on rebasing all of them to be in one chain?17:25
aspiersonly where necessary17:25
aspiersmy goals, in decreasing order, are: 1) correctness, 2) ease of review, 3) minimise churn on CI resources17:26
*** spatel has joined #openstack-nova17:27
aspiersit did recently occur to me that I could (theoretically, in a parallel universe where time is unconstrained) teach git-review to automatically rebase as necessary by using my git-deps module17:27
efriedwhat I mean is, for example, https://review.opendev.org/#/c/661782/2 is based on https://review.opendev.org/#/c/661266/3 when PS4 is available (and merging). And then https://review.opendev.org/#/c/638680/18 is based on https://review.opendev.org/#/c/661782/2, but https://review.opendev.org/#/c/636334/5 is based on https://review.opendev.org/#/c/638680/1417:29
aspiersefried: that's because I forgot that you submitted PS417:30
aspiersefried: I just based it on the latest PS I had locally, without thinking17:30
efriedokay, my fault on that one17:30
aspiershaha, hardly :)17:30
aspiersbut I'll generously share some of the blame with you if you insist ;)17:31
efriedanyway, as a reviewer I'm basically too confused to jump in atm17:31
aspierslooking at the other ones now17:31
efriedwhich is fine, I have lots to keep me busy, not like I'm sitting on my hands waiting for this to be ready.17:31
efriedjust want you to be aware that I'm likely to wait until there's no orange dots or green tildes on the right before I dig in.17:32
spatelsean-k-mooney: hey17:32
efriedaspiers: (are you aware of the meaning of the orange dots and green tildes?)17:32
aspiersOK, so essentially you want me to ditch my third goal? which is totally fine by me17:32
aspiersyep, I had figured that out17:32
aspiersI can understand the desire to eliminate orange dots. Why do you want to avoid green tildes though?17:33
efriedaspiers: well, I may be telling you that you may be reversing goals 2 and 3 :) at least from my pov17:34
aspiersACK, just trying to understand the cause of the confusion17:34
efriedbecause it means that those patches are based on older versions of these17:34
efriedit's usually a signal that you're still in the process of rebasing and cleaning things up.17:34
*** igordc has quit IRC17:34
aspiers... which in the third example you listed is true17:34
*** ykarel|away has quit IRC17:34
efriedwhich is reinforced by having just WIP'd one near the bottom17:35
efriedanyway, again, I'm not trying to hurry you along.17:35
aspiersI don't mind being hurried :)17:35
*** ykarel|away has joined #openstack-nova17:35
efriedjust wanted to confirm that you're still shuffling the paperwork, as opposed to thinking you're ready for reviews and then getting frustrated when they don't happen17:35
aspiersWell, this is a very useful discussion17:36
aspiersIt highlights that the unavoidable impact of deciding not to review anything within a given topic until all tildes and dots are gone, is that every time I need to change something minor lower in the dependency tree, I have to rebase every single thing above it before the new patchset gets reviewed17:37
aspiersTo me this highlights a failure in Gerrit's UI17:37
efriedor a failure in my method of working.17:38
aspiersIdeally reviews would only be blocked if stale stuff is *below* them, not above17:38
efried"blocked" is a bit strong17:38
efriedIt's just the typical workflow I see (and use) is, when something needs to be fixed on a lower patch, download the whole series, git restack, fix the issues below, which automatically rebases the rest of the way up, and resubmit the whole series.17:39
efriedAgree that consumes a lot of CI resources17:39
efriedbut it also ensures that the top changes will legitimately work with however the lower changes have been altered.17:39
aspiersSure17:39
aspiersI'm not saying I want to avoid rebasing things17:39
aspiersJust wondering if the presence of WIP higher up the tree should have an impact on stuff lower in the tree17:40
aspiersIf I understand the Gerrit UI correctly, we're talking about whether a patch in the Related Changes list has dots or tildes *below* it, right?17:41
efriedI'm not sure it's possible to have tildes below or dots above.17:42
aspiersOh, good point17:42
efriedI mean, technically possible, but you would really have to be trying.17:42
efried...unless you're looking at a PS that itself has a dot17:42
efriedanyway17:42
efriedthe presence of WIP higher in the tree (which is not the same thing as a tilde, btw) should not impact reviews lower.17:42
efriedso this is probably just me being used to one workflow and you using a different one to (rightly) try to conserve CI resources.17:43
aspiersWell, it's also about me needing to pay more attention to orange dots in Related Changes, so I can spot when rebases are needed17:44
efriedmoot right now because I've reviewed everything up to the first one that's actually titled WIP, so regardless of colored decorations, I'm stopping here.17:44
aspiersthe WIP one is only marked WIP because of the required-projects hack. Other than that I think it's ready to go17:44
efriedbut yeah, usually a patch that's riding an orange dot should be rebased if it's to get serious attention.17:44
aspiersAt least, other than rebasing (which I'll do now) I've run out of improvements to make to it17:45
aspiersI put WIP on it because mriedem asked me to, but the only element of WIP there is that kashyap's os-traits patch hasn't landed and been released yet.17:46
aspiersefried: also, since we're putting the workflow under the microscope, should I be putting the SEV blueprint: in the commit message and topic for changes like refactorings, which aren't per se SEV-related, but still form part of the SEV series?17:48
efriednah17:48
aspiersok17:48
*** ttsiouts has joined #openstack-nova17:49
openstackgerritAdam Spiers proposed openstack/nova master: extract baselineCPU API call from _get_cpu_traits()  https://review.opendev.org/66178217:50
openstackgerritAdam Spiers proposed openstack/nova master: WIP: Provide HW_CPU_X86_AMD_SEV trait when SEV is supported  https://review.opendev.org/63868017:53
*** igordc has joined #openstack-nova17:55
*** igordc has quit IRC17:55
*** igordc has joined #openstack-nova17:55
*** priteau has quit IRC17:56
openstackgerritMerged openstack/nova-specs master: Update SEV work item to new approach based on MEM_ENCRYPTION_CONTEXT  https://review.opendev.org/65571717:58
openstackgerritAdam Spiers proposed openstack/nova master: Extract SEV-specific bits on host detection  https://review.opendev.org/63633417:59
*** ttsiouts has quit IRC17:59
aspiersefried: got rid of some orange dots18:01
*** ykarel|away has quit IRC18:01
*** itlinux has quit IRC18:02
*** hongbin has joined #openstack-nova18:03
* aspiers wonders how the hell the Linux kernel and git communities get anything done at all reviewing by email18:04
*** cmart has joined #openstack-nova18:05
aspiers(and that's from someone who's worked with them)18:05
*** hemna has quit IRC18:15
*** hemna has joined #openstack-nova18:16
*** itlinux has joined #openstack-nova18:16
openstackgerritMatt Riedemann proposed openstack/nova master: Workaround missing RequestSpec.instance_group.uuid  https://review.opendev.org/66178618:16
openstackgerritMatt Riedemann proposed openstack/nova master: Add regression recreate test for bug 1830747  https://review.opendev.org/66182218:17
openstackbug 1830747 in OpenStack Compute (nova) "Error 500 trying to migrate an instance after wrong request_spec" [High,In progress] https://launchpad.net/bugs/1830747 - Assigned to Matt Riedemann (mriedem)18:17
mriedemzigo: with a functional recreate test of the issue ^18:17
*** efried has quit IRC18:17
*** efried has joined #openstack-nova18:18
*** wwriverrat has joined #openstack-nova18:19
*** wwriverrat has quit IRC18:21
openstackgerritAdam Spiers proposed openstack/nova master: Reduce logging of host hypervisor capabilities to DEBUG level  https://review.opendev.org/66137918:24
*** imacdonn has quit IRC18:33
gansolyarwood, melwitt, dansmith, tonyb: Hello! When you have a minute, could you please take a look at those backports? https://review.opendev.org/#/c/652153 , https://review.opendev.org/#/c/658136 and https://review.opendev.org/#/c/661349 ? Thanks in advance! =)18:34
*** wwriverrat has joined #openstack-nova18:41
*** wwriverrat has quit IRC18:42
*** wwriverrat has joined #openstack-nova18:43
aspiersefried: if CONF.libvirt.num_memory_encrypted_guests is not set and therefore defaults to None (meaning as we agreed in the spec, "auto-detect the inventory, if if this isn't possible, don't impose any limit), what should the MEM_ENCRYPTION_CONTEXT inventory get set to?18:44
aspiersI'm not sure we came to a consensus with jaypipes on this http://eavesdrop.openstack.org/irclogs/%23openstack-nova/%23openstack-nova.2019-04-23.log.html#t2019-04-23T17:55:5718:44
*** lpetrut has joined #openstack-nova18:47
*** wwriverrat has quit IRC18:47
efriedaspiers: MAXINT18:48
jaypipesaspiers: not sure you need any consensus. :)18:49
aspiersjaypipes: OK :)18:51
*** lpetrut has quit IRC18:51
*** itlinux has quit IRC19:09
*** tstrul has joined #openstack-nova19:11
*** itlinux has joined #openstack-nova19:13
*** hemna has quit IRC19:27
*** takamatsu has joined #openstack-nova19:28
*** pcaruana has quit IRC19:30
*** BjoernT has quit IRC19:41
*** tstrul has quit IRC19:48
*** ralonsoh has quit IRC19:53
*** imacdonn has joined #openstack-nova19:56
*** licanwei has quit IRC19:56
openstackgerritJohn Garbutt proposed openstack/nova master: WIP: Integrating with unified limits  https://review.opendev.org/61518019:57
*** hemna has joined #openstack-nova20:01
*** takamatsu has quit IRC20:02
*** mriedem has quit IRC20:07
*** wwriverrat has joined #openstack-nova20:14
*** wwriverrat has quit IRC20:19
*** dasp has joined #openstack-nova20:20
*** hamzy has quit IRC20:21
*** wwriverrat has joined #openstack-nova20:29
*** wwriverrat has quit IRC20:30
*** dpawlik has quit IRC20:31
*** wwriverrat has joined #openstack-nova20:31
*** wwriverrat has quit IRC20:32
*** wwriverrat has joined #openstack-nova20:35
*** wwriverrat has quit IRC20:36
*** dasp has quit IRC20:38
*** dasp has joined #openstack-nova20:38
*** takamatsu has joined #openstack-nova20:42
*** xek_ has quit IRC20:44
*** boxiang has quit IRC20:48
*** slaweq has quit IRC20:49
*** mriedem has joined #openstack-nova20:51
mriedemyikun: looks like we have an api-ref bug on the server group policy parameter type, can you confirm? https://bugs.launchpad.net/nova/+bug/183080020:51
openstackLaunchpad bug 1830800 in OpenStack Compute (nova) "Compute API in nova - server group "policy" field is a string rather than an object" [Medium,Triaged]20:51
openstackgerritArtom Lifshitz proposed openstack/nova master: [WIP] Revert resize: wait for events according to hybrid plug  https://review.opendev.org/64488120:53
openstackgerritArtom Lifshitz proposed openstack/nova master: Run revert resize tests in nova-live-migration  https://review.opendev.org/65349820:53
openstackgerritArtom Lifshitz proposed openstack/nova master: [DNM] use iptables in nova-multinode  https://review.opendev.org/66078220:53
*** dave-mccowan has joined #openstack-nova21:08
*** slaweq has joined #openstack-nova21:11
*** itlinux has quit IRC21:20
*** dave-mccowan has quit IRC21:23
*** itlinux has joined #openstack-nova21:23
*** slaweq has quit IRC21:24
*** udesale has quit IRC21:31
*** bbowen has quit IRC21:52
*** bbowen has joined #openstack-nova21:53
*** JamesBenson has quit IRC21:57
*** awalende has joined #openstack-nova22:00
*** itlinux has quit IRC22:02
*** bbowen has quit IRC22:02
*** spatel has quit IRC22:03
*** awalende has quit IRC22:05
*** rcernin has quit IRC22:06
*** whoami-rajat has quit IRC22:11
*** dave-mccowan has joined #openstack-nova22:12
*** slaweq has joined #openstack-nova22:16
*** cmart has quit IRC22:19
*** slaweq has quit IRC22:24
*** mriedem has quit IRC22:29
*** wwriverrat has joined #openstack-nova22:29
*** dave-mccowan has quit IRC22:31
eanderssonWhat is the network cache used for on the computes?22:45
openstackgerritAdam Spiers proposed openstack/nova master: extract baselineCPU API call from _get_cpu_traits()  https://review.opendev.org/66178222:45
eanderssonWe found that with a high number of computes, the whole heal instance info cache got a little too chatty on the default setting.22:45
aspiersefried: at risk of highlighting my own incompetence, this is the kind of change where normally I'd be inclined to avoid a rebase of everything sitting on top: https://review.opendev.org/#/c/661782/3..4/nova/virt/libvirt/driver.py22:46
aspiersefried: that said, I'm totally fine with rebasing if you'd prefer that22:47
aspiersah actually, since splitting out some other patches, there's only one patch sitting on top22:47
aspiersso maybe I will anyway22:48
aspiershah, especially considering zuul absolutely hates that change sitting on top22:49
efriedaspiers: I respect your green-ness. And maybe you'll start a sea change in nova. All I'm saying is that all the series contributions I've seen in my (albeit limited) time here have been managed in a series-as-a-whole fashion.22:49
*** amodi has quit IRC22:49
aspiersefried: fine by me :) I maintain the belief that Gerrit should visualise the dependency tree in a way which would make this kind of stuff a no-brainer22:50
aspiersbut until it gets smarter, I'm happy to do whatever to make reviews easier22:50
efriedaspiers: I use the tree-shaped version of git log locally, do you?22:51
efriedTo me, that sounds more or less like the visualization you're talking about...22:52
aspiersI use gitk, but that shows the history, not the real dependency tree22:52
efried...and in that visualization, the way it's expressed is bang on.22:52
efriedi.e. you can't say that PS4 of X is based on PS2 of Y when it's in fact based on PS1 of Y.22:52
aspiersI'm talking about semantic dependencies https://aspiers.github.io/nashville-git-automagic-april-2019/#/git-deps-concept22:53
efriedBecause PS1 and PS2 of Y could be *wildly* bifferent.22:53
efriedor even different.22:53
aspiersI like bifferent, it should be a word22:53
efriedBack to the Future referential, somehow.22:53
aspiers:)22:53
efriedlike how a guy can be a jerk until you go back in time and kick his ass, then when you come back to the present, he's bifferent.22:54
aspiersexactly :)22:54
aspiersactually that was misleading - git-deps deals in textual dependencies, but here I mean semantic ones22:55
*** tkajinam has joined #openstack-nova23:02
openstackgerritMatt Riedemann proposed openstack/nova master: Fix hard-delete of instance with soft-deleted referential constraints  https://review.opendev.org/66139823:09
openstackgerritMatt Riedemann proposed openstack/nova master: Update usage in RT.drop_move_claim during confirm resize  https://review.opendev.org/64180623:09
openstackgerritMatt Riedemann proposed openstack/nova master: Robustify attachment tracking in CinderFixtureNewAttachFlow  https://review.opendev.org/65890423:09
openstackgerritMatt Riedemann proposed openstack/nova master: Add Migration.cross_cell_move and get_by_uuid  https://review.opendev.org/61401223:09
openstackgerritMatt Riedemann proposed openstack/nova master: Add InstanceAction/Event create() method  https://review.opendev.org/61403623:09
openstackgerritMatt Riedemann proposed openstack/nova master: Add Instance.hidden field  https://review.opendev.org/63112323:09
openstackgerritMatt Riedemann proposed openstack/nova master: Add TargetDBSetupTask  https://review.opendev.org/62789223:09
openstackgerritMatt Riedemann proposed openstack/nova master: Add CrossCellMigrationTask  https://review.opendev.org/63158123:09
openstackgerritMatt Riedemann proposed openstack/nova master: Execute TargetDBSetupTask  https://review.opendev.org/63385323:09
openstackgerritMatt Riedemann proposed openstack/nova master: Add prep_snapshot_based_resize_at_dest compute method  https://review.opendev.org/63329323:09
openstackgerritMatt Riedemann proposed openstack/nova master: Add PrepResizeAtDestTask  https://review.opendev.org/62789023:09
openstackgerritMatt Riedemann proposed openstack/nova master: Add prep_snapshot_based_resize_at_source compute method  https://review.opendev.org/63483223:09
openstackgerritMatt Riedemann proposed openstack/nova master: Add nova.compute.utils.delete_image  https://review.opendev.org/63760523:09
openstackgerritMatt Riedemann proposed openstack/nova master: Add PrepResizeAtSourceTask  https://review.opendev.org/62789123:09
openstackgerritMatt Riedemann proposed openstack/nova master: Refactor ComputeManager.remove_volume_connection  https://review.opendev.org/64218323:09
openstackgerritMatt Riedemann proposed openstack/nova master: Add power_on kwarg to ComputeDriver.spawn() method  https://review.opendev.org/64259023:09
openstackgerritMatt Riedemann proposed openstack/nova master: Add finish_snapshot_based_resize_at_dest compute method  https://review.opendev.org/63508023:09
openstackgerritMatt Riedemann proposed openstack/nova master: Add FinishResizeAtDestTask  https://review.opendev.org/63564623:09
openstackgerritMatt Riedemann proposed openstack/nova master: Add CrossCellWeigher  https://review.opendev.org/61435323:09
openstackgerritMatt Riedemann proposed openstack/nova master: Support cross-cell moves in external_instance_event  https://review.opendev.org/65847823:09
openstackgerritMatt Riedemann proposed openstack/nova master: Add cross-cell resize policy rule and enable in API  https://review.opendev.org/63826923:09
openstackgerritMatt Riedemann proposed openstack/nova master: WIP: Enable cross-cell resize in the nova-multi-cell job  https://review.opendev.org/65665623:09
openstackgerritMatt Riedemann proposed openstack/nova master: Add functional test for anti-affinity cross-cell migration  https://review.opendev.org/66185923:09
*** mriedem has joined #openstack-nova23:10
*** spatel has joined #openstack-nova23:10
mriedemmelwitt: you might be interested in https://review.opendev.org/#/c/661859/ since it's related to the setup_instance_group group.hosts lazy-load / cell context stuff you worked on before23:10
mriedemturns out the move operation assumptions in there don't work for cross-cell migration with an anti-affinity group but the anti-affinity server group filter doesn't look at request_spec.instance_group.hosts since rocky anyway23:11
mriedemso it magically just sort of works23:11
*** slaweq has joined #openstack-nova23:11
*** spatel has quit IRC23:14
*** _erlon_ has quit IRC23:16
*** lbragstad has quit IRC23:19
*** rcernin has joined #openstack-nova23:21
*** lbragstad has joined #openstack-nova23:23
*** slaweq has quit IRC23:24
*** mriedem has quit IRC23:27
*** JamesBenson has joined #openstack-nova23:36
*** macza has quit IRC23:36
*** gyee has quit IRC23:40
*** JamesBenson has quit IRC23:40
*** mlavalle has quit IRC23:41
*** dave-mccowan has joined #openstack-nova23:47
*** frankwang has joined #openstack-nova23:48
*** dave-mccowan has quit IRC23:53
*** takamatsu has quit IRC23:56

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!