Thursday, 2018-11-22

*** betherly has joined #openstack-nova00:01
*** brinzhang has joined #openstack-nova00:02
*** betherly has quit IRC00:06
*** Dinesh_Bhor has joined #openstack-nova00:20
*** Dinesh_Bhor has quit IRC00:21
*** betherly has joined #openstack-nova00:21
*** betherly has quit IRC00:25
*** betherly has joined #openstack-nova00:34
*** betherly has quit IRC00:40
*** erlon has quit IRC00:49
*** mordred has quit IRC00:49
*** takashin has joined #openstack-nova00:53
*** ileixe has joined #openstack-nova01:02
*** bhagyashris has joined #openstack-nova01:11
*** jamesdenton has quit IRC01:12
*** rcernin has quit IRC01:39
*** rcernin has joined #openstack-nova01:39
*** tetsuro has joined #openstack-nova01:41
*** annp has quit IRC02:04
*** ileixe has quit IRC02:06
openstackgerritFan Zhang proposed openstack/nova master: Log disk transfer stats in live migration monitor.  https://review.openstack.org/61939502:11
*** ileixe has joined #openstack-nova02:12
*** Dinesh_Bhor has joined #openstack-nova02:14
openstackgerritJason SUN proposed openstack/nova master: For instances end up in cell0, set its availability_zone to None.  https://review.openstack.org/61873702:18
*** ileixe has quit IRC02:19
*** ileixe has joined #openstack-nova02:25
*** mrsoul has quit IRC02:31
*** ileixe has quit IRC02:41
*** mhen has quit IRC02:47
*** ileixe has joined #openstack-nova02:49
*** mhen has joined #openstack-nova02:54
*** ileixe has quit IRC03:07
*** psachin has joined #openstack-nova03:19
*** mgariepy has quit IRC03:24
*** amrith has quit IRC03:32
*** mgariepy has joined #openstack-nova03:35
openstackgerritYikun Jiang proposed openstack/nova master: Add live migration timeout action  https://review.openstack.org/61914303:36
openstackgerritYikun Jiang proposed openstack/nova master: Remove live_migration_progress_timeout config  https://review.openstack.org/61914203:36
*** tetsuro has quit IRC04:05
*** cfriesen has quit IRC04:11
*** whoami-rajat has joined #openstack-nova04:13
*** yonglihe has quit IRC04:14
*** udesale has joined #openstack-nova04:15
*** janki has joined #openstack-nova04:32
openstackgerritFan Zhang proposed openstack/nova master: Log disk transfer stats in live migration monitor.  https://review.openstack.org/61939504:32
*** ivve has joined #openstack-nova04:39
*** bhagyashris has quit IRC05:01
openstackgerritTakashi NATSUME proposed openstack/nova master: Add a bug tag for nova doc  https://review.openstack.org/61943405:13
*** sridharg has joined #openstack-nova05:17
openstackgerritMerged openstack/python-novaclient master: Fix a type of block_device_mapping_v2 in a comment  https://review.openstack.org/61914505:17
*** ileixe has joined #openstack-nova05:28
*** Sundar has joined #openstack-nova05:42
*** ratailor has joined #openstack-nova05:50
*** jarodwl1 has joined #openstack-nova06:09
*** jarodwl1 has quit IRC06:09
*** k_mouza has joined #openstack-nova06:14
openstackgerritJason SUN proposed openstack/nova master: For instances end up in cell0, set its availability_zone to None.  https://review.openstack.org/61873706:15
*** k_mouza has quit IRC06:18
openstackgerritYikun Jiang proposed openstack/nova master: Add live migration timeout action  https://review.openstack.org/61914306:20
openstackgerritYikun Jiang proposed openstack/nova master: Remove live_migration_progress_timeout config  https://review.openstack.org/61914206:20
*** Luzi has joined #openstack-nova06:23
*** Sundar has quit IRC06:35
openstackgerritZhenyu Zheng proposed openstack/nova master: Bump compute service to indicate attach/detach root volume is supported  https://review.openstack.org/61475006:50
*** jarodwl has joined #openstack-nova06:53
*** slaweq has joined #openstack-nova06:59
*** bhagyashris has joined #openstack-nova07:00
openstackgerritOpenStack Proposal Bot proposed openstack/nova stable/rocky: Imported Translations from Zanata  https://review.openstack.org/61475707:17
*** pcaruana has joined #openstack-nova07:22
*** tetsuro has joined #openstack-nova07:27
*** jaosorior has joined #openstack-nova07:41
*** phillu has joined #openstack-nova07:50
*** alexchadin has joined #openstack-nova07:52
*** phillu has quit IRC07:57
*** sahid has joined #openstack-nova07:57
*** takashin has left #openstack-nova08:00
*** alexchadin has quit IRC08:06
*** adrianc has joined #openstack-nova08:07
*** rcernin has quit IRC08:13
*** ralonsoh has joined #openstack-nova08:18
*** helenafm has joined #openstack-nova08:24
*** imacdonn has quit IRC08:38
*** xek has joined #openstack-nova08:42
*** phillu has joined #openstack-nova08:46
openstackgerritYikun Jiang proposed openstack/nova master: Add live migration timeout action  https://review.openstack.org/61914308:51
openstackgerritYikun Jiang proposed openstack/nova master: Remove live_migration_progress_timeout config  https://review.openstack.org/61914208:51
*** bhagyashris has quit IRC08:53
*** phillu has quit IRC08:55
*** slaweq has quit IRC08:56
*** trident has quit IRC08:57
*** trident has joined #openstack-nova08:59
*** Dinesh_Bhor has quit IRC09:15
*** sambetts_ has quit IRC09:18
*** Dinesh_Bhor has joined #openstack-nova09:18
*** sambetts_ has joined #openstack-nova09:20
*** tssurya has joined #openstack-nova09:23
*** derekh has joined #openstack-nova09:34
*** holser_ has joined #openstack-nova09:36
*** holser_ has left #openstack-nova09:36
*** phillu has joined #openstack-nova09:52
*** davidsha has joined #openstack-nova09:53
*** dtantsur|afk is now known as dtantsur09:54
*** cdent has joined #openstack-nova09:58
*** aloga has quit IRC10:15
*** aloga has joined #openstack-nova10:15
*** aloga has quit IRC10:20
*** aloga has joined #openstack-nova10:20
*** brinzhang has quit IRC10:24
*** Dinesh_Bhor has quit IRC10:24
*** aloga has quit IRC10:24
*** aloga has joined #openstack-nova10:25
openstackgerritSylvain Bauza proposed openstack/nova master: libvirt: implement reshaper for vgpu  https://review.openstack.org/59920810:28
*** erlon has joined #openstack-nova10:30
*** dpawlik has quit IRC10:37
*** dpawlik_ has joined #openstack-nova10:37
*** aloga has quit IRC10:39
*** aloga has joined #openstack-nova10:40
*** maciejjozefczyk has joined #openstack-nova10:43
*** k_mouza has joined #openstack-nova10:44
*** aloga has quit IRC10:44
*** aloga has joined #openstack-nova10:45
*** sahid has left #openstack-nova10:47
*** adrianc has quit IRC10:50
*** toabctl has joined #openstack-nova10:54
*** aloga has quit IRC10:54
*** maciejjozefczyk has quit IRC10:54
*** maciejjozefczyk has joined #openstack-nova10:55
*** aloga has joined #openstack-nova10:55
*** maciejjozefczyk has quit IRC11:00
*** aloga has quit IRC11:00
*** aloga has joined #openstack-nova11:00
*** aloga has quit IRC11:05
*** ccamacho has quit IRC11:08
*** zigo has joined #openstack-nova11:09
*** ccamacho has joined #openstack-nova11:10
*** aloga has joined #openstack-nova11:11
*** aloga has quit IRC11:15
*** udesale has quit IRC11:15
*** aloga has joined #openstack-nova11:16
*** aloga has quit IRC11:20
*** aloga has joined #openstack-nova11:21
*** adrianc has joined #openstack-nova11:24
*** aloga has quit IRC11:24
*** adrianc has quit IRC11:24
*** adrianc has joined #openstack-nova11:24
*** aloga has joined #openstack-nova11:26
*** aloga has quit IRC11:30
*** aloga has joined #openstack-nova11:31
*** aloga has quit IRC11:34
*** Miouge has joined #openstack-nova11:35
openstackgerritJason SUN proposed openstack/nova master: For instances end up in cell0, set its availability_zone to None.  https://review.openstack.org/61873711:38
*** k_mouza has quit IRC11:38
gary_perkinsHi folks! General question about spinning up instances and storage: I have compute nodes with very little spare storage. Is it possible to confine all storage operations to go to Cinder? Even ephemeral storage and spinning up image-backed instances where normally local storage is allocated? Is this something flavors could handle or should handle? TIA11:40
MiougeIs there a way to expose the compute node an instance is running on in metadata? I would have to do with DynamicJSON vendordata?11:41
gary_perkinsmriedem: Thanks for your help yesterday. The issue is still not resolved, but I'll have to return to it another time.11:42
*** aloga has joined #openstack-nova11:43
*** janki has quit IRC11:43
*** aloga has quit IRC11:44
*** dims has quit IRC11:45
openstackgerritBalazs Gibizer proposed openstack/nova master: Calculate RequestGroup resource provider mapping  https://review.openstack.org/61623911:46
openstackgerritBalazs Gibizer proposed openstack/nova master: Pass resource provider mapping to neutronv2 api  https://review.openstack.org/61624011:46
openstackgerritBalazs Gibizer proposed openstack/nova master: Send RP uuid in the port binding  https://review.openstack.org/56945911:46
openstackgerritBalazs Gibizer proposed openstack/nova master: Test boot with more ports with bandwidth request  https://review.openstack.org/57331711:46
openstackgerritBalazs Gibizer proposed openstack/nova master: Extend RequestGroup object for mapping  https://review.openstack.org/61952711:46
openstackgerritBalazs Gibizer proposed openstack/nova master: Fill the RequestGroup mapping during schedule  https://review.openstack.org/61952811:46
openstackgerritBalazs Gibizer proposed openstack/nova master: Recalculate request group - RP mapping during re-schedule  https://review.openstack.org/61952911:46
*** aloga has joined #openstack-nova11:48
*** aloga has quit IRC11:50
*** aloga has joined #openstack-nova11:53
*** aloga has quit IRC11:53
*** phillu has quit IRC11:55
*** ralonsoh has quit IRC11:58
*** aloga has joined #openstack-nova11:58
*** ralonsoh has joined #openstack-nova11:59
openstackgerritBalazs Gibizer proposed openstack/nova master: Transfer port.resource_request to the scheduler  https://review.openstack.org/56726812:00
openstackgerritBalazs Gibizer proposed openstack/nova master: Extend RequestGroup object for mapping  https://review.openstack.org/61952712:00
openstackgerritBalazs Gibizer proposed openstack/nova master: Calculate RequestGroup resource provider mapping  https://review.openstack.org/61623912:00
openstackgerritBalazs Gibizer proposed openstack/nova master: Fill the RequestGroup mapping during schedule  https://review.openstack.org/61952812:00
openstackgerritBalazs Gibizer proposed openstack/nova master: Pass resource provider mapping to neutronv2 api  https://review.openstack.org/61624012:00
openstackgerritBalazs Gibizer proposed openstack/nova master: Recalculate request group - RP mapping during re-schedule  https://review.openstack.org/61952912:00
openstackgerritBalazs Gibizer proposed openstack/nova master: Send RP uuid in the port binding  https://review.openstack.org/56945912:00
openstackgerritBalazs Gibizer proposed openstack/nova master: Test boot with more ports with bandwidth request  https://review.openstack.org/57331712:00
*** phillu has joined #openstack-nova12:07
*** phillu has quit IRC12:22
*** salmankhan has joined #openstack-nova12:29
*** awalende has joined #openstack-nova12:30
awalendeDoes anyone know how I can troubleshoot oslo_timeouts exceptions in pre-live migrations? Only 1/5 migration attempts work, all others run in somekind of oslo messaging timeout:12:37
awalendePre live migration failed at blies: MessagingTimeout: Timed out waiting for a reply to message ID 359a5c51e98f4474ac12:37
mhenawalende, we're experiencing the exact same thing in one of our infrastructures - we're still investigating but had no luck identifying the cause so far12:46
awalendeWe tried to cram up some migration timeout values in nova.conf but I believe it has nothing to do with the migration itself.12:51
awalendeDon't know what exactly is happening in the pre-migration. Probably networking and maybe cinder stuff...12:52
*** tetsuro has quit IRC12:58
sean-k-mooneyawalende: pre-migration has a number of check and we do wire up some of the networking on the destination13:01
sean-k-mooneyawalende: the timeout could be as a result of messages getting lost or connection  issue btween the compute nodes and amqp13:04
sean-k-mooneyawalende: have you seen any log messages related to services reconnecting to rabbitmq that could indicate network issues13:05
awalendesean-k-mooney, I have enabled debug logging on the compute nodes, but the only amqp related stuff is the timeOut-Exception itself. We are running HA rabbit on 3 Controllers, I'll check there for any further infos13:06
mhenawalende, are you using persistent queues?13:17
awalendewe don't13:18
awalendebecause we had often problems with split-brain issues on rabbit13:18
mhengood to know, then we can rule that out as the culprit for now13:20
*** diga has joined #openstack-nova13:21
*** k_mouza has joined #openstack-nova13:22
*** jangutter_ has joined #openstack-nova13:30
*** awalende has quit IRC13:33
*** jangutter has quit IRC13:33
*** adrianc has quit IRC13:34
*** ratailor has quit IRC13:35
*** adrianc has joined #openstack-nova13:38
*** cdent_ has joined #openstack-nova13:39
*** cdent has quit IRC13:39
*** cdent_ is now known as cdent13:39
*** slaweq has joined #openstack-nova13:41
*** udesale has joined #openstack-nova13:44
*** liuyulong has joined #openstack-nova13:48
*** pcaruana has quit IRC13:50
*** zul has joined #openstack-nova14:07
*** slaweq has quit IRC14:07
*** dims has joined #openstack-nova14:14
*** whoami-rajat has quit IRC14:16
*** Luzi has quit IRC14:22
*** pcaruana has joined #openstack-nova14:25
*** adrianc has quit IRC14:33
*** psachin has quit IRC14:55
gary_perkinsHi folks! General question about spinning up instances and storage: I have compute nodes with very little spare storage. Is it possible to confine all storage operations to go to Cinder? Even ephemeral storage and spinning up image-backed instances where normally local storage is allocated? Is this something flavors could handle or should handle? TIA15:07
*** cfriesen has joined #openstack-nova15:09
*** jangutter_ has quit IRC15:10
*** jangutter has joined #openstack-nova15:11
mnasersimple and clean backport if anyone is around -- https://review.openstack.org/#/c/619349/15:11
artomgary_perkins, I think you want boot from volume instances15:11
*** jistr is now known as jistr|call15:20
gary_perkinsartom: yes, but I want to transparently enforce the use of cinder volumes for all storage so that the compute nodes don't run out of their limited capacity15:22
*** k_mouza has quit IRC15:23
gary_perkinsand by, transparently, I mean, I don't want users to have to create a bootable cinder volume prior to spinning up an instance15:24
*** jistr|call is now known as jistr15:28
*** ccamacho has quit IRC15:31
*** ccamacho has joined #openstack-nova15:32
*** k_mouza has joined #openstack-nova15:37
*** cfriesen has quit IRC15:37
gibigary_perkins: have you thought about mounting a cinder volume to each compute and use that space as nova's instance directory?15:41
gary_perkinsgibi: hmmm... that's an idea!15:42
*** mdbooth_ has joined #openstack-nova15:43
*** mdbooth_ is now known as mdbooth15:44
gary_perkinsgibi: thanks! I wasn't sure one could do that. I'll give that a try!15:45
*** diga has quit IRC15:46
*** k_mouza has quit IRC15:47
*** cfriesen has joined #openstack-nova15:55
*** Sundar has joined #openstack-nova16:03
*** k_mouza has joined #openstack-nova16:05
*** jangutter has quit IRC16:23
artomgibi, can you do that? I would have thought that Cinder volumes (control plane) wouldn't be accessible from the data plane (tenants)16:25
artomgary_perkins, there was a spec for flavor-enforced boot from volume16:25
artomLemme find it16:25
kashyapHi folks, wonder if anyone have the latest, minimal (only Nova, Keystone, Glance, Neutron) DevStack local.conf.16:25
kashyapCurrently I use: http://paste.openstack.org/show/735950/16:26
artomkashyap, wouldn't just putting enabled_services=blah be sufficient?16:26
artomThe defaults have worked for me16:26
kashyapartom: That's what I do: ENABLED_SERVICES=g-api,g-reg,key,n-api,n-cpu,placement-api,n-sch,n-cond,mysql,rabbit,dstat,quantum,q-svc,q-agt,q-dhcp,q-l3,q-meta16:26
artomkashyap, then I don't think you need anything else?16:27
kashyapI don't want all the needless crap to be installed on the system.  It's difficult to cut crap; but far easier to start minimal16:27
artomgary_perkins, https://review.openstack.org/#/c/511965/16:27
kashyapartom: Yeah, that's what I normally go with.  Writing up a bunch of scripts that setup live migration w/ non-shared storage from scratch in nested envs16:27
gary_perkinsthanks artom :)16:28
artomgary_perkins, abandoned because of lack of operator/user interest. Perhaps you could be the one drumming up support ;)16:28
*** lbragstad has joined #openstack-nova16:28
gibiartom: as far as I understand cinder volumes passed to a VM are also attached to the compute host and then the resulting device is passed to the VM via libvirt16:30
gibiartom: but I can be worng16:30
gibiwrong16:30
artomgibi, oh, right, yeah, I... I'm actually not sure what I understood from your idea16:32
artomFor some reason I thought the VMs would be mounting the volumes inside the guest OS16:32
jackdingjaypipes: Hi Jay, I have responded to your question on https://review.openstack.org/#/c/618542/16:36
gibiartom: my idea is to use cinder volumes as local disk providers for the compute host directlty16:38
artomgibi, right, so you'd mount the nova instances directly over iscsi or NFS or whatever from the volume's connection_info16:38
artomI guess? I'm not sure how supported that is. It seems weird to do that instead of deploying Ceph or something explicitly for this purpose16:39
*** lbragstad has quit IRC16:39
gibiartom: yeah deploy ceph would be the ideal solution, or using the cinder backend directly16:40
artomgibi, actually yeah, why not just use Cinder's backend directly.16:40
artomHrmm, would there be a way to set a compute node's disk capacity to 0?16:41
artomIt wouldn't make boot from volume transparent, but it would at least prevent local storage from being used.16:42
gary_perkinsartom: +116:42
*** tidwellr_ has quit IRC16:43
gary_perkinsyeah, I could just manually setup iscsid/tgt or user cinder. I just didn't know one could use cinder outside of OpenStack16:43
artomgary_perkins, not Cinder itself directly, I think. But Cinder's backend is what gibi was suggesting.16:44
gary_perkinsartom: ahhh, in my case that's just LVM16:44
artomgary_perkins, also, what version is this? Because you could also set disk_allocation_ratio to something really tiny to effectively reserve the vast majority of the computes's disks16:44
gary_perkinsI'm running Queens16:44
artomThat disk_allocation_hack would work with Queens, I think16:45
gary_perkinsbecause Rocky doesn't yet work on the Arm machines I'm using16:45
gibiartom: instead of allocation ratio you can use reserved_host_disk_mb to reserve disk16:45
gary_perkinsartom: thanks, I'll look into it16:46
artomgibi, hah, thanks, yeah, that's smarter :)16:46
*** udesale has quit IRC16:48
openstackgerritMatthew Booth proposed openstack/nova master: Workaround a race initialising version control in db_version()  https://review.openstack.org/61962216:55
*** helenafm has quit IRC16:59
*** artom has quit IRC17:09
*** artom has joined #openstack-nova17:10
*** mdbooth_ has joined #openstack-nova17:16
*** mdbooth has quit IRC17:19
*** mdbooth_ has quit IRC17:27
*** dtantsur is now known as dtantsur|afk17:35
*** k_mouza_ has joined #openstack-nova17:35
*** davidsha has quit IRC17:36
*** k_mouza_ has quit IRC17:36
*** tbachman has quit IRC17:38
*** k_mouza has quit IRC17:39
*** derekh has quit IRC18:01
*** jamesdenton has joined #openstack-nova18:04
*** k_mouza has joined #openstack-nova18:19
*** k_mouza has quit IRC18:23
*** salmankhan has quit IRC18:32
*** tssurya has quit IRC18:39
*** lpetrut has joined #openstack-nova18:46
*** Sundar has quit IRC19:23
*** sridharg has quit IRC19:43
*** rmart04 has joined #openstack-nova19:53
*** erlon has quit IRC20:03
*** rmart04 has left #openstack-nova20:16
*** imacdonn has joined #openstack-nova21:06
*** maciejjozefczyk has joined #openstack-nova21:07
*** ivve has quit IRC21:12
*** lpetrut has quit IRC21:23
*** slaweq has joined #openstack-nova21:23
*** dave-mccowan has joined #openstack-nova21:24
*** maciejjozefczyk has quit IRC21:27
*** dave-mccowan has quit IRC21:28
*** ralonsoh has quit IRC21:47
*** lbragstad has joined #openstack-nova21:54
*** rcernin has joined #openstack-nova22:05
*** xek_ has joined #openstack-nova22:06
*** xek has quit IRC22:09
*** slaweq has quit IRC22:15
*** xek__ has joined #openstack-nova22:25
*** xek_ has quit IRC22:27
*** mchlumsky has quit IRC22:42
*** lbragstad has quit IRC23:23
*** ileixe has quit IRC23:37
*** erlon has joined #openstack-nova23:42

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!