WARNING - OLD ARCHIVES

This is an archived copy of the Xen.org mailing list, which we have preserved to ensure that existing links to archives are not broken. The live archive, which contains the latest emails, can be found at http://lists.xen.org/
   
 
 
Xen 
 
Home Products Support Community News
 
   
 

xen-users

Re: [Xen-users] xen 3.3 -> tap:aio performance over nfs

To: C V <rayvittal-lists@xxxxxxxxx>
Subject: Re: [Xen-users] xen 3.3 -> tap:aio performance over nfs
From: Jia Rao <rickenrao@xxxxxxxxx>
Date: Fri, 30 Jan 2009 23:25:05 -0500
Cc: xen-users@xxxxxxxxxxxxxxxxxxx
Delivery-date: Fri, 30 Jan 2009 20:26:07 -0800
Dkim-signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:in-reply-to:references :date:message-id:subject:from:to:cc:content-type; bh=0biKwlqnxKxaks2+LDoBWBLY20FqdYA4C8hqJlHaviE=; b=npPqLfYhuUMnWi1E6ftNhozdSPbs85B4nGyQGCtb6ef6H7gjsgOSLq8Vf5Ig4vaTOD PjF5BacFgpq+psmsKTbTVF8sP1MHptP2P+Efh+xMo/8tckY6xJ5yxtwHtgngutrZt+d4 7K/16w1iKmAdZ25sE6v4L610t8wCe81ZcC4L8=
Domainkey-signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; b=S1y92PVVM6wg1O9QIW7ORMi9we6trkSH+ExBSls/uOmuCyZY7qw88UB7i2jwwunGcT HORG29vZfC247cHcx3VlBgzSNsato1UKBIktzXjQaaduV/C+ckQ6R87cp+fRStVKY1KG P5Yb58dEah8mJPlP9669VS8Tu4Y2ovDT93bY0=
Envelope-to: www-data@xxxxxxxxxxxxxxxxxxx
In-reply-to: <197060.7633.qm@xxxxxxxxxxxxxxxxxxxxxxxxxxx>
List-help: <mailto:xen-users-request@lists.xensource.com?subject=help>
List-id: Xen user discussion <xen-users.lists.xensource.com>
List-post: <mailto:xen-users@lists.xensource.com>
List-subscribe: <http://lists.xensource.com/mailman/listinfo/xen-users>, <mailto:xen-users-request@lists.xensource.com?subject=subscribe>
List-unsubscribe: <http://lists.xensource.com/mailman/listinfo/xen-users>, <mailto:xen-users-request@lists.xensource.com?subject=unsubscribe>
References: <197060.7633.qm@xxxxxxxxxxxxxxxxxxxxxxxxxxx>
Sender: xen-users-bounces@xxxxxxxxxxxxxxxxxxx
I am mounting file-based disk images (tap:aio) ) for VM from a nfs server (SATA, RAID 5) too. The link to the nfs server is a 1 G ethernet.
The read and write performance is also bad, all around 10M/s. The write size for the nfs client is set to 8K (I tested with different sizes, like 16K and 32K, similar performance).
Is there any way to optimize the disk-based VM performance? Currently there are 10+ VMs mounted to the nfs server and they include webservers, OLTP, and Java application servers.

Thanks.

On Fri, Jan 30, 2009 at 9:04 PM, C V <rayvittal-lists@xxxxxxxxx> wrote:
I've been getting disappointing performance for file-backed disks mounted using tap:aio over an NFS mount.
For example, bonnie++ reports 3 MB/s for block writes in the domU to
that
disk, but in dom0, bonnie++ reports 38 MB/s for that same mount. The
same domU can get 40 MB/s to the same filer using a phy: block device
over iSCSI .

It seems that
1. tap:aio causes synchronous writes to the nfs mount (6 writes, wait for ack, write 6 more etc) as opposed to NFSv3 async write
2. Each synchronous write writes very small blocks (4K bytes vs max of 32K bytes)

Is there any configuration option to tweak this behavior to get better-performing async writes to the filer?

Thanks
--
CV

_______________________________________________
Xen-users mailing list
Xen-users@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-users

_______________________________________________
Xen-users mailing list
Xen-users@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-users