WARNING - OLD ARCHIVES

This is an archived copy of the Xen.org mailing list, which we have preserved to ensure that existing links to archives are not broken. The live archive, which contains the latest emails, can be found at http://lists.xen.org/
   
 
 
Xen 
 
Home Products Support Community News
 
   
 

xen-devel

[Xen-devel] Poor HVM performance with 8 vcpus

To: "xen-devel@xxxxxxxxxxxxxxxxxxx" <xen-devel@xxxxxxxxxxxxxxxxxxx>
Subject: [Xen-devel] Poor HVM performance with 8 vcpus
From: Juergen Gross <juergen.gross@xxxxxxxxxxxxxx>
Date: Wed, 07 Oct 2009 08:55:05 +0200
Delivery-date: Tue, 06 Oct 2009 23:55:44 -0700
Dkim-signature: v=1; a=rsa-sha256; c=simple/simple; d=ts.fujitsu.com; i=juergen.gross@xxxxxxxxxxxxxx; q=dns/txt; s=s1536b; t=1254898715; x=1286434715; h=from:sender:reply-to:subject:date:message-id:to:cc: mime-version:content-transfer-encoding:content-id: content-description:resent-date:resent-from:resent-sender: resent-to:resent-cc:resent-message-id:in-reply-to: references:list-id:list-help:list-unsubscribe: list-subscribe:list-post:list-owner:list-archive; z=From:=20Juergen=20Gross=20<juergen.gross@xxxxxxxxxxxxxx> |Subject:=20Poor=20HVM=20performance=20with=208=20vcpus |Date:=20Wed,=2007=20Oct=202009=2008:55:05=20+0200 |Message-ID:=20<4ACC3B49.4060500@xxxxxxxxxxxxxx>|To:=20"x en-devel@xxxxxxxxxxxxxxxxxxx"=20<xen-devel@xxxxxxxxxxxxxx e.com>|MIME-Version:=201.0|Content-Transfer-Encoding:=207 bit; bh=rODqycjbSIn+wGU25x/uVJnR/NFYVwdB92p6h0tC1wc=; b=c3aQIzpeX8+aBkJQjX8oD1IIhdIqySyBc1mSjXDYW1pofbhO2zUuW/se Kx1f3/IFT+XrsrBAWdZxF85NLdmh0InQOdHEfauHBQzd62LWsCy/Iub+6 LWiqijxcDVbddjXSqVA4TbkCTkHPKY4/TAy/BbaYI3Y6rt+6IpBt6Rkal DAbtm7S3YGaOMbau9fyopVGESloDYr2WQx8/BawZoGEX0PEQoUC6kZF6G AYMtOC//BDgSRIeIvI7BjoTZm6Ofo;
Domainkey-signature: s=s1536a; d=ts.fujitsu.com; c=nofws; q=dns; h=X-SBRSScore:X-IronPort-AV:Received:X-IronPort-AV: Received:Received:Message-ID:Date:From:Organization: User-Agent:MIME-Version:To:Subject:X-Enigmail-Version: Content-Type:Content-Transfer-Encoding; b=iq/ETwBhAS4gLMwzAmX9dTgMzGgmpioVFjHmDf2phBn7BWNN7eFXTLEQ K4NRJ9fwyCh0VHuMt/VHoVj6IRMTaRmUlffbupOA4sc/XfFi+1wJjuIZk ulPSJJcOQIiHCNI2GDKF56RC846kE2r7InN4clVfaFpUH/qHwScA0+vWS 4V7YzL9CXDlqbGwtIhDIyHiZVqShRzMvrFuqaDsTGwYxHFqzY66Oo9ZTH tsj0SCGTO6aevpxOKPo/iGeeV/+9L;
Envelope-to: www-data@xxxxxxxxxxxxxxxxxxx
List-help: <mailto:xen-devel-request@lists.xensource.com?subject=help>
List-id: Xen developer discussion <xen-devel.lists.xensource.com>
List-post: <mailto:xen-devel@lists.xensource.com>
List-subscribe: <http://lists.xensource.com/mailman/listinfo/xen-devel>, <mailto:xen-devel-request@lists.xensource.com?subject=subscribe>
List-unsubscribe: <http://lists.xensource.com/mailman/listinfo/xen-devel>, <mailto:xen-devel-request@lists.xensource.com?subject=unsubscribe>
Organization: Fujitsu Technology Solutions
Sender: xen-devel-bounces@xxxxxxxxxxxxxxxxxxx
User-agent: Mozilla-Thunderbird 2.0.0.22 (X11/20090707)
Hi,

we've got massive performance problems running a 8 vcpu HVM-guest (BS2000)
under XEN (xen 3.3.1).

With a specific benchmark producing a rather high load on memory management
operations (lots of process creation/deletion and memory allocation) the 8
vcpu performance was worse than the 4 vcpu performance. On other platforms
(/390, MIPS, SPARC) this benchmark scaled rather well with the number of cpus.

The result of the usage of the software performance counters of XEN seemed
to point to the shadow lock being the reason. I modified the Hypervisor to
gather some lock statistics (patch will be sent soon) and found that the
shadow lock is really the bottleneck. On average 4 vcpus are waiting to get
the lock!

Is this a known issue?
Is there a chance to split the shadow lock into sub-locks or to use a
reader/writer lock instead?
I just wanted to ask before trying to understand all of the shadow code :-)


Juergen

-- 
Juergen Gross                 Principal Developer Operating Systems
TSP ES&S SWE OS6                       Telephone: +49 (0) 89 636 47950
Fujitsu Technolgy Solutions               e-mail: juergen.gross@xxxxxxxxxxxxxx
Otto-Hahn-Ring 6                        Internet: ts.fujitsu.com
D-81739 Muenchen                 Company details: ts.fujitsu.com/imprint.html

_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-devel