This is an archived copy of the Xen.org mailing list, which we have preserved to ensure that existing links to archives are not broken. The live archive, which contains the latest emails, can be found at http://lists.xen.org/
Home Products Support Community News


Re: [Xen-devel] [PATCH 0/6] xen,xend,tools: NUMA support for Xen

To: Keir Fraser <Keir.Fraser@xxxxxxxxxxxx>
Subject: Re: [Xen-devel] [PATCH 0/6] xen,xend,tools: NUMA support for Xen
From: Ryan Harper <ryanh@xxxxxxxxxx>
Date: Tue, 11 Jul 2006 12:47:06 -0500
Cc: xen-devel@xxxxxxxxxxxxxxxxxxx
Delivery-date: Tue, 11 Jul 2006 10:47:30 -0700
Envelope-to: www-data@xxxxxxxxxxxxxxxxxx
In-reply-to: <86615345f6064a8e6b78321d3d8a7313@xxxxxxxxxxxx>
List-help: <mailto:xen-devel-request@lists.xensource.com?subject=help>
List-id: Xen developer discussion <xen-devel.lists.xensource.com>
List-post: <mailto:xen-devel@lists.xensource.com>
List-subscribe: <http://lists.xensource.com/cgi-bin/mailman/listinfo/xen-devel>, <mailto:xen-devel-request@lists.xensource.com?subject=subscribe>
List-unsubscribe: <http://lists.xensource.com/cgi-bin/mailman/listinfo/xen-devel>, <mailto:xen-devel-request@lists.xensource.com?subject=unsubscribe>
References: <20060711153547.GF1694@xxxxxxxxxx> <86615345f6064a8e6b78321d3d8a7313@xxxxxxxxxxxx>
Sender: xen-devel-bounces@xxxxxxxxxxxxxxxxxxx
User-agent: Mutt/1.5.6+20040907i
* Keir Fraser <Keir.Fraser@xxxxxxxxxxxx> [2006-07-11 10:59]:
> On 11 Jul 2006, at 16:35, Ryan Harper wrote:
> >Reposting the latest patches, no significant changes since May when I
> >last received feedback.  I've done some simple overhead and performance
> >numbers for these patches.
> >
> >Measuring NUMA allocator patch overhead via balloon driver and DOM0
> >involved starting DOM0 with all memory (4G) and ballooning down (256M)
> >as a starting point, [1]tracking the time it takes to balloon back up
> >to full memory.  The test was done with and without NUMA patches.
> What sort of box are these numbers taken from? If it's not a NUMA 
> system then the slowdowns are rather poor. We're particularly 
> interested in not slowing down non-NUMA and small-NUMA (e.g., AMD K8) 
> x86 systems. They are what we really want to see measurements from.

The measurements are taken from a two-way Operton 248 (2.1Ghz) ,
small-NUMA.  I agree that there is significant overhead, however, we
aren't talking about fast path here; correct me if I'm wrong.   We
are only adding overhead to during domain startup.  The end result
being we pay for local memory allocation at creation time while
benefiting from local memory access for the lifetime of the domain.

I'm going to gather some oprofile data to see if I missed something
obvious, but in general I think that having local memory is of greater
benefit for the lifetime of a domain than the cost we incur during its

Ryan Harper
Software Engineer; Linux Technology Center
IBM Corp., Austin, Tx
(512) 838-9253   T/L: 678-9253

Xen-devel mailing list