This is an archived copy of the Xen.org mailing list, which we have preserved to ensure that existing links to archives are not broken. The live archive, which contains the latest emails, can be found at http://lists.xen.org/
Home Products Support Community News


[Xen-devel] Re: [PATCH 2/4] [HVM] introduce CPU affinity for allocate_ph

To: "Andre Przywara" <andre.przywara@xxxxxxx>
Subject: [Xen-devel] Re: [PATCH 2/4] [HVM] introduce CPU affinity for allocate_physmap call
From: Andi Kleen <andi@xxxxxxxxxxxxxx>
Date: 15 Aug 2007 13:18:10 +0200
Cc: Christoph Egger <christoph.egger@xxxxxxx>, Ryan Harper <ryanh@xxxxxxxxxx>, Keir Fraser <keir@xxxxxxxxxxxxx>, xen-devel@xxxxxxxxxxxxxxxxxxx
Delivery-date: Fri, 17 Aug 2007 10:02:27 -0700
Envelope-to: www-data@xxxxxxxxxxxxxxxxxx
In-reply-to: <46C2D1A8.1030001@xxxxxxx>
List-help: <mailto:xen-devel-request@lists.xensource.com?subject=help>
List-id: Xen developer discussion <xen-devel.lists.xensource.com>
List-post: <mailto:xen-devel@lists.xensource.com>
List-subscribe: <http://lists.xensource.com/cgi-bin/mailman/listinfo/xen-devel>, <mailto:xen-devel-request@lists.xensource.com?subject=subscribe>
List-unsubscribe: <http://lists.xensource.com/cgi-bin/mailman/listinfo/xen-devel>, <mailto:xen-devel-request@lists.xensource.com?subject=unsubscribe>
References: <200708131459.31305.Christoph.Egger@xxxxxxx> <C2E623FF.1419B%keir@xxxxxxxxxxxxx> <20070813204947.GC1228@xxxxxxxxxx> <46C2D1A8.1030001@xxxxxxx>
Sender: xen-devel-bounces@xxxxxxxxxxxxxxxxxxx
User-agent: Gnus/5.09 (Gnus v5.9.0) Emacs/21.3
"Andre Przywara" <andre.przywara@xxxxxxx> writes:

> Ryan Harper wrote:
> > One concern has been the static nature of the ACPI SRAT data versus the
> > dynamic ability of the vcpu to cpu mapping.  If the scheduler is
> > migrating the guest vcpu to various cpus, then the SRAT information is
> > likely to be incorrect.
> I think this is a problem even for the native OSes when you think of
> CPU- and/or memory-hotplugging. Although Linux can do CPU hotplugging,
> AFAIK NUMA isn't currently considered in this process. 

IA64 (and I think PPC) Linux support node hotplug. Node hot unplug
is currently missing because the memory hotunplug support is not finished
yet. There is no interface to notify NUMA aware user space of topology
changes though.

x86 Linux currently doesn't but will assign new CPUs to existing
nodes as reported in SRAT.

> I think the
> most feasible approach would be to rebuild all affected structures
> when the hotplug event occurs. This will probably considered quite
> rare and thus could be potentially more costly, so I this is not
> something you want to do every time Xen decides to reschedule a
> VCPU. 

In the current Linux implementation just report all nodes at boot up
(even if they have little or no memory) and then you can add/remove CPUs to 
them as needed. 

When you migrate to another box with more nodes that likely won't work,
but that could be probably made configurable.


Xen-devel mailing list