WARNING - OLD ARCHIVES

This is an archived copy of the Xen.org mailing list, which we have preserved to ensure that existing links to archives are not broken. The live archive, which contains the latest emails, can be found at http://lists.xen.org/
   
 
 
Xen 
 
Home Products Support Community News
 
   
 

xen-devel

Re: [Xen-devel] vnif socket buffer mistaken for pagetable page causes ma

To: Gianluca Guida <gianluca.guida@xxxxxxxxxxxxx>
Subject: Re: [Xen-devel] vnif socket buffer mistaken for pagetable page causes major performance problem
From: Herbert van den Bergh <Herbert.van.den.Bergh@xxxxxxxxxx>
Date: Mon, 08 Jun 2009 09:22:10 -0700
Cc: Dan Magenheimer <dan.magenheimer@xxxxxxxxxx>, "Xen-Devel \(E-mail\)" <xen-devel@xxxxxxxxxxxxxxxxxxx>
Delivery-date: Tue, 09 Jun 2009 09:03:36 -0700
Envelope-to: www-data@xxxxxxxxxxxxxxxxxxx
In-reply-to: <4A2CD5B3.4090700@xxxxxxxxxxxxx>
List-help: <mailto:xen-devel-request@lists.xensource.com?subject=help>
List-id: Xen developer discussion <xen-devel.lists.xensource.com>
List-post: <mailto:xen-devel@lists.xensource.com>
List-subscribe: <http://lists.xensource.com/mailman/listinfo/xen-devel>, <mailto:xen-devel-request@lists.xensource.com?subject=subscribe>
List-unsubscribe: <http://lists.xensource.com/mailman/listinfo/xen-devel>, <mailto:xen-devel-request@lists.xensource.com?subject=unsubscribe>
References: <2ee9aac0-0772-4306-a9e5-bf711cf2c2d8@default> <4A2CD5B3.4090700@xxxxxxxxxxxxx>
Sender: xen-devel-bounces@xxxxxxxxxxxxxxxxxxx
User-agent: Thunderbird 2.0.0.21 (X11/20090409)


Gianluca Guida wrote:
Hi,

Sorry for the late reply,

Dan Magenheimer wrote:
A recent posting reminded me of this and, though the
information is a bit vague, someone familiar with the
shadow code might know just where to look to fix this,
hopefully in time for 3.4 (if its not already fixed).

One of our performance experts discovered a strange
major network performance hit seen only under certain
circumstances, IIRC mostly in HVM but sometimes in
PV when migrating.

With some help from Intel, it was determined that
the heuristics used by shadow paging to determine
whether a guest is modifying a pagetable page were
getting fooled by the access pattern used by the
code that copies data into a newly allocated socket
buffer.  As a result, many unnecessary vmenter/vmexits
were happening.

The workaround was to preallocate all socket buffer
memory.

That's all I've got, but we can try to answer questions
if this isn't already a known fixed problem.

Can you be a little more specific about what is the performance loss,
Network throughput was reduced to 10% of normal.
in what workload,
A network send throughput test using netperf.
and what heuristic you found to be wrong in this case?
The access pattern to the memory page that was recognized as a pagetable access was a regular memcpy doing 4 byte aligned writes into a newly allocated page. I'm not that familiar with the shadow pagetable code, so I don't know how "wrong" this is, just that it caused a false positive on this type of memory access.

Thanks,
Herbert.


_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-devel