WARNING - OLD ARCHIVES

This is an archived copy of the Xen.org mailing list, which we have preserved to ensure that existing links to archives are not broken. The live archive, which contains the latest emails, can be found at http://lists.xen.org/
   
 
 
Xen 
 
Home Products Support Community News
 
   
 

xen-tools

Re: [Xen-devel] Hi,something about the xentrace tool

To: "Rob Gardner" <rob.gardner@xxxxxx>
Subject: Re: [Xen-devel] Hi,something about the xentrace tool
From: "George Dunlap " <dunlapg@xxxxxxxxx>
Date: Mon, 19 Jun 2006 10:02:15 -0400
Cc: xen-tools@xxxxxxxxxxxxxxxxxxx, xen-devel@xxxxxxxxxxxxxxxxxxx
Delivery-date: Mon, 19 Jun 2006 07:02:38 -0700
Domainkey-signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:message-id:date:from:sender:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references:x-google-sender-auth; b=CgBTclZQsk5Pt+eKP9dm7V3S5B2EfS4WotJDtvKXYjC3+fPbMJcTca/GrpLkwMq+Agry3LLRkA/6Ush/IYNTjBm82vYfHhFSuMLOALNsDyMy4TjMccS0kerqARoNkkgjd+1wrfvw1nuWww1NdrUD+lVP/xQdpSNKsRiU2d/9yU4=
Envelope-to: www-data@xxxxxxxxxxxxxxxxxx
In-reply-to: <44962F85.4060005@xxxxxx>
List-help: <mailto:xen-devel-request@lists.xensource.com?subject=help>
List-id: Xen developer discussion <xen-devel.lists.xensource.com>
List-post: <mailto:xen-devel@lists.xensource.com>
List-subscribe: <http://lists.xensource.com/cgi-bin/mailman/listinfo/xen-devel>, <mailto:xen-devel-request@lists.xensource.com?subject=subscribe>
List-unsubscribe: <http://lists.xensource.com/cgi-bin/mailman/listinfo/xen-devel>, <mailto:xen-devel-request@lists.xensource.com?subject=unsubscribe>
References: <A95E2296287EAD4EB592B5DEEFCE0E9D4BAAAA@xxxxxxxxxxxxxxxxxxxxxxxxxxx> <8061f8830606150158m35f11025t43c3fa962ccd6679@xxxxxxxxxxxxxx> <449192E1.4080808@xxxxxx> <de76405a0606151120m5f333609s126bda4d33e73ef@xxxxxxxxxxxxxx> <4491AC9A.2090906@xxxxxx> <de76405a0606181806y4d08998ua680342c561be6d0@xxxxxxxxxxxxxx> <44962F85.4060005@xxxxxx>
Sender: xen-devel-bounces@xxxxxxxxxxxxxxxxxxx
On 6/19/06, Rob Gardner <rob.gardner@xxxxxx> wrote:
Stdio is there for a reason; Doing lots of raw I/O using
very small buffers is highly inefficient.

You misunderstand me. :-)  I meant to write out (via DMA) several
pages at a time, straight from the HV trace buffers.  The default tbuf
size in xentrace is 20 pages, so if (as the plan is) xentrace would be
notified when it would be half full, we could easily write out 10
pages in one transaction.  The tbuf size could be increased if DMA
setup/teardown overhead were an issue on that scale.

You're right, for traces that fit in the file cache, buffering is a
big win.  The copy overhead is negligible, writes to disk are more
efficient, and the data will be in the file cache for reading for
subsequent analysis.  But for traces that won't fit in the file cache,
the best thing would be to get them to disk with as little copying and
cache-trashing as possible.

Some of my recent traces have been on the order of 10 gigabytes.  I
haven't done much to modify xentrace, because I'm not worried about
the trace overhead at this point.  But I've had to pull some tricks to
get my analysis tools to run in anything like a reasonable amount of
time.

-George

_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-devel