WARNING - OLD ARCHIVES

This is an archived copy of the Xen.org mailing list, which we have preserved to ensure that existing links to archives are not broken. The live archive, which contains the latest emails, can be found at http://lists.xen.org/
   
 
 
Xen 
 
Home Products Support Community News
 
   
 

xen-devel

Re: [Xen-devel] Re: how to avoid lost trace records?

To: Olaf Hering <olaf@xxxxxxxxx>
Subject: Re: [Xen-devel] Re: how to avoid lost trace records?
From: George Dunlap <dunlapg@xxxxxxxxx>
Date: Mon, 22 Nov 2010 11:53:33 +0000
Cc: xen-devel@xxxxxxxxxxxxxxxxxxx
Delivery-date: Mon, 22 Nov 2010 03:54:10 -0800
Dkim-signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:sender:received :in-reply-to:references:date:x-google-sender-auth:message-id:subject :from:to:cc:content-type:content-transfer-encoding; bh=js7GCN27VQ+ICGLZC3FLEbuYdtAcfjeKXnjfkWIEIsE=; b=C6Tt4C51tAtEcxbIl1+CyNtwJ111Xjx5KjESB56/xv9j7X89KkK3+ElpHr2yMAL/SF vyeS0OgVHZw01odImhwTJ2uLdKLFKYQfz9kYIMUldrREbzGeRUwTBPox0Wv3cNO4jx1x fYdcwA+ppoBc7MylSbFFoj3jDnrIUfm4MfBZI=
Domainkey-signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:cc:content-type :content-transfer-encoding; b=PmvvB0t8x6+kK7CEKx23TvqB3L4a/TMorV3efJ63Njp5yfcrmG9aRw7rbW0XyoqgJ2 heHUxedjJmbyM6NWtxAjhwigsYhgH9xSYjXrXo7RcJC2/sjXt5H1+gEHbeMJEXJ/1ZCR bSV+YN+xfQnzHqOmGcCP+USRgFgy1kpmdsZDE=
Envelope-to: www-data@xxxxxxxxxxxxxxxxxxx
In-reply-to: <20101120202122.GA31616@xxxxxxxxx>
List-help: <mailto:xen-devel-request@lists.xensource.com?subject=help>
List-id: Xen developer discussion <xen-devel.lists.xensource.com>
List-post: <mailto:xen-devel@lists.xensource.com>
List-subscribe: <http://lists.xensource.com/mailman/listinfo/xen-devel>, <mailto:xen-devel-request@lists.xensource.com?subject=subscribe>
List-unsubscribe: <http://lists.xensource.com/mailman/listinfo/xen-devel>, <mailto:xen-devel-request@lists.xensource.com?subject=unsubscribe>
References: <20101119154652.GA11544@xxxxxxxxx> <20101120202122.GA31616@xxxxxxxxx>
Sender: xen-devel-bounces@xxxxxxxxxxxxxxxxxxx
Olaf,

Dang, 8 megs per cpu -- but I guess that's really not so much overhead
on a big machine; and it's definitely worth getting around the lost
records issue.  Send the T_INFO_PAGES patch to the list, and see what
Keir thinks.

There's probably a way to modify xenalyze to do start up gzip
directly; may not be a bad idea.

 -George

On Sat, Nov 20, 2010 at 8:21 PM, Olaf Hering <olaf@xxxxxxxxx> wrote:
> On Fri, Nov 19, Olaf Hering wrote:
>
>>
>> Today I inspected the xenalyze and the dump-raw output and noticed that
>> huge number of lost trace records, even when booted with tbuf_size=200:
>>
>> grep -wn 1f001 log.sles11_6.xentrace.txt.dump-raw
>> 274438:R p 5 o000000000063ffd4    1f001 4 t0000006d215b3c6b [ b6aed 57fff 
>> 9e668fb6 51 ]
> ...
>> That means more than 740K lost entries on cpu5,3,2,1,0.
>> Is this expected?
>
> After reading the sources more carefully, its clear now.
> There are a few constraints:
>
> If booted with tbuf_size=N, tracing starts right away and fills up the
> buffer until xentrace collects its content. So entries will be lost.
>
> Once I just ran xentrace -e all > output, which filled up the whole disk
> during my testing. So I changed the way to collect the output to a
> compressed file:
>
>  # mknod pipe p
>  # gzip -v9 < pipe > output.gz &
>  # xentrace -e all pipe &
>
> This means xentrace will stall until gzip has made room in the pipe.
> Which also means xentrace cant collect more data from the tracebuffer
> while waiting. So that is the reason for the lost entries.
>
> Now I changed T_INFO_PAGES in trace.c from 2 to 16, and reduced the
> compression rate to speedup gzip emptying the pipe.
>
>  # mknod pipe p
>  # nice -n -19 gzip -v1 < pipe > output.gz &
>  # nice -n -19 xentrace -s 1 -S 2031 -e $(( 0x10f000 )) pipe &
>
>
> This means no more lost entries even with more than one guest running.
>
>
> Olaf
>
>
> _______________________________________________
> Xen-devel mailing list
> Xen-devel@xxxxxxxxxxxxxxxxxxx
> http://lists.xensource.com/xen-devel
>

_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-devel