WARNING - OLD ARCHIVES

This is an archived copy of the Xen.org mailing list, which we have preserved to ensure that existing links to archives are not broken. The live archive, which contains the latest emails, can be found at http://lists.xen.org/
   
 
 
Xen 
 
Home Products Support Community News
 
   
 

xen-devel

Re: [Xen-devel] xend / xenstored performance & scalability issues

To: Keir Fraser <Keir.Fraser@xxxxxxxxxxxx>
Subject: Re: [Xen-devel] xend / xenstored performance & scalability issues
From: "Daniel P. Berrange" <berrange@xxxxxxxxxx>
Date: Thu, 12 Oct 2006 15:46:17 +0100
Cc: xen-devel@xxxxxxxxxxxxxxxxxxx
Delivery-date: Thu, 12 Oct 2006 07:47:28 -0700
Envelope-to: www-data@xxxxxxxxxxxxxxxxxx
In-reply-to: <C15410C8.26E0%Keir.Fraser@xxxxxxxxxxxx>
List-help: <mailto:xen-devel-request@lists.xensource.com?subject=help>
List-id: Xen developer discussion <xen-devel.lists.xensource.com>
List-post: <mailto:xen-devel@lists.xensource.com>
List-subscribe: <http://lists.xensource.com/cgi-bin/mailman/listinfo/xen-devel>, <mailto:xen-devel-request@lists.xensource.com?subject=subscribe>
List-unsubscribe: <http://lists.xensource.com/cgi-bin/mailman/listinfo/xen-devel>, <mailto:xen-devel-request@lists.xensource.com?subject=unsubscribe>
References: <20061012141638.GA6878@xxxxxxxxxx> <C15410C8.26E0%Keir.Fraser@xxxxxxxxxxxx>
Reply-to: "Daniel P. Berrange" <berrange@xxxxxxxxxx>
Sender: xen-devel-bounces@xxxxxxxxxxxxxxxxxxx
User-agent: Mutt/1.4.1i
On Thu, Oct 12, 2006 at 03:33:28PM +0100, Keir Fraser wrote:
> On 12/10/06 15:16, "Daniel P. Berrange" <berrange@xxxxxxxxxx> wrote:
> 
> >   1. Why the need for xenstored to be doing any of this I/O in the first
> > place?
> >      If the DB needs to be kept on disk at all, it really needs to have a 
> > much
> >      saner update/transactional model to only update bits which actually
> > change,
> >      rather than re-creating the entire DB on every transaction.
> >      But it strikes me that the DB could potentially be kept entirely in
> > memory
> >      removing the disk I/O completely. Sure yyou wouldn't be able to restart
> >      the daemon then, but even today you can't restart xenstored & expect
> > things
> >      to still be working.
> 
> We plan to keep transactional state in memory, and commit to tdb only on
> transaction completion. In which case you'll be able to achieve what you
> describe above by keeping the tdb file in a ramdisk. I suspect that'll turn
> out to be unnecessary and once we keep a persistent handle on a single tdb
> file and only update what has changed, we'll find the buffer cache will work
> quite nicely.

Agreed,that sounds like it ought to be able to significantly reduce overhead
without neccessarily needing to go to a purely memory backed storage.

Regards,
Dan.
-- 
|=- Red Hat, Engineering, Emerging Technologies, Boston.  +1 978 392 2496 -=|
|=-           Perl modules: http://search.cpan.org/~danberr/              -=|
|=-               Projects: http://freshmeat.net/~danielpb/               -=|
|=-  GnuPG: 7D3B9505   F3C9 553F A1DA 4AC2 5648 23C1 B3DF F742 7D3B 9505  -=| 

_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-devel