WARNING - OLD ARCHIVES

This is an archived copy of the Xen.org mailing list, which we have preserved to ensure that existing links to archives are not broken. The live archive, which contains the latest emails, can be found at http://lists.xen.org/
   
 
 
Xen 
 
Home Products Support Community News
 
   
 

xen-devel

Re: [Xen-devel] Re: [PATCH 0 of 6] dm-userspace xen integrationpatches

To: Julian Chesterfield <jac90@xxxxxxxxx>
Subject: Re: [Xen-devel] Re: [PATCH 0 of 6] dm-userspace xen integrationpatches
From: Dan Smith <danms@xxxxxxxxxx>
Date: Tue, 29 Aug 2006 17:41:43 -0700
Cc: Ian Pratt <m+Ian.Pratt@xxxxxxxxxxxx>, Xen Devel <xen-devel@xxxxxxxxxxxxxxxxxxx>
Delivery-date: Tue, 29 Aug 2006 17:42:12 -0700
Envelope-to: www-data@xxxxxxxxxxxxxxxxxx
In-reply-to: <5387538162cf71ab288d1387dca9240a@xxxxxxxxx> (Julian Chesterfield's message of "Wed, 30 Aug 2006 00:47:06 +0100")
List-help: <mailto:xen-devel-request@lists.xensource.com?subject=help>
List-id: Xen developer discussion <xen-devel.lists.xensource.com>
List-post: <mailto:xen-devel@lists.xensource.com>
List-subscribe: <http://lists.xensource.com/cgi-bin/mailman/listinfo/xen-devel>, <mailto:xen-devel-request@lists.xensource.com?subject=subscribe>
List-unsubscribe: <http://lists.xensource.com/cgi-bin/mailman/listinfo/xen-devel>, <mailto:xen-devel-request@lists.xensource.com?subject=unsubscribe>
References: <A95E2296287EAD4EB592B5DEEFCE0E9D5725AC@xxxxxxxxxxxxxxxxxxxxxxxxxxx> <m3mz9n8uit.fsf@xxxxxxxxxxxxxxxxxxxxxxxxxxx> <5387538162cf71ab288d1387dca9240a@xxxxxxxxx>
Sender: xen-devel-bounces@xxxxxxxxxxxxxxxxxxx
User-agent: Gnus/5.110006 (No Gnus v0.6) Emacs/21.4 (gnu/linux)
JC> Your new CoW driver, however doesn't handle allocation, it just
JC> assumes a CoW volume that's as big as the original disk

Correct, it does not do sparse allocation.  Sparse allocation does not
make any sense on a fixed-size block device.  Note that it has nothing
to do with how the rest of the dm-userspace/cowd system works.  When
using the prototype qcow plugin to cowd, sparse allocation is
performed as you would expect.

JC> and uses a bitmap to optimize lookups.  

It does not use a bitmap to optimize lookups, it uses a bitmap as the
metadata to record which blocks have been mapped.  It also determines
where the block is located in the CoW volume, as this can be
determined from the block size and the bit number.

JC> Given that you seem to be assuming that the block device is
JC> providing sparse allocation and dynamic disk resizing for you,

No, I'm not assuming this.  With this current format plugin, we are
just assuming a fully-allocated block device (such as a LVM, or a
simple iSCSI device).

JC> isn't it likely that such devices would already provide low-level
JC> support for CoW and disk snapshotting? 

Some do, but plenty do not.  However, being able to do snapshots, CoW,
rollback, etc while easily synchronizing with other pieces of Xen is
something that will be simpler with dm-userspace than with a hardware
device.  It also allows us to provide the same advanced features, no
matter what device we are working on top of, and independent of
whether or not it supports them.

JC> Qcow provides both sparse support and CoW functionality.

Sparse allocation and control of block devices (i.e. growing an LVM as
we need it for a growing CoW storage) is definitely something that is
on our radar.  We are just not there yet.

I should mention here that I am not fighting for a format here.  The
plugin that is the default in cowd right now (dscow) implements a very
simple format geared at speed and simplicity.  It has limitations and
we understand that.  It is not intended to be the CoW format of the
future :)

JC> What's the policy on metadata writes - are metadata writes
JC> synchronised with the acknowledgement of block IO requests?

Yes.  Ian asked for this the last time we posted our code.  We have
worked hard to implement this ability in dm-userspace/cowd between the
time we posted our original version and our recent post.

While the normal persistent domain case definitely needs this to be
"correct", there are other usage models for virtual machines that do
not necessarily need to have a persistent disk store.  We are able to
disable the metadata syncing (and the metadata writing altogether if
desired) and regain a lot of speed.

-- 
Dan Smith
IBM Linux Technology Center
Open Hypervisor Team
email: danms@xxxxxxxxxx

Attachment: pgpGXEPYOe7w0.pgp
Description: PGP signature

_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-devel