[Xen-users] Re: Virtualization vs. Cassandra and Hadloop

To:	common-user@xxxxxxxxxxxxxxxxx
Subject:	[Xen-users] Re: Virtualization vs. Cassandra and Hadloop
From:	Edward Capriolo <edlinuxguru@xxxxxxxxx>
Date:	Fri, 7 May 2010 11:24:11 -0400
Cc:	user@xxxxxxxxxxxxxxxxxxxx, thrift-user@xxxxxxxxxxxxxxxxxxxx, xen-users@xxxxxxxxxxxxxxxxxxx
Delivery-date:	Mon, 10 May 2010 07:38:36 -0700
Dkim-signature:	v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:received:in-reply-to :references:date:message-id:subject:from:to:cc:content-type; bh=z6DNzwC765CS1TSk2MV2Gfottm3MA0ZXN/tHgeUjmSg=; b=wpERlROFEhhMmux6HHfTqNviGBKJb1sZxO/k65STn+u2xBl46eDcGyjJwCF/QIfq53 Ao1L0l7avT3+p4xEit7NP3siOnSAWfrOFoPOhiTGgkYpylPro1cRxVneWK4T5Q070kVX +4Nwj7bjv1GUQu2c0V5jUUa+aVoO9Oaezwsfk=
Domainkey-signature:	a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; b=EDs/jZ47iVn6Q8J0evy4ure6/aKstXOYUQNqOVHa+L/pMV/HAHfefEbjTOR4zA+5SE 58KgG2h+WLn/mP2oiuVzN0EJlVCsJKpkm/hZ5UxpDsrWtyJU5qFb5ux7FiKa8CPeJrri 9dEDCfCbcQR21vjyrsOqONpx9Jfng29KmHkZ8=
Envelope-to:	www-data@xxxxxxxxxxxxxxxxxxx
In-reply-to:	<582307.73807.qm@xxxxxxxxxxxxxxxxxxxxxxxxxxx>
List-help:	<mailto:xen-users-request@lists.xensource.com?subject=help>
List-id:	Xen user discussion <xen-users.lists.xensource.com>
List-post:	<mailto:xen-users@lists.xensource.com>
List-subscribe:	<http://lists.xensource.com/mailman/listinfo/xen-users>, <mailto:xen-users-request@lists.xensource.com?subject=subscribe>
List-unsubscribe:	<http://lists.xensource.com/mailman/listinfo/xen-users>, <mailto:xen-users-request@lists.xensource.com?subject=unsubscribe>
References:	<582307.73807.qm@xxxxxxxxxxxxxxxxxxxxxxxxxxx>
Sender:	xen-users-bounces@xxxxxxxxxxxxxxxxxxx

On Thu, May 6, 2010 at 10:02 PM, Dennis <arsenepark@xxxxxxxxxxxx> wrote:

Please check out this PNG image from attachment or from Google docs: http://docs.google.com/drawings/pub?id=1P3jdSddseG1oSYrtjREWcajizxmxoRIhUHCEw4sDi3k&w=771&h=624

So, what I want to do is something like a private cloud storage solution.
I belive the http servers and application servers should be set up on virtual VMs, but what about the Cassandra and Hadloop servers, should their be set up on VMs or directly on physical machines? If they should be set up on VMs, the data of Cassandra and Hadloop should be stored in local storage or a Storage Repository?

Thanks,
Dennis

Dennis,

Looks like fun :)

Either architect is fine depending on your usage patterns. I have tried running cassandra on non-dedicated nodes. I have noticed that if cassandra gets CPU starved the gossip protocol detects nodes as down and that is a bad thing. so the danger is that very CPU intensive Hadoop jobs could starve our cassandra. Cassandra runs pretty even as I see except when it does its anti-compaction and repairs.

_______________________________________________
Xen-users mailing list
Xen-users@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-users

WARNING - OLD ARCHIVES

xen-users

[Xen-users] Re: Virtualization vs. Cassandra and Hadloop