This is an archived copy of the Xen.org mailing list, which we have preserved to ensure that existing links to archives are not broken. The live archive, which contains the latest emails, can be found at http://lists.xen.org/
Home Products Support Community News


Re: [Xen-devel] Memory de-duplication (Persistent pages)

To: Xen-devel <Xen-devel@xxxxxxxxxxxxxxxxxxx>
Subject: Re: [Xen-devel] Memory de-duplication (Persistent pages)
From: Kaustubh Kabra <kaustubhwise@xxxxxxxxx>
Date: Thu, 16 Sep 2010 00:39:00 +0530
Cc: Dan Magenheimer <dan.magenheimer@xxxxxxxxxx>
Delivery-date: Wed, 15 Sep 2010 12:09:51 -0700
Dkim-signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:received:in-reply-to :references:date:message-id:subject:from:to:cc:content-type; bh=cYFkaIdTocN9IOIfB76WfNCrSr3jqYME7UeZZUTMimI=; b=WLlxt6RNk1YKBswxH8BcrpTz9YZKWlneLFn2kMtPTWNeW8mvZqcU8IG7VA5TVUpDma 54EQz86loQI+hJiXeW+IexqcqQyTqLsY9wcFVrekJEJ1wW5WDt+8A87l8fgui5lnJK31 xtX7vib99BoXHfJAm801kfkFKwr/9um2xmgQQ=
Domainkey-signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; b=gpVJGDMkiemsplJvVy7jgf61oh7pBjtaoICkxPA6ia6LqBCd4d/PCcb1snjZaQCHrH x0Exvm1xs3qYSlRgNRo6cQHKS92HXEZAwbAWaasjWC5bsxzTYr3ylkxNg0CLL7lYeFPs AooPyXTW/N3FzrTQqo2UzXSNaRL91TAeKpG6Q=
Envelope-to: www-data@xxxxxxxxxxxxxxxxxxx
In-reply-to: <a7f686b6-d95d-429b-9d91-f1bcaf1934fd@default>
List-help: <mailto:xen-devel-request@lists.xensource.com?subject=help>
List-id: Xen developer discussion <xen-devel.lists.xensource.com>
List-post: <mailto:xen-devel@lists.xensource.com>
List-subscribe: <http://lists.xensource.com/mailman/listinfo/xen-devel>, <mailto:xen-devel-request@lists.xensource.com?subject=subscribe>
List-unsubscribe: <http://lists.xensource.com/mailman/listinfo/xen-devel>, <mailto:xen-devel-request@lists.xensource.com?subject=unsubscribe>
References: <AANLkTinAdznx33YkjkHTLweZm=kdmOYXP05qP6SHwZm-@xxxxxxxxxxxxxx> <a7f686b6-d95d-429b-9d91-f1bcaf1934fd@default>
Sender: xen-devel-bounces@xxxxxxxxxxxxxxxxxxx
To solve memory deduplication in Xen using Gpu :

Current problem :
If Memory deduplication is done on Cpu ,a lot of memory is used for data structures and lot of computation time is wasted in finding duplicate page and becomes waste, if duplicate page is not found.

Proposed GPU solution: Let Gpu perform seraching for a shared page using multiple threads in parallel,improving searching operation and save data structures on GPU device memory ,which is possible. Communication between Cpu and Gpu can be done using inter processor synchronization which is also possible. Cpu process will run as a daemon that will invoke gpu process when ever deduplication is scheduled / if performance is good enough then for every page written in memory.

Correct me , if anything is wrong.

On Mon, Sep 6, 2010 at 11:05 PM, Dan Magenheimer <dan.magenheimer@xxxxxxxxxx> wrote:
In my opinion, both could be useful projects.

> -----Original Message-----
> From: Kaustubh Kabra [mailto:kaustubhwise@xxxxxxxxx]
> Sent: Saturday, September 04, 2010 1:02 PM
> To: Xen-devel
> Cc: Dan Magenheimer
> Subject: Re: [Xen-devel] Memory de-duplication (Persistent pages)
> Sir,
> We are pretty clear with the internal working of tmem.
> Now as "ephemeral" pages are already de-duplicated in current
> implementation .
> 1>>So, we propose to do sharing of "persistent" pages also .
> 2>>We also propose n/w bipass manager for "tmem" as its not existing
> currently.
> Will it be really useful ?
> If yes, it will be implemented within stipulated time frame.
> Thank you.

Kaustubh Kabra

Xen-devel mailing list