WARNING - OLD ARCHIVES

This is an archived copy of the Xen.org mailing list, which we have preserved to ensure that existing links to archives are not broken. The live archive, which contains the latest emails, can be found at http://lists.xen.org/
   
 
 
Xen 
 
Home Products Support Community News
 
   
 

xen-devel

Re: [Xen-devel] Re: [Xen-users] XCP with 64-bit dom0?

To: Kannan Vijayan <kvijayan@xxxxxxxxxxxxxx>
Subject: Re: [Xen-devel] Re: [Xen-users] XCP with 64-bit dom0?
From: Todd Deshane <todd.deshane@xxxxxxx>
Date: Sat, 30 Apr 2011 20:56:06 -0400
Cc: xen-devel <xen-devel@xxxxxxxxxxxxxxxxxxx>, Muriel <mucawhite@xxxxxxxxx>, Jonathan Ludlam <Jonathan.Ludlam@xxxxxxxxxxxxx>
Delivery-date: Sat, 30 Apr 2011 18:25:52 -0700
Dkim-signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:sender:in-reply-to:references:from :date:x-google-sender-auth:message-id:subject:to:cc:content-type :content-transfer-encoding; bh=f98lkj//hidVkc8yJO/1YswZWBDqQL9X6Y0u8K4UWRg=; b=XzLA/uvf3jrAeR4o2BXGAgkdNTgirhaaHaF2xzC2n5x1xvvvXprXBlFlaH3JzhhHYC ss/PbE2ROiuL29fD9AzIRSZgeD/gUITig52txHpyBkXjqiC2UHOH+80IiCg/EOCY7B2T 4ojeE0MlYSP/S4mGgD22m5mtoQFfZru2FZF/s=
Domainkey-signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:sender:in-reply-to:references:from:date :x-google-sender-auth:message-id:subject:to:cc:content-type :content-transfer-encoding; b=N9pEuBvguORp3WIixJdS9z5Vmct08eB11rfRyBjkJMwFrsIo4Oob2RVVjvT+NPgbYk rGJ2ApP77IvdUtvEfeFdqHuV4vcqZizy6zprtwwUCn3axYcuVAYyS+/kxWDHZe7HY05v 26jqHddHlK6nIBvwqedKZzMj3y9WzWADStnnU=
Envelope-to: www-data@xxxxxxxxxxxxxxxxxxx
In-reply-to: <BANLkTingrzwW4HGtQic_vzyrWQtxOCKuMw@xxxxxxxxxxxxxx>
List-help: <mailto:xen-devel-request@lists.xensource.com?subject=help>
List-id: Xen developer discussion <xen-devel.lists.xensource.com>
List-post: <mailto:xen-devel@lists.xensource.com>
List-subscribe: <http://lists.xensource.com/mailman/listinfo/xen-devel>, <mailto:xen-devel-request@lists.xensource.com?subject=subscribe>
List-unsubscribe: <http://lists.xensource.com/mailman/listinfo/xen-devel>, <mailto:xen-devel-request@lists.xensource.com?subject=unsubscribe>
References: <BANLkTim=1Oaw=CEjQ3bvx09N0tDpna94mA@xxxxxxxxxxxxxx> <BANLkTikn9vS+utdL-HcMtC2gYmh5KJ7Egg@xxxxxxxxxxxxxx> <BANLkTimw2818KuW9Ld5oym6skEdztfh1XA@xxxxxxxxxxxxxx> <4DB15A31.4040104@xxxxxxxxx> <BANLkTingrzwW4HGtQic_vzyrWQtxOCKuMw@xxxxxxxxxxxxxx>
Sender: xen-devel-bounces@xxxxxxxxxxxxxxxxxxx
On Mon, Apr 25, 2011 at 11:39 AM, Kannan Vijayan
<kvijayan@xxxxxxxxxxxxxx> wrote:
> On Fri, Apr 22, 2011 at 6:36 AM, Muriel <mucawhite@xxxxxxxxx> wrote:
>>> I'm trying to integrate live-cloning (via the xen snowflock codebase)
>>> into the XCP control path, which requires me to run a 64-bit PV
>>> kernel, and also requires 64-bit dom0 tools to talk properly with Xen.
>>>

Have you considered running the 64 bit code in a VM?

The dom0 in XCP is 32 bit because of performance. It is recommended
for performance reasons to use 64bit HVM and then use the PVonHVM
drivers.

http://wiki.xensource.com/xenwiki/XenLinuxPVonHVMdrivers


>>> Perhaps I should re-ask this question in Xen-devel.  It may be a more
>>> appropriate venue.
>>>
>>> -kannan
>>
>>
>> Ok, i will reply directly to xen-devel to move the discussion.
>> I'm very interested and i'm starting to recompile. I'm trying to integrate
>> into an existing 64bit cluster a dom0 based on xpc. What packages are
>> fundamental to have a stable environment?
>>
>> Thanks,
>> Muriel
>>
>
> I've been working at it from the other end, with a goal of "shortest
> path to working".  I'm coming in with relative unfamiliarity with the
> XCP architecture, and started working top-down.
>
> I can boot the XCP host with a 64-bit snowflock kernel.  I
> subsequently ran into problems with a 32-bit blktap userspace toolset
> having problems talking to a 64-bit dom0 kernel, so I started
> rebuilding that and kept moving down as needed.  I got the blktap
> issue resolved, but currently I'm running into an issue with
> xc_dom_boot_mem_init:
>
> /var/log/xensource.log:[20110418T16:56:55.946Z|debug|localhost|1003
> unix-RPC||cli] Xapi_cli.exception_handler: Got exception
> INTERNAL_ERROR: [ XenguestHelper.Xc_dom_linux_build_failure(4, "
> xc_dom_boot_mem_init: can't allocate low memory for dom\\\"") ]
>
> Once again, I think this is due to a mismatch between 32-bit/64-bit
> addresses.  The call is made through a tool called 'xenguest' which is
> built alongside xapi and is used by xapi.  I had to go and dig pretty
> deep in the rebuild tree to generate the dependencies needed to build
> a 64-bit xapi and xenguest.
>
> So far, these are the high-level packages I've had to rebuild to
> target a 64-bit runtime (all as part of getting to a 64-bit build of
> xapi and xenguest):
>
> blktap-1.0.0-566.x86_64.rpm
> blktap-devel-1.0.0-566.x86_64.rpm
> ocaml-3.11.0-unknown.x86_64.rpm
> ocaml-camlp4-3.11.0-unknown.x86_64.rpm
> ocaml-findlib-1.1.2pl1-16.x86_64.rpm
> ocaml-findlib-devel-1.1.2pl1-16.x86_64.rpm
> ocaml-getopt-20040811-unknown.x86_64.rpm
> ocaml-getopt-devel-20040811-unknown.x86_64.rpm
> ocaml-type-conv-1.6.8-unknown.x86_64.rpm
> ocaml-xmlm-1.0.2-unknown.x86_64.rpm
> ocaml-xmlm-devel-1.0.2-unknown.x86_64.rpm
> omake-0.9.8.5-unknown.x86_64.rpm
> xapi-client-devel-0.2-unknown.x86_64.rpm
> xapi-core-0.2-unknown.x86_64.rpm
> xapi-datamodel-devel-0.2-unknown.x86_64.rpm
> xapi-docs-0.2-unknown.x86_64.rpm
> xapi-libs-devel-0-unknown.x86_64.rpm
> xapi-libs-fe-0-unknown.x86_64.rpm
> xapi-libs-utils-0-unknown.x86_64.rpm
> xapi-squeezed-0.2-unknown.x86_64.rpm
> xapi-tests-0.2-unknown.x86_64.rpm
> xapi-www-0.2-unknown.x86_64.rpm
> xapi-xe-0.2-unknown.x86_64.rpm
> xapi-xenops-0.2-unknown.x86_64.rpm
> xen-blktap-3.4.2-1.0.0.700.20051.x86_64.rpm
> xen-devel-3.4.2-1.0.0.700.20051.x86_64.rpm
> xen-firmware-3.4.2-1.0.0.700.20051.x86_64.rpm
> xen-hypervisor-3.4.2-1.0.0.700.20051.x86_64.rpm
> xen-tools-3.4.2-1.0.0.700.20051.x86_64.rpm
>
>
> Current problem: Installing these directly on a normal XCP deployment
> is infeasible.  It wants to pull a TON of 64-bit support packages, and
> quickly descends into conflict hell.
>
> So now I'm looking for ways to build an XCP install image, and hoping
> I can replace all the base packages with 64-bit versions and go from
> there.  I've looked around for instructions on building a full install
> image (found the instructions for building/modifying xapi.. those were
> very useful earlier in the process.. but not for this).
>
> If I can't rebuild an XCP install disk, the other tactic I have in
> mind is to edit an existing install ISO and switch out the existing
> packages for 64-bit surrogates.
>
> I haven't tried either of these approaches yet.  Does anybody know of
> docs, or have thoughts, on either of these subjects?  I'm picking up
> what I need to know as I go along, so my overall picture of the system
> is coalescing over time, but is almost definitely not complete at this
> time.
>
> Just a note: from what I _have_ seen of the system, it's very nicely
> designed.  I like the xapi object model and schema design.  Simple,
> but complete, clear, and understandable.  A short analysis was enough
> to figure out how best to approach the integration of live-cloning
> semantics into XCP.  Kudos on the good work.
>
> Cheers.
> -kannan
>
> _______________________________________________
> Xen-devel mailing list
> Xen-devel@xxxxxxxxxxxxxxxxxxx
> http://lists.xensource.com/xen-devel
>



-- 
Todd Deshane
http://www.linkedin.com/in/deshantm
http://www.xen.org/products/cloudxen.html

_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-devel

<Prev in Thread] Current Thread [Next in Thread>