Hi
I have a setup where I have an eth2 10GB interface setup a loop back
between two dell 1950 servers. I have enabled VT in the bios. The eth0
interface is on a 1GB network. I am using an iscsi
shared drive for the HVM image.
I have followed the instruction provided in http://www.osrg.net/kemari/usage.html
Now once everything is setup:
After launching the HVM, I execute the following command:
"xm migrate 3
192.168.20.21 --kemari &"
This after 2-3 seconds gives an error on the console:
"Error: /usr/lib/xen/bin/xc_kemari_save
51 3 0 0 4 failed"
Is this some sort of bug, or there is something wrong with the
configuration I am using.
Thank you in advance for any help you can provide in resolving this
issue.
Vivek.
Additional information:
The xend.log file on the destination server
shows some error with mmap failing. Here is an
excerpt:
-------- ---------- -------
[2009-01-03 21:29:09 4814] INFO (XendCheckpoint:277)
restore hvm domain 10, apic=1,
pae=1
[2009-01-03 21:29:09 4814] DEBUG (image:743) args: boot, val: c
[2009-01-03 21:29:09 4814] DEBUG (image:743) args: fda, val:
None
[2009-01-03 21:29:09 4814] DEBUG (image:743) args: fdb, val:
None
[2009-01-03 21:29:09 4814] DEBUG (image:743) args: soundhw, val: None
[2009-01-03 21:29:09 4814] DEBUG (image:743) args: localtime, val: 0
[2009-01-03 21:29:09 4814] DEBUG (image:743) args: serial, val: pty
[2009-01-03 21:29:09 4814] DEBUG (image:743) args: std-vga, val: 0
[2009-01-03 21:29:09 4814] DEBUG (image:743) args: isa, val:
0
[2009-01-03 21:29:09 4814] DEBUG (image:743) args: acpi, val:
1
[2009-01-03 21:29:09 4814] DEBUG (image:743) args: usb, val:
0
[2009-01-03 21:29:09 4814] DEBUG (image:743) args: usbdevice, val: None
[2009-01-03 21:29:09 4814] DEBUG (XendCheckpoint:295)
restore:shadow=0x9, _static_max=0x40000000,
_static_min=0x0,
[2009-01-03 21:29:09 4814] DEBUG (balloon:132)
Balloon: 2564668 KiB free; need 1065984; done.
[2009-01-03 21:29:09 4814] DEBUG (XendCheckpoint:320)
[xc_restore]: /usr/lib/xen/bin/xc_kemari_restore
15 10 2 3 1 1 1
[2009-01-03 21:29:09 4814] INFO (XendCheckpoint:466)
xc_kemari_restore start: p2m_size = 100000
[2009-01-03 21:29:10 4814] INFO (XendCheckpoint:466)
xc_kemari_restore: shared_info_frame:
f2000
[2009-01-03 21:29:10 4814] INFO
(XendCheckpoint:466) xc_map_foreign_batch:
mmap failed: Cannot allocate memory
[2009-01-03 21:29:10 4814] INFO (XendCheckpoint:466)
ERROR Internal error: map batch failed
[2009-01-03 21:29:11 4814] INFO (XendCheckpoint:466)
Restore exit with rc=1
[2009-01-03 21:29:11 4814] DEBUG (XendDomainInfo:2420)
XendDomainInfo.destroy: domid=10
[2009-01-03 21:29:11 4814] ERROR (XendDomainInfo:2435)
XendDomainInfo.destroy: domain destruction failed.
Traceback (most recent call
last):
File "//usr/lib/python/xen/xend/XendDomainInfo.py", line 2428,
in destroy
xc.domain_pause(self.domid)
Error: (3, 'No such process')
-------------- ------------- ----------------
Excerpt of logs in the source server:
-------- -------- -----
[2009-01-03
20:58:55 6693] INFO (XendDomain:1174) Domain AES-HVM
(3) unpaused.
[2009-01-03
20:59:48 6693] DEBUG (XendDomainInfo:1974) No device
model
[2009-01-03
20:59:48 6693] DEBUG (XendDomainInfo:1976) Releasing
devices
[2009-01-03
20:59:48 6693] DEBUG (XendDomainInfo:1974) No device
model
[2009-01-03
20:59:48 6693] DEBUG (XendDomainInfo:1976) Releasing
devices
[2009-01-03
21:34:29 6693] DEBUG (XendCheckpoint:136) [xc_save]: /usr/lib/xen/bin/xc_kemari_save
51 3 0 0 4
[2009-01-03
21:34:29 6693] DEBUG (XendCheckpoint:141) [xc_save]: /usr/lib/xen/bin/xc_kemari_save
51 3 0 0 4
[2009-01-03
21:34:29 6693] INFO (XendCheckpoint:466) xc_kemari_control: cmd=1
[2009-01-03
21:34:29 6693] INFO (XendCheckpoint:466) kemari_port=8, kemari_mfn=3008, kemari_ring_size=8
[2009-01-03
21:34:29 6693] INFO (XendCheckpoint:466) xc_kemari_save: shared_info_frame:
991232
[2009-01-03
21:34:29 6693] INFO (XendCheckpoint:466) xc_kemari_save: p2m_size: 1048576
[2009-01-03
21:34:29 6693] INFO (XendCheckpoint:466) kemari_restore: magic_pfns 0:
262142, 1: 262140, 2: 262141
[2009-01-03
21:34:31 6693] INFO (XendCheckpoint:466) kemari_restore: callback irq
100000000001800Saving memory pages: iter 1 0%ERROR Internal error: Error when
writing to state file (4a) (errno 104)
[2009-01-03
21:34:31 6693] INFO (XendCheckpoint:466) Save exit
rc=1
[2009-01-03
21:34:31 6693] INFO (XendCheckpoint:466) ERROR
Internal error: xc_kemari_save failed
[2009-01-03
21:34:31 6693] INFO (XendCheckpoint:466) xc_kemari_control: cmd=2
[2009-01-03
21:34:31 6693] INFO (XendCheckpoint:466) successufully execute KEMARI_OP_off
[2009-01-03
21:34:31 6693] ERROR (XendCheckpoint:195) Save failed
on domain AES-HVM (3) - resuming.
Traceback
(most recent call last):
File "//usr/lib/python/xen/xend/XendCheckpoint.py",
line 163, in save
forkHelper(cmd, fd, saveInputHandler,
False)
File "//usr/lib/python/xen/xend/XendCheckpoint.py",
line 454, in forkHelper
raise
XendError("%s failed" % string.join(cmd))
XendError: /usr/lib/xen/bin/xc_kemari_save 51 3 0 0
4 failed
--------- -------- ----------------------
The HVM was launched using the following configuration:
----------- --------- --------------------
name = "AES-HVM"
uuid
= "a30857d1-546d-2ad6-f2b7-35e222782c0d"
maxmem
= 1024
memory = 1024
vcpus
= 1
builder = "hvm"
kernel = "/usr/lib/xen/boot/hvmloader"
boot = "c"
pae
= 1
acpi
= 1
apic
= 1
localtime
= 0
on_poweroff = "destroy"
on_reboot = "restart"
on_crash = "restart"
device_model = "/usr/lib/xen/bin/qemu-dm"
sdl
= 0
vnc
= 0
vncunused
= 0
disk = [
"phy:/dev/disk/by-id/scsi-16465616462656166323a3100000000000000000000000000,hda,w",
",hdc:cdrom,r" ]
vif
= [ "mac=00:16:3e:7d:cc:8a,bridge=xenbr0" ]
serial = "pty"
-------------------------------------------
The image is on an iscsi shared drive where the
target is on an external server setup over a 1GB network.
"xm info"
on dom0 shows the following:
------------ ---------------
0[root@copper2 xen]#
xm info
host
: xxx2.yyy.zzz.com
release
: 2.6.18.8-xen
version
: #1 SMP Thu Dec 11 03:25:15 MST 2008
machine
: i686
nr_cpus
: 4
nr_nodes
: 1
cores_per_socket : 4
threads_per_core : 1
cpu_mhz
: 2327
hw_caps
: bfebfbff:20100000:00000000:00000140:000ce3bd:00000000:00000001:00000000
virt_caps
: hvm
total_memory
: 4090
free_memory
: 1464
node_to_cpu
: node0:0-3
node_to_memory
: node0:1464
xen_major
: 3
xen_minor
: 3
xen_extra
: .1-rc1-pre
xen_caps
: xen-3.0-x86_32p hvm-3.0-x86_32 hvm-3.0-x86_32p
xen_scheduler
: credit
xen_pagesize
: 4096
platform_params : virt_start=0xf5800000
xen_changeset
: Thu Sep 25 13:33:50 2008 +0100 18430:19201eebab16
cc_compiler
: gcc version 4.1.2 20071124 (Red Hat
4.1.2-42)
cc_compile_by
: root
cc_compile_domain : yyy.zzz.com
cc_compile_date :
Thu Dec 11 04:40:56 MST 2008
xend_config_format : 4
------ ------- -------
"uname -a"
shows the following:
Linux xxx2.yyy.zzz.com 2.6.18.8-xen #1 SMP Thu Dec 11 03:25:15 MST 2008
i686 i686 i386 GNU/Linux
