[Xen-devel] "xm migrate VM_ID dest_IP_addr --kemari" fails

I have a setup where I have an eth2 10GB interface setup a loop back between two dell 1950 servers. I have enabled VT in the bios. The eth0 interface is on a 1GB network. I am using an iscsi shared drive for the HVM image.

I have followed the instruction provided in http://www.osrg.net/kemari/usage.html

Now once everything is setup:

After launching the HVM, I execute the following command:

"xm migrate 3 192.168.20.21 --kemari &"

This after 2-3 seconds gives an error on the console:

"Error: /usr/lib/xen/bin/xc_kemari_save 51 3 0 0 4 failed"

Is this some sort of bug, or there is something wrong with the configuration I am using.

Thank you in advance for any help you can provide in resolving this issue.

Vivek.

Additional information:

The xend.log file on the destination server shows some error with mmap failing. Here is an excerpt:

-------- ---------- -------

[2009-01-03 21:29:09 4814] INFO (XendCheckpoint:277) restore hvm domain 10, apic=1, pae=1

[2009-01-03 21:29:09 4814] DEBUG (image:743) args: boot, val: c

[2009-01-03 21:29:09 4814] DEBUG (image:743) args: fda, val: None

[2009-01-03 21:29:09 4814] DEBUG (image:743) args: fdb, val: None

[2009-01-03 21:29:09 4814] DEBUG (image:743) args: soundhw, val: None

[2009-01-03 21:29:09 4814] DEBUG (image:743) args: localtime, val: 0

[2009-01-03 21:29:09 4814] DEBUG (image:743) args: serial, val: pty

[2009-01-03 21:29:09 4814] DEBUG (image:743) args: std-vga, val: 0

[2009-01-03 21:29:09 4814] DEBUG (image:743) args: isa, val: 0

[2009-01-03 21:29:09 4814] DEBUG (image:743) args: acpi, val: 1

[2009-01-03 21:29:09 4814] DEBUG (image:743) args: usb, val: 0

[2009-01-03 21:29:09 4814] DEBUG (image:743) args: usbdevice, val: None

[2009-01-03 21:29:09 4814] DEBUG (XendCheckpoint:295) restore:shadow=0x9, _static_max=0x40000000, _static_min=0x0,

[2009-01-03 21:29:09 4814] DEBUG (balloon:132) Balloon: 2564668 KiB free; need 1065984; done.

[2009-01-03 21:29:09 4814] DEBUG (XendCheckpoint:320) [xc_restore]: /usr/lib/xen/bin/xc_kemari_restore 15 10 2 3 1 1 1

[2009-01-03 21:29:09 4814] INFO (XendCheckpoint:466) xc_kemari_restore start: p2m_size = 100000

[2009-01-03 21:29:10 4814] INFO (XendCheckpoint:466) xc_kemari_restore: shared_info_frame: f2000

[2009-01-03 21:29:10 4814] INFO (XendCheckpoint:466) xc_map_foreign_batch: mmap failed: Cannot allocate memory

[2009-01-03 21:29:10 4814] INFO (XendCheckpoint:466) ERROR Internal error: map batch failed

[2009-01-03 21:29:11 4814] INFO (XendCheckpoint:466) Restore exit with rc=1

[2009-01-03 21:29:11 4814] DEBUG (XendDomainInfo:2420) XendDomainInfo.destroy: domid=10

[2009-01-03 21:29:11 4814] ERROR (XendDomainInfo:2435) XendDomainInfo.destroy: domain destruction failed.

Traceback (most recent call last):

File "//usr/lib/python/xen/xend/XendDomainInfo.py", line 2428, in destroy

xc.domain_pause(self.domid)

Error: (3, 'No such process')

-------------- ------------- ----------------

Excerpt of logs in the source server:

-------- -------- -----

[2009-01-03 20:58:55 6693] INFO (XendDomain:1174) Domain AES-HVM (3) unpaused.

[2009-01-03 20:59:48 6693] DEBUG (XendDomainInfo:1974) No device model

[2009-01-03 20:59:48 6693] DEBUG (XendDomainInfo:1976) Releasing devices

[2009-01-03 20:59:48 6693] DEBUG (XendDomainInfo:1974) No device model

[2009-01-03 20:59:48 6693] DEBUG (XendDomainInfo:1976) Releasing devices

[2009-01-03 21:34:29 6693] DEBUG (XendCheckpoint:136) [xc_save]: /usr/lib/xen/bin/xc_kemari_save 51 3 0 0 4

[2009-01-03 21:34:29 6693] DEBUG (XendCheckpoint:141) [xc_save]: /usr/lib/xen/bin/xc_kemari_save 51 3 0 0 4

[2009-01-03 21:34:29 6693] INFO (XendCheckpoint:466) xc_kemari_control: cmd=1

[2009-01-03 21:34:29 6693] INFO (XendCheckpoint:466) kemari_port=8, kemari_mfn=3008, kemari_ring_size=8

[2009-01-03 21:34:29 6693] INFO (XendCheckpoint:466) xc_kemari_save: shared_info_frame: 991232

[2009-01-03 21:34:29 6693] INFO (XendCheckpoint:466) xc_kemari_save: p2m_size: 1048576

[2009-01-03 21:34:29 6693] INFO (XendCheckpoint:466) kemari_restore: magic_pfns 0: 262142, 1: 262140, 2: 262141

[2009-01-03 21:34:31 6693] INFO (XendCheckpoint:466) kemari_restore: callback irq 100000000001800Saving memory pages: iter 1 0%ERROR Internal error: Error when writing to state file (4a) (errno 104)

[2009-01-03 21:34:31 6693] INFO (XendCheckpoint:466) Save exit rc=1

[2009-01-03 21:34:31 6693] INFO (XendCheckpoint:466) ERROR Internal error: xc_kemari_save failed

[2009-01-03 21:34:31 6693] INFO (XendCheckpoint:466) xc_kemari_control: cmd=2

[2009-01-03 21:34:31 6693] INFO (XendCheckpoint:466) successufully execute KEMARI_OP_off

[2009-01-03 21:34:31 6693] ERROR (XendCheckpoint:195) Save failed on domain AES-HVM (3) - resuming.

Traceback (most recent call last):

File "//usr/lib/python/xen/xend/XendCheckpoint.py", line 163, in save

forkHelper(cmd, fd, saveInputHandler, False)

File "//usr/lib/python/xen/xend/XendCheckpoint.py", line 454, in forkHelper

raise XendError("%s failed" % string.join(cmd))

XendError: /usr/lib/xen/bin/xc_kemari_save 51 3 0 0 4 failed

--------- -------- ----------------------

The HVM was launched using the following configuration:

----------- --------- --------------------

name = "AES-HVM"

uuid = "a30857d1-546d-2ad6-f2b7-35e222782c0d"

maxmem = 1024

memory = 1024

vcpus = 1

builder = "hvm"

kernel = "/usr/lib/xen/boot/hvmloader"

boot = "c"

pae = 1

acpi = 1

apic = 1

localtime = 0

on_poweroff = "destroy"

on_reboot = "restart"

on_crash = "restart"

device_model = "/usr/lib/xen/bin/qemu-dm"

sdl = 0

vnc = 0

vncunused = 0

disk = [ "phy:/dev/disk/by-id/scsi-16465616462656166323a3100000000000000000000000000,hda,w", ",hdc:cdrom,r" ]

vif = [ "mac=00:16:3e:7d:cc:8a,bridge=xenbr0" ]

serial = "pty"

-------------------------------------------

The image is on an iscsi shared drive where the target is on an external server setup over a 1GB network.

"xm info" on dom0 shows the following:

------------ ---------------

0[root@copper2 xen]# xm info

host : xxx2.yyy.zzz.com

release : 2.6.18.8-xen

version : #1 SMP Thu Dec 11 03:25:15 MST 2008

machine : i686

nr_cpus : 4

nr_nodes : 1

cores_per_socket : 4

threads_per_core : 1

cpu_mhz : 2327

hw_caps : bfebfbff:20100000:00000000:00000140:000ce3bd:00000000:00000001:00000000

virt_caps : hvm

total_memory : 4090

free_memory : 1464

node_to_cpu : node0:0-3

node_to_memory : node0:1464

xen_major : 3

xen_minor : 3

xen_extra : .1-rc1-pre

xen_caps : xen-3.0-x86_32p hvm-3.0-x86_32 hvm-3.0-x86_32p

xen_scheduler : credit

xen_pagesize : 4096

platform_params : virt_start=0xf5800000

xen_changeset : Thu Sep 25 13:33:50 2008 +0100 18430:19201eebab16

cc_compiler : gcc version 4.1.2 20071124 (Red Hat 4.1.2-42)

cc_compile_by : root

cc_compile_domain : yyy.zzz.com

cc_compile_date : Thu Dec 11 04:40:56 MST 2008

xend_config_format : 4

------ ------- -------

"uname -a" shows the following:

Linux xxx2.yyy.zzz.com 2.6.18.8-xen #1 SMP Thu Dec 11 03:25:15 MST 2008 i686 i686 i386 GNU/Linux

_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-devel

WARNING - OLD ARCHIVES

xen-devel

[Xen-devel] "xm migrate VM_ID dest_IP_addr --kemari" fails