[Xen-devel] HVM with PV Drivers - Live Migration broken?

["Robert Dunkley" <Robert@xxxxxxxxx>]

Hi Everyone,

For some reason I cannot migrate HVMs using paravirt drivers. I have
asked the user list but no one seems to know why.

Non para Windows and Linux HVMs migrate OK on my setup but systems
running the Windows GPLPV drivers or Linux KMod paradrivers get stuck,
the receiving Dom0 shows the domain in a paused state and the sending
Dom0 show the domain with migrating- added to the beginning of the name
but it never completes.

I'm running Xen 3.3.0 on Centos 5.2 with DRBD 8.2.6 for shared storage,
NUMA enabled. The VMs will transfer live if I order the transfer very
quickly after starting them (I presume this is because the PV drivers
have not yet loaded). Is this likely a bug or some sort of configuration
issue?

Both Dom 0s show this in the xm dmesg:
save.c:159:d0 HVM restore: Xen changeset was not saved.

XM Log for each looks like this:
Sending Dom0:
[2009-01-21 14:19:33 11509] DEBUG (XendCheckpoint:103) [xc_save]:
/usr/lib64/xen/bin/xc_save 50 15 0 0 5
[2009-01-21 14:19:33 11509] INFO (XendCheckpoint:403) xc_save: could not
read suspend event channel
[2009-01-21 14:19:39 11509] INFO (XendCheckpoint:403) Saving memory
pages: iter  1: sent 982721, skipped 287, delta 6046ms, dom0 47%, target
0%, sent 5326Mb/s, dirtied 2Mb/s 503 pages
[2009-01-21 14:19:39 11509] INFO (XendCheckpoint:403) Saving memory
pages: iter  2: sent 509, skipped 0, delta 23ms, dom0 65%, target 0%,
sent 725Mb/s, dirtied 18Mb/s 13 pages
[2009-01-21 14:19:39 11509] INFO (XendCheckpoint:403) Saving memory
pages: iter  3: sent 0, skipped 13, Start last iteration
[2009-01-21 14:19:39 11509] DEBUG (XendCheckpoint:374) suspend
[2009-01-21 14:19:39 11509] DEBUG (XendCheckpoint:106) In
saveInputHandler suspend
[2009-01-21 14:19:39 11509] DEBUG (XendCheckpoint:108) Suspending 15 ...
[2009-01-21 14:19:39 11509] DEBUG (XendDomainInfo:472)
XendDomainInfo.shutdown(suspend)
[2009-01-21 14:19:39 11509] DEBUG (XendDomainInfo:1443)
XendDomainInfo.handleShutdownWatch

Receiving Dom0:
[2009-01-21 14:19:34 11571] DEBUG (DevController:124) DevController:
writing {'bridge': 'lanbr', 'domain': 'dns2', 'handle': '1', 'uuid':
'48bac5cb-2332-8ba8-8d59-484bb2969c59', 'script':
'/etc/xen/scripts/vif-bridge', 'mac': '00:16:3e:44:d3:a9',
'frontend-id': '13', 'state': '1', 'online': '1', 'frontend':
'/local/domain/13/device/vif/1'} to /local/domain/0/backend/vif/13/1.
[2009-01-21 14:19:34 11571] DEBUG (XendDomainInfo:1359) Storing domain
details: {'console/port': '3', 'name': 'dns2', 'console/limit':
'1048576', 'image/suspend-cancel': '1', 'domid': '13', 'vm':
'/vm/9ef8a7c9-efc1-73c7-40c1-b3013c2f1336', 'cpu/0/availability':
'online', 'memory/target': '524288',
'control/platform-feature-multiprocessor-suspend': '1', 'console/type':
'ioemu', 'store/port': '2'}
[2009-01-21 14:19:34 11571] INFO (XendCheckpoint:229) restore hvm domain
13, apic=1, pae=1
[2009-01-21 14:19:34 11571] DEBUG (image:300) Stored a VNC password for
vfb access
[2009-01-21 14:19:34 11571] DEBUG (image:743) args: boot, val: c
[2009-01-21 14:19:34 11571] DEBUG (image:743) args: fda, val: None
[2009-01-21 14:19:34 11571] DEBUG (image:743) args: fdb, val: None
[2009-01-21 14:19:34 11571] DEBUG (image:743) args: soundhw, val: None
[2009-01-21 14:19:34 11571] DEBUG (image:743) args: localtime, val: 0
[2009-01-21 14:19:34 11571] DEBUG (image:743) args: serial, val: pty
[2009-01-21 14:19:34 11571] DEBUG (image:743) args: std-vga, val: 0
[2009-01-21 14:19:34 11571] DEBUG (image:743) args: isa, val: 0
[2009-01-21 14:19:34 11571] DEBUG (image:743) args: acpi, val: 1
[2009-01-21 14:19:34 11571] DEBUG (image:743) args: usb, val: 0
[2009-01-21 14:19:34 11571] DEBUG (image:743) args: usbdevice, val: None
[2009-01-21 14:19:34 11571] DEBUG (XendCheckpoint:247)
restore:shadow=0x5, _static_max=0x20000000, _static_min=0x0,
[2009-01-21 14:19:34 11571] DEBUG (balloon:132) Balloon: 23809136 KiB
free; need 537600; done.
[2009-01-21 14:19:34 11571] DEBUG (XendCheckpoint:264) [xc_restore]:
/usr/lib64/xen/bin/xc_restore 4 13 2 3 1 1 1
[2009-01-21 14:19:34 11571] INFO (XendCheckpoint:403) xc_domain_restore
start: p2m_size = f2021
[2009-01-21 14:19:34 11571] INFO (XendCheckpoint:403) Reloading memory
pages:   0%


Thanks,

Rob

The SAQ Group

Registered Office: 18 Chapel Street, Petersfield, Hampshire GU32 3DZ
SAQ is the trading name of SEMTEC Limited. Registered in England & Wales
Company Number: 06481952

http://www.saqnet.co.uk AS29219

SAQ Group Delivers high quality, honestly priced communication and I.T. 
services to UK Business.

Broadband : Domains : Email : Hosting : CoLo : Servers : Racks : Transit : 
Backups : Managed Networks : Remote Support.

ISPA Member

Find us in http://www.thebestof.co.uk/petersfield


_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-devel