WARNING - OLD ARCHIVES

This is an archived copy of the Xen.org mailing list, which we have preserved to ensure that existing links to archives are not broken. The live archive, which contains the latest emails, can be found at http://lists.xen.org/
   
 
 
Xen 
 
Home Products Support Community News
 
   
 

xen-users

Re: [Xen-devel] tap:qcow causes dom-U to hang in 3.0.3

To: xen-devel@xxxxxxxxxxxxxxxxxxx
Subject: Re: [Xen-devel] tap:qcow causes dom-U to hang in 3.0.3
From: Wolfgang Schnerring <wosc@xxxxxxx>
Date: Fri, 10 Nov 2006 09:49:32 +0100
Cancel-lock: sha1:7EJhWwxmp6OjdvqEYgVFOTbmX8c=
Cc: xen-users@xxxxxxxxxxxxxxxxxxx
Delivery-date: Fri, 10 Nov 2006 02:50:33 -0800
Envelope-to: www-data@xxxxxxxxxxxxxxxxxx
List-help: <mailto:xen-devel-request@lists.xensource.com?subject=help>
List-id: Xen developer discussion <xen-devel.lists.xensource.com>
List-post: <mailto:xen-devel@lists.xensource.com>
List-subscribe: <http://lists.xensource.com/cgi-bin/mailman/listinfo/xen-devel>, <mailto:xen-devel-request@lists.xensource.com?subject=subscribe>
List-unsubscribe: <http://lists.xensource.com/cgi-bin/mailman/listinfo/xen-devel>, <mailto:xen-devel-request@lists.xensource.com?subject=unsubscribe>
References: <4551EEC3.3010308@xxxxxxxxxxxx> <20061108151133.GE3507@xxxxxxxxxxxxxxxxxxxxxx>
Sender: xen-devel-bounces@xxxxxxxxxxxxxxxxxxx
User-agent: Gnus/5.110006 (No Gnus v0.6) Emacs/21.4 (gnu/linux)
* Ewan Mellor <ewan@xxxxxxxxxxxxx>:
> On Wed, Nov 08, 2006 at 04:50:43PM +0200, Roland Paterson-Jones wrote:
>> However, I am really interested in copy-on-write support, and hence have 
>> been trying tap:qcow:. This has had limited success, in that dom-U's 
>> appear to launch. However, as soon as I try to console or ssh into the 
>> dom-U's they apparently freeze, and I can get no further with them.

I'm seeing (what I believe to be) the same thing, so here's some more data
points. This is Xen 3.0.3, compiled from the source.tgz, dom0 is Ubuntu 6.06,
domU is Debian Sarge. The error occurs when using a file-backed qcow-image,
using a standalone qcow image or tap:aio works just fine.

# qcow-create 1024 vm01.qcow vm01.img
# cat sample.xen
name="vm01"
kernel="/boot/vmlinuz-2.6-xen0"
ramdisk="/boot/initrd.img-2.6.16.29-xen0"
root="/dev/hda1"
extra="3"
memory=32
disk=["tap:qcow:/opt/wosc/vm01.qcow,hda1,w", 
"tap:aio:/opt/wosc/vm01-swap.img,hda2,w"]
vif=[""]
dhcp="off"
# xm create sample.xen -c
(boots up to login prompt, but freezes after entering the username)
# xm destroy vm01
# xm list
Error: Device 769 not connected

>From then on I haven't been able to un-wedge Xen other than by rebooting the
machine.

Please let me know if there's anything I can do to help debug this.

Thanks,
Wolfgang

> Could we see your /var/log/xen/*  and the output of xenstore-ls?

# xenstore-ls
tool = ""
 xenstored = ""
vm = ""
 00000000-0000-0000-0000-000000000000 = ""
  shadow_memory = "0"
  uuid = "00000000-0000-0000-0000-000000000000"
  on_reboot = "restart"
  on_poweroff = "destroy"
  name = "Domain-0"
  xend = ""
   restart_count = "0"
  vcpus = "1"
  vcpu_avail = "1"
  memory = "461"
  on_crash = "restart"
  maxmem = "461"
local = ""
 domain = ""
  0 = ""
   cpu = ""
    0 = ""
     availability = "online"
   memory = ""
    target = "472064"
   name = "Domain-0"
   console = ""
    limit = "1048576"
   vm = "/vm/00000000-0000-0000-0000-000000000000"
   domid = "0"
   backend = ""
    tap = ""
     1 = ""
      769 = ""
       domain = "vm01"
       frontend = "/local/domain/1/device/vbd/769"
       dev = "hda1"
       state = "4"
       params = "qcow:/opt/wosc/vm01.qcow"
       mode = "w"
       online = "1"
       frontend-id = "1"
       type = "tap"
       sectors = "2097152"
       sector-size = "512"
       info = "0"
       hotplug-status = "connected"
      770 = ""
       domain = "vm01"
       frontend = "/local/domain/1/device/vbd/770"
       dev = "hda2"
       state = "4"
       params = "aio:/opt/wosc/vm01-swap.img"
       mode = "w"
       online = "1"
       frontend-id = "1"
       type = "tap"
       sectors = "262144"
       sector-size = "512"
       info = "0"
       hotplug-status = "connected"
   error = ""
    backend = ""
     tap = ""
      1 = ""
       769 = ""
        error = "2 getting info"
       770 = ""
        error = "2 getting info"

# cat /var/log/xend.log
[2006-11-10 09:07:17 xend 3432] INFO (__init__:1072) Xend stopped due to signal 
15.
[2006-11-10 09:08:42 xend 3446] INFO (__init__:1072) Xend Daemon started
[2006-11-10 09:08:42 xend 3446] INFO (__init__:1072) Xend changeset: 
unavailable .
[2006-11-10 09:08:42 xend.XendDomainInfo 3446] DEBUG (__init__:1072) 
XendDomainInfo.recreate({'paused': 0, 'cpu_time': 18163054582L, 'ssidref': 0, 
'handle': [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0], 'shutdown_reason': 
0, 'dying': 0, 'dom': 0, 'mem_kb': 471940, 'maxmem_kb': -4, 'max_vcpu_id': 0, 
'crashed': 0, 'running': 1, 'shutdown': 0, 'online_vcpus': 1, 'blocked': 0})
[2006-11-10 09:08:42 xend.XendDomainInfo 3446] INFO (__init__:1072) Recreating 
domain 0, UUID 00000000-0000-0000-0000-000000000000.
[2006-11-10 09:08:42 xend.XendDomainInfo 3446] WARNING (__init__:1072) No vm 
path in store for existing domain 0
[2006-11-10 09:08:42 xend.XendDomainInfo 3446] DEBUG (__init__:1072) Storing VM 
details: {'shadow_memory': '0', 'uuid': '00000000-0000-0000-0000-000000000000', 
'on_reboot': 'restart', 'on_poweroff': 'destroy', 'name': 'Domain-0', 
'xend/restart_count': '0', 'vcpus': '1', 'vcpu_avail': '1', 'memory': '461', 
'on_crash': 'restart', 'maxmem': '461'}
[2006-11-10 09:08:42 xend.XendDomainInfo 3446] DEBUG (__init__:1072) Storing 
domain details: {'cpu/0/availability': 'online', 'memory/target': '472064', 
'name': 'Domain-0', 'console/limit': '1048576', 'vm': 
'/vm/00000000-0000-0000-0000-000000000000', 'domid': '0'}
[2006-11-10 09:08:42 xend 3446] DEBUG (__init__:1072) number of vcpus to use is 0
[2006-11-10 09:08:42 xend.XendDomainInfo 3446] DEBUG (__init__:1072) 
XendDomainInfo.handleShutdownWatch
[2006-11-10 09:35:36 xend.XendDomainInfo 3446] DEBUG (__init__:1072) 
XendDomainInfo.create(['vm', ['name', 'vm01'], ['memory', 32], ['vcpus', 1], 
['image', ['linux', ['kernel', '
boot/vmlinuz-2.6-xen0'], ['ramdisk', '/boot/initrd.img-2.6.16.29-xenU'], 
['root', '/dev/hda1'], ['args', '3']]], ['device', ['tap', ['uname', 
'tap:qcow:/opt/wosc/vm01.qcow'], ['dev', 'hda1'], ['mode', 'w']]], ['device', 
['tap', ['uname', 'tap:aio:/opt/wosc/vm01-swap.img'], ['dev', 'hda2'], ['mode', 
'w']]], ['device', ['vif']]])
[2006-11-10 09:35:36 xend.XendDomainInfo 3446] DEBUG (__init__:1072) 
parseConfig: config is ['vm', ['name', 'vm01'], ['memory', 32], ['vcpus', 1], 
['image', ['linux', ['kernel', '/boot/vmlinuz-2.6-xen0'], ['ramdisk', 
'/boot/initrd.img-2.6.16.29-xenU'], ['root', '/dev/hda1'], ['args', '3']]], 
['device', ['tap', ['uname', 'tap:qcow:/opt/wosc/vm01.qcow'], ['dev', 'hda1'], 
['mode', 'w']]], ['device', ['tap', ['uname', 
'tap:aio:/opt/wosc/vm01-swap.img'], ['dev', 'hda2'], ['mode', 'w']]], 
['device', ['vif']]]
[2006-11-10 09:35:36 xend.XendDomainInfo 3446] DEBUG (__init__:1072) 
parseConfig: result is {'shadow_memory': None, 'uuid': None, 'on_crash': None, 
'on_reboot': None, 'localtime': None, 'image': ['linux', ['kernel', 
'/boot/vmlinuz-2.6-xen0'], ['ramdisk', '/boot/initrd.img-2.6.16.29-xenU'], 
['root', '/dev/hda1'], ['args', '3']], 'on_poweroff': None, 'bootloader_args': 
None, 'cpus': None, 'name': 'vm01', 'backend': [], 'vcpus': 1, 'cpu_weight': 
None, 'features': None, 'vcpu_avail': None, 'memory': 32, 'device': [('tap', 
['tap', ['uname', 'tap:qcow:/opt/wosc/vm01.qcow'], ['dev', 'hda1'], ['mode', 
'w']]), ('tap', ['tap', ['uname', 'tap:aio:/opt/wosc/vm01-swap.img'], ['dev', 
'hda2'], ['mode', 'w']]), ('vif', ['vif'])], 'bootloader': None, 'cpu': None, 
'maxmem': None}
[2006-11-10 09:35:36 xend.XendDomainInfo 3446] DEBUG (__init__:1072) 
XendDomainInfo.construct: None
[2006-11-10 09:35:36 xend.XendDomainInfo 3446] DEBUG (__init__:1072) 
XendDomainInfo.initDomain: 1 1.0
[2006-11-10 09:35:36 xend 3446] DEBUG (__init__:1072) Balloon: 32828 KiB free; 
need 32768; done.
[2006-11-10 09:35:36 xend 3446] INFO (__init__:1072) buildDomain os=linux dom=1 
vcpus=1
[2006-11-10 09:35:36 xend 3446] DEBUG (__init__:1072) dom            = 1
[2006-11-10 09:35:36 xend 3446] DEBUG (__init__:1072) image          = 
/boot/vmlinuz-2.6-xen0
[2006-11-10 09:35:36 xend 3446] DEBUG (__init__:1072) store_evtchn   = 1
[2006-11-10 09:35:36 xend 3446] DEBUG (__init__:1072) console_evtchn = 2
[2006-11-10 09:35:36 xend 3446] DEBUG (__init__:1072) cmdline        =  
root=/dev/hda1 3
[2006-11-10 09:35:36 xend 3446] DEBUG (__init__:1072) ramdisk        = 
/boot/initrd.img-2.6.16.29-xenU
[2006-11-10 09:35:36 xend 3446] DEBUG (__init__:1072) vcpus          = 1
[2006-11-10 09:35:36 xend 3446] DEBUG (__init__:1072) features       =
[2006-11-10 09:35:36 xend 3446] DEBUG (__init__:1072) DevController: writing 
{'backend-id': '0', 'virtual-device': '769', 'device-type': 'disk', 'state': 
'1', 'backend': '/local/domain/0/backend/tap/1/769'} to 
/local/domain/1/device/vbd/769.
[2006-11-10 09:35:36 xend 3446] DEBUG (__init__:1072) DevController: writing 
{'domain': 'vm01', 'frontend': '/local/domain/1/device/vbd/769', 'dev': 'hda1', 
'state': '1', 'params': 'qcow:/opt/wosc/vm01.qcow', 'mode': 'w', 'online': '1', 
'frontend-id': '1', 'type': 'tap'} to /local/domain/0/backend/tap/1/769.
[2006-11-10 09:35:36 xend 3446] DEBUG (__init__:1072) DevController: writing 
{'backend-id': '0', 'virtual-device': '770', 'device-type': 'disk', 'state': 
'1', 'backend': '/local/domain/0/backend/tap/1/770'} to 
/local/domain/1/device/vbd/770.
[2006-11-10 09:35:36 xend 3446] DEBUG (__init__:1072) DevController: writing 
{'domain': 'vm01', 'frontend': '/local/domain/1/device/vbd/770', 'dev': 'hda2', 
'state': '1', 'params': 'aio:/opt/wosc/vm01-swap.img', 'mode': 'w', 'online': 
'1', 'frontend-id': '1', 'type': 'tap'} to /local/domain/0/backend/tap/1/770.
[2006-11-10 09:35:36 xend 3446] DEBUG (__init__:1072) DevController: writing 
{'backend-id': '0', 'mac': '00:16:3e:36:5b:cb', 'handle': '0', 'state': '1', 
'backend': '/local/domain/0/backend/vif/1/0'} to /local/domain/1/device/vif/0.
[2006-11-10 09:35:36 xend 3446] DEBUG (__init__:1072) DevController: writing 
{'domain': 'vm01', 'handle': '0', 'script': '/etc/xen/scripts/vif-bridge', 
'state': '1', 'frontend': '/local/domain/1/device/vif/0', 'mac': 
'00:16:3e:36:5b:cb', 'online': '1', 'frontend-id': '1'} to 
/local/domain/0/backend/vif/1/0.
[2006-11-10 09:35:37 xend.XendDomainInfo 3446] DEBUG (__init__:1072) Storing VM 
details: {'shadow_memory': '0', 'uuid': '071a2275-e0b2-4511-ecd8-f7510366f6a1', 
'on_reboot': 'restart', 'start_time': '1163147737.0', 'on_poweroff': 'destroy', 
'name': 'vm01', 'xend/restart_count': '0', 'vcpus': '1', 'vcpu_avail': '1', 
'memory': '32', 'on_crash': 'restart', 'image': '(linux (kernel 
/boot/vmlinuz-2.6-xen0) (ramdisk /boot/initrd.img-2.6.16.29-xenU) (root 
/dev/hda1) (args 3))', 'maxmem': '32'}
[2006-11-10 09:35:37 xend.XendDomainInfo 3446] DEBUG (__init__:1072) Storing 
domain details: {'console/ring-ref': '71163', 'console/port': '2', 'name': 
'vm01', 'console/limit': '1048576', 'vm': 
'/vm/071a2275-e0b2-4511-ecd8-f7510366f6a1', 'domid': '1', 'cpu/0/availability': 
'online', 'memory/target': '32768', 'store/ring-ref': '71164', 'store/port': 
'1'}
[2006-11-10 09:35:37 xend.XendDomainInfo 3446] DEBUG (__init__:1072) 
XendDomainInfo.handleShutdownWatch
[2006-11-10 09:35:37 xend 3446] DEBUG (__init__:1072) Waiting for devices vif.
[2006-11-10 09:35:37 xend 3446] DEBUG (__init__:1072) Waiting for 0.
[2006-11-10 09:35:37 xend 3446] DEBUG (__init__:1072) hotplugStatusCallback 
/local/domain/0/backend/vif/1/0/hotplug-status.
[2006-11-10 09:35:37 xend 3446] DEBUG (__init__:1072) hotplugStatusCallback 
/local/domain/0/backend/vif/1/0/hotplug-status.
[2006-11-10 09:35:37 xend 3446] DEBUG (__init__:1072) hotplugStatusCallback 1.
[2006-11-10 09:35:37 xend 3446] DEBUG (__init__:1072) Waiting for devices usb.
[2006-11-10 09:35:37 xend 3446] DEBUG (__init__:1072) Waiting for devices vbd.
[2006-11-10 09:35:37 xend 3446] DEBUG (__init__:1072) Waiting for devices irq.
[2006-11-10 09:35:37 xend 3446] DEBUG (__init__:1072) Waiting for devices pci.
[2006-11-10 09:35:37 xend 3446] DEBUG (__init__:1072) Waiting for devices 
ioports.
[2006-11-10 09:35:37 xend 3446] DEBUG (__init__:1072) Waiting for devices tap.
[2006-11-10 09:35:37 xend 3446] DEBUG (__init__:1072) Waiting for 769.
[2006-11-10 09:35:37 xend 3446] DEBUG (__init__:1072) hotplugStatusCallback 
/local/domain/0/backend/tap/1/769/hotplug-status.
[2006-11-10 09:35:37 xend 3446] DEBUG (__init__:1072) hotplugStatusCallback 1.
[2006-11-10 09:35:37 xend 3446] DEBUG (__init__:1072) Waiting for 770.
[2006-11-10 09:35:37 xend 3446] DEBUG (__init__:1072) hotplugStatusCallback 
/local/domain/0/backend/tap/1/770/hotplug-status.
[2006-11-10 09:35:37 xend 3446] DEBUG (__init__:1072) hotplugStatusCallback 1.
[2006-11-10 09:35:37 xend 3446] DEBUG (__init__:1072) Waiting for devices vtpm.
[2006-11-10 09:35:37 xend 3446] INFO (__init__:1072) Domain vm01 (1) unpaused.
[2006-11-10 09:36:20 xend.XendDomainInfo 3446] DEBUG (__init__:1072) 
XendDomainInfo.destroy: domid=1
[2006-11-10 09:36:20 xend.XendDomainInfo 3446] DEBUG (__init__:1072) 
XendDomainInfo.destroyDomain(1)

# cat /var/log/xen/xend-debug.log
Traceback (most recent call last):
  File "SocketServer.py", line 463, in process_request_thread
    self.finish_request(request, client_address)
  File "SocketServer.py", line 254, in finish_request
    self.RequestHandlerClass(request, client_address, self)
  File "SocketServer.py", line 521, in __init__
    self.handle()
  File "BaseHTTPServer.py", line 316, in handle
    self.handle_one_request()
  File "BaseHTTPServer.py", line 310, in handle_one_request
    method()
  File "/usr/lib/python/xen/util/xmlrpclib2.py", line 66, in do_POST
    self.send_response(200)
  File "BaseHTTPServer.py", line 367, in send_response
    self.wfile.write("%s %d %s\r\n" %
  File "socket.py", line 248, in write
    self.flush()
  File "socket.py", line 235, in flush
    self._sock.sendall(buffer)
error: (32, 'Broken pipe')

# cat /var/log/xen/xen-hotplug.log
Nothing to flush.
Nothing to flush.
Nothing to flush.
Nothing to flush.



_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-devel