[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[Xen-devel] Re: Problem with DomU devices not found after domain reboot using Xen 4.1.1 on NetBSD



Hello,

I've been able to reproduce the error, using "xm shutdown <domu>" on
Xen 4.1.1 the devices didn't get detached, here is the output:

xbd backend: detach device dm0f for domain 3
xbd backend: detach device dm0d for domain 3
xbd backend: detach device dm0e for domain 3
xenbus: can't get state for backend/vbd/3/51714 (2)
xenbus: can't get state for backend/vif/3/0 (2)
Jul  7 09:29:06 odin xenbackendd[399]: Failed to read
/local/domain/0/backend/vif/3/0/script (No such file or directory)
xenbus: can't get state for backend/vif/3/1 (2)
Jul  7 09:29:06 odin xenbackendd[399]: Failed to read
/local/domain/0/backend/vif/3/1/script (No such file or directory)
xenbus: can't get state for backend/vif/3/2 (2)
Jul  7 09:29:06 odin xenbackendd[399]: Failed to read
/local/domain/0/backend/vif/3/2/script (No such file or directory)
xenbus: can't get state for backend/vif/3/3 (2)
Jul  7 09:29:06 odin xenbackendd[399]: Failed to read
/local/domain/0/backend/vif/3/3/script (No such file or directory)
xenbus: can't get state for backend/vif/3/4 (2)
Jul  7 09:29:06 odin xenbackendd[399]: Failed to read
/local/domain/0/backend/vif/3/4/script (No such file or directory)
Jul  7 09:29:06 odin xenbackendd[399]: Failed to read
/local/domain/0/backend/console/3/0/script (No such file or directory)
xenbus: can't get state for backend/vbd/3/51714 (2)
xenbus: can't get state for backend/vbd/3/51713 (2)
xenbus: can't get state for backend/vbd/3/51728 (2)

Then when I try to start the domu again, I get the following messages:

xbdback backend/vbd/6/51714: can't VOP_OPEN device 0xa904: 16
xbdback backend/vbd/6/51713: can't VOP_OPEN device 0xa903: 16
xbdback backend/vbd/6/51713: can't VOP_OPEN device 0xa903: 16
xbdback backend/vbd/6/51728: can't VOP_OPEN device 0xa905: 16
xbdback backend/vbd/6/51728: can't VOP_OPEN device 0xa905: 16
Jul  7 09:32:43 odin xenbackendd[399]: Failed to read
/local/domain/0/backend/console/6/0/script (No such file or directory)

And the domain is unable to boot if I start it again, here are the
significant messages from domu boot:

[    5.416087] XENBUS: Waiting for devices to initialise:
295s...290s...285s...280s...275s...270s...265s...260s...255s...250s...245s...240s...235s...230s...225s...220s...215s...210s...205s...200s...195s...190s...185s...180s...175s...170s...165s...160s...155s...150s...145s...140s...135s...130s...125s...udevd[47]:
worker [54] unexpectedly returned with status 0x0100

udevd[47]: worker [54] failed while handling '/devices/vbd-51713'

udevd[47]: worker [55] unexpectedly returned with status 0x0100

udevd[47]: worker [55] failed while handling '/devices/vbd-51714'

udevd[47]: worker [56] unexpectedly returned with status 0x0100

udevd[47]: worker [56] failed while handling '/devices/vbd-51728'

It seems like none of the filesystems can be attached. Here's the
output from xenstore-ls -fp after the domu has been destroyed:

/tool = ""   (n0)
/tool/xenstored = ""   (n0)
/local = ""   (n0)
/local/pool = ""   (n0)
/local/pool/0 = ""   (n0)
/local/pool/0/other_config = ""   (n0)
/local/pool/0/description = "Pool-0"   (n0)
/local/pool/0/uuid = "a714f371-4b33-2a59-11e8-ab98c1e53c6d"   (n0)
/local/pool/0/name = "Pool-0"   (n0)
/local/domain = ""   (n0)
/local/domain/0 = ""   (r0)
/local/domain/0/vm = "/vm/00000000-0000-0000-0000-000000000000"   (r0)
/local/domain/0/device = ""   (n0)
/local/domain/0/control = ""   (n0)
/local/domain/0/control/platform-feature-multiprocessor-suspend = "1"   (n0)
/local/domain/0/error = ""   (n0)
/local/domain/0/memory = ""   (n0)
/local/domain/0/memory/target = "524288"   (n0)
/local/domain/0/guest = ""   (n0)
/local/domain/0/hvmpv = ""   (n0)
/local/domain/0/data = ""   (n0)
/local/domain/0/description = ""   (r0)
/local/domain/0/console = ""   (r0)
/local/domain/0/console/limit = "1048576"   (r0)
/local/domain/0/console/type = "xenconsoled"   (r0)
/local/domain/0/domid = "0"   (r0)
/local/domain/0/cpu = ""   (r0)
/local/domain/0/cpu/0 = ""   (r0)
/local/domain/0/cpu/0/availability = "online"   (r0)
/local/domain/0/name = "Domain-0"   (r0)
/local/domain/0/device-model = ""   (r0)
/local/domain/0/device-model/4 = ""   (n0,b4)
/local/domain/0/device-model/4/disable_pf = "0"   (r0)
/local/domain/0/device-model/4/state = "running"   (n0,b4)
/local/domain/0/backend = ""   (r0)
/local/domain/0/backend/vfb = ""   (r0)
/local/domain/0/backend/vfb/1 = ""   (r0)
/local/domain/0/backend/vfb/4 = ""   (r0)
/local/domain/0/backend/vfb/4/0 = ""   (n0,r4)
/local/domain/0/backend/vfb/4/0/vncunused = "1"   (n0,r4)
/local/domain/0/backend/vfb/4/0/domain = "pfsense"   (n0,r4)
/local/domain/0/backend/vfb/4/0/vnc = "1"   (n0,r4)
/local/domain/0/backend/vfb/4/0/uuid =
"41a1d9f5-be54-c3c1-7f47-74f2588f7cbc"   (n0,r4)
/local/domain/0/backend/vfb/4/0/vnclisten = "0.0.0.0"   (n0,r4)
/local/domain/0/backend/vfb/4/0/frontend =
"/local/domain/4/device/vfb/0"   (n0,r4)
/local/domain/0/backend/vfb/4/0/vncpasswd = "XXXXX"   (n0,r4)
/local/domain/0/backend/vfb/4/0/state = "1"   (n0,r4)
/local/domain/0/backend/vfb/4/0/keymap = "es"   (n0,r4)
/local/domain/0/backend/vfb/4/0/location = "0.0.0.0:5900"   (n0,r4)
/local/domain/0/backend/vfb/4/0/online = "1"   (n0,r4)
/local/domain/0/backend/vfb/4/0/frontend-id = "4"   (n0,r4)
/local/domain/0/backend/vbd = ""   (r0)
/local/domain/0/backend/vbd/1 = ""   (r0)
/local/domain/0/backend/vbd/2 = ""   (r0)
/local/domain/0/backend/vbd/2/51714 = ""   (n0,r2)
/local/domain/0/backend/vbd/2/51714/domain = "monitor"   (n0,r2)
/local/domain/0/backend/vbd/2/51714/frontend =
"/local/domain/2/device/vbd/51714"   (n0,r2)
/local/domain/0/backend/vbd/2/51714/uuid =
"efc17180-4d84-fb54-6274-f8daa242ecfa"   (n0,r2)
/local/domain/0/backend/vbd/2/51714/bootable = "1"   (n0,r2)
/local/domain/0/backend/vbd/2/51714/dev = "xvda2"   (n0,r2)
/local/domain/0/backend/vbd/2/51714/state = "4"   (n0,r2)
/local/domain/0/backend/vbd/2/51714/params =
"/dev/mapper/guests-monitor"   (n0,r2)
/local/domain/0/backend/vbd/2/51714/mode = "w"   (n0,r2)
/local/domain/0/backend/vbd/2/51714/online = "1"   (n0,r2)
/local/domain/0/backend/vbd/2/51714/frontend-id = "2"   (n0,r2)
/local/domain/0/backend/vbd/2/51714/type = "phy"   (n0,r2)
/local/domain/0/backend/vbd/2/51714/physical-device = "43270"   (n0,r2)
/local/domain/0/backend/vbd/2/51714/hotplug-status = "connected"   (n0,r2)
/local/domain/0/backend/vbd/2/51714/sectors = "20971520"   (n0,r2)
/local/domain/0/backend/vbd/2/51714/info = "0"   (n0,r2)
/local/domain/0/backend/vbd/2/51714/sector-size = "512"   (n0,r2)
/local/domain/0/backend/vbd/2/51714/feature-flush-cache = "1"   (n0,r2)
/local/domain/0/backend/vbd/2/51713 = ""   (n0,r2)
/local/domain/0/backend/vbd/2/51713/domain = "monitor"   (n0,r2)
/local/domain/0/backend/vbd/2/51713/frontend =
"/local/domain/2/device/vbd/51713"   (n0,r2)
/local/domain/0/backend/vbd/2/51713/uuid =
"1da48c35-2fb6-3662-1260-2c5e7851b1f1"   (n0,r2)
/local/domain/0/backend/vbd/2/51713/bootable = "0"   (n0,r2)
/local/domain/0/backend/vbd/2/51713/dev = "xvda1"   (n0,r2)
/local/domain/0/backend/vbd/2/51713/state = "4"   (n0,r2)
/local/domain/0/backend/vbd/2/51713/params =
"/dev/mapper/guests-monitorswap"   (n0,r2)
/local/domain/0/backend/vbd/2/51713/mode = "w"   (n0,r2)
/local/domain/0/backend/vbd/2/51713/online = "1"   (n0,r2)
/local/domain/0/backend/vbd/2/51713/frontend-id = "2"   (n0,r2)
/local/domain/0/backend/vbd/2/51713/type = "phy"   (n0,r2)
/local/domain/0/backend/vbd/2/51713/physical-device = "43271"   (n0,r2)
/local/domain/0/backend/vbd/2/51713/hotplug-status = "connected"   (n0,r2)
/local/domain/0/backend/vbd/2/51713/sectors = "2097152"   (n0,r2)
/local/domain/0/backend/vbd/2/51713/info = "0"   (n0,r2)
/local/domain/0/backend/vbd/2/51713/sector-size = "512"   (n0,r2)
/local/domain/0/backend/vbd/2/51713/feature-flush-cache = "1"   (n0,r2)
/local/domain/0/backend/vbd/3 = ""   (r0)
/local/domain/0/backend/vbd/3/51714 = ""   (r0)
/local/domain/0/backend/vbd/3/51714/online = "0"   (r0)
/local/domain/0/backend/vbd/3/51714/state = "5"   (r0)
/local/domain/0/backend/vbd/3/51713 = ""   (r0)
/local/domain/0/backend/vbd/3/51713/online = "0"   (r0)
/local/domain/0/backend/vbd/3/51713/state = "5"   (r0)
/local/domain/0/backend/vbd/3/51728 = ""   (r0)
/local/domain/0/backend/vbd/3/51728/online = "0"   (r0)
/local/domain/0/backend/vbd/3/51728/state = "5"   (r0)
/local/domain/0/backend/vbd/4 = ""   (r0)
/local/domain/0/backend/vbd/4/51712 = ""   (n0,r4)
/local/domain/0/backend/vbd/4/51712/domain = "pfsense"   (n0,r4)
/local/domain/0/backend/vbd/4/51712/frontend =
"/local/domain/4/device/vbd/51712"   (n0,r4)
/local/domain/0/backend/vbd/4/51712/uuid =
"e443ce63-c72a-032b-a5c2-a2947165b5bb"   (n0,r4)
/local/domain/0/backend/vbd/4/51712/bootable = "1"   (n0,r4)
/local/domain/0/backend/vbd/4/51712/dev = "xvda"   (n0,r4)
/local/domain/0/backend/vbd/4/51712/state = "4"   (n0,r4)
/local/domain/0/backend/vbd/4/51712/params =
"/dev/mapper/guests-pfsense"   (n0,r4)
/local/domain/0/backend/vbd/4/51712/mode = "w"   (n0,r4)
/local/domain/0/backend/vbd/4/51712/online = "1"   (n0,r4)
/local/domain/0/backend/vbd/4/51712/frontend-id = "4"   (n0,r4)
/local/domain/0/backend/vbd/4/51712/type = "phy"   (n0,r4)
/local/domain/0/backend/vbd/4/51712/physical-device = "43265"   (n0,r4)
/local/domain/0/backend/vbd/4/51712/hotplug-status = "connected"   (n0,r4)
/local/domain/0/backend/vbd/4/51712/sectors = "10485760"   (n0,r4)
/local/domain/0/backend/vbd/4/51712/info = "0"   (n0,r4)
/local/domain/0/backend/vbd/4/51712/sector-size = "512"   (n0,r4)
/local/domain/0/backend/vbd/4/51712/feature-flush-cache = "1"   (n0,r4)
/local/domain/0/backend/vbd/6 = ""   (r0)
/local/domain/0/backend/vif = ""   (r0)
/local/domain/0/backend/vif/1 = ""   (r0)
/local/domain/0/backend/vif/2 = ""   (r0)
/local/domain/0/backend/vif/2/0 = ""   (n0,r2)
/local/domain/0/backend/vif/2/0/bridge = "bridge1"   (n0,r2)
/local/domain/0/backend/vif/2/0/domain = "monitor"   (n0,r2)
/local/domain/0/backend/vif/2/0/handle = "0"   (n0,r2)
/local/domain/0/backend/vif/2/0/uuid =
"faa22b0c-f4ab-5b48-0163-b8fa5698ea59"   (n0,r2)
/local/domain/0/backend/vif/2/0/script =
"/usr/pkg/etc/xen/scripts/vif-bridge"   (n0,r2)
/local/domain/0/backend/vif/2/0/state = "4"   (n0,r2)
/local/domain/0/backend/vif/2/0/frontend =
"/local/domain/2/device/vif/0"   (n0,r2)
/local/domain/0/backend/vif/2/0/mac = "00:16:3e:7d:57:5a"   (n0,r2)
/local/domain/0/backend/vif/2/0/online = "1"   (n0,r2)
/local/domain/0/backend/vif/2/0/frontend-id = "2"   (n0,r2)
/local/domain/0/backend/vif/2/0/vifname = "xvif2i0"   (n0,r2)
/local/domain/0/backend/vif/2/0/feature-rx-copy = "1"   (n0,r2)
/local/domain/0/backend/vif/2/0/feature-rx-flip = "1"   (n0,r2)
/local/domain/0/backend/vif/2/0/hotplug-status = "connected"   (n0,r2)
/local/domain/0/backend/vif/3 = ""   (r0)
/local/domain/0/backend/vif/3/0 = ""   (r0)
/local/domain/0/backend/vif/3/0/online = "0"   (r0)
/local/domain/0/backend/vif/3/0/state = "5"   (r0)
/local/domain/0/backend/vif/3/1 = ""   (r0)
/local/domain/0/backend/vif/3/1/online = "0"   (r0)
/local/domain/0/backend/vif/3/1/state = "5"   (r0)
/local/domain/0/backend/vif/3/2 = ""   (r0)
/local/domain/0/backend/vif/3/2/online = "0"   (r0)
/local/domain/0/backend/vif/3/2/state = "5"   (r0)
/local/domain/0/backend/vif/3/3 = ""   (r0)
/local/domain/0/backend/vif/3/3/online = "0"   (r0)
/local/domain/0/backend/vif/3/3/state = "5"   (r0)
/local/domain/0/backend/vif/3/4 = ""   (r0)
/local/domain/0/backend/vif/3/4/online = "0"   (r0)
/local/domain/0/backend/vif/3/4/state = "5"   (r0)
/local/domain/0/backend/vif/4 = ""   (r0)
/local/domain/0/backend/vif/4/0 = ""   (n0,r4)
/local/domain/0/backend/vif/4/0/bridge = "bridge0"   (n0,r4)
/local/domain/0/backend/vif/4/0/domain = "pfsense"   (n0,r4)
/local/domain/0/backend/vif/4/0/handle = "0"   (n0,r4)
/local/domain/0/backend/vif/4/0/uuid =
"57503098-06de-0da2-db1c-549420a9c940"   (n0,r4)
/local/domain/0/backend/vif/4/0/script =
"/usr/pkg/etc/xen/scripts/vif-bridge"   (n0,r4)
/local/domain/0/backend/vif/4/0/state = "2"   (n0,r4)
/local/domain/0/backend/vif/4/0/frontend =
"/local/domain/4/device/vif/0"   (n0,r4)
/local/domain/0/backend/vif/4/0/mac = "00:16:3e:4e:bf:43"   (n0,r4)
/local/domain/0/backend/vif/4/0/online = "1"   (n0,r4)
/local/domain/0/backend/vif/4/0/frontend-id = "4"   (n0,r4)
/local/domain/0/backend/vif/4/0/model = "e1000"   (n0,r4)
/local/domain/0/backend/vif/4/0/vifname = "xvif4i0"   (n0,r4)
/local/domain/0/backend/vif/4/0/feature-rx-copy = "1"   (n0,r4)
/local/domain/0/backend/vif/4/0/feature-rx-flip = "1"   (n0,r4)
/local/domain/0/backend/vif/4/0/hotplug-status = "connected"   (n0,r4)
/local/domain/0/backend/vif/4/1 = ""   (n0,r4)
/local/domain/0/backend/vif/4/1/bridge = "bridge0"   (n0,r4)
/local/domain/0/backend/vif/4/1/domain = "pfsense"   (n0,r4)
/local/domain/0/backend/vif/4/1/handle = "1"   (n0,r4)
/local/domain/0/backend/vif/4/1/uuid =
"5e850a9f-6ae0-36ab-a395-6bc30a564cdd"   (n0,r4)
/local/domain/0/backend/vif/4/1/script =
"/usr/pkg/etc/xen/scripts/vif-bridge"   (n0,r4)
/local/domain/0/backend/vif/4/1/state = "2"   (n0,r4)
/local/domain/0/backend/vif/4/1/frontend =
"/local/domain/4/device/vif/1"   (n0,r4)
/local/domain/0/backend/vif/4/1/mac = "00:16:3e:26:41:7a"   (n0,r4)
/local/domain/0/backend/vif/4/1/online = "1"   (n0,r4)
/local/domain/0/backend/vif/4/1/frontend-id = "4"   (n0,r4)
/local/domain/0/backend/vif/4/1/model = "e1000"   (n0,r4)
/local/domain/0/backend/vif/4/1/vifname = "xvif4i1"   (n0,r4)
/local/domain/0/backend/vif/4/1/feature-rx-copy = "1"   (n0,r4)
/local/domain/0/backend/vif/4/1/feature-rx-flip = "1"   (n0,r4)
/local/domain/0/backend/vif/4/1/hotplug-status = "connected"   (n0,r4)
/local/domain/0/backend/vif/4/2 = ""   (n0,r4)
/local/domain/0/backend/vif/4/2/bridge = "bridge2301"   (n0,r4)
/local/domain/0/backend/vif/4/2/domain = "pfsense"   (n0,r4)
/local/domain/0/backend/vif/4/2/handle = "2"   (n0,r4)
/local/domain/0/backend/vif/4/2/uuid =
"08569aa3-1fc1-d557-a2ec-1aad73db83b6"   (n0,r4)
/local/domain/0/backend/vif/4/2/script =
"/usr/pkg/etc/xen/scripts/vif-bridge"   (n0,r4)
/local/domain/0/backend/vif/4/2/state = "2"   (n0,r4)
/local/domain/0/backend/vif/4/2/frontend =
"/local/domain/4/device/vif/2"   (n0,r4)
/local/domain/0/backend/vif/4/2/mac = "00:16:3e:5b:42:4c"   (n0,r4)
/local/domain/0/backend/vif/4/2/online = "1"   (n0,r4)
/local/domain/0/backend/vif/4/2/frontend-id = "4"   (n0,r4)
/local/domain/0/backend/vif/4/2/model = "e1000"   (n0,r4)
/local/domain/0/backend/vif/4/2/vifname = "xvif4i2"   (n0,r4)
/local/domain/0/backend/vif/4/2/feature-rx-copy = "1"   (n0,r4)
/local/domain/0/backend/vif/4/2/feature-rx-flip = "1"   (n0,r4)
/local/domain/0/backend/vif/4/2/hotplug-status = "connected"   (n0,r4)
/local/domain/0/backend/vif/4/3 = ""   (n0,r4)
/local/domain/0/backend/vif/4/3/bridge = "bridge2302"   (n0,r4)
/local/domain/0/backend/vif/4/3/domain = "pfsense"   (n0,r4)
/local/domain/0/backend/vif/4/3/handle = "3"   (n0,r4)
/local/domain/0/backend/vif/4/3/uuid =
"ae9fcbff-e023-8c74-09ae-77b77e1d6fb2"   (n0,r4)
/local/domain/0/backend/vif/4/3/script =
"/usr/pkg/etc/xen/scripts/vif-bridge"   (n0,r4)
/local/domain/0/backend/vif/4/3/state = "2"   (n0,r4)
/local/domain/0/backend/vif/4/3/frontend =
"/local/domain/4/device/vif/3"   (n0,r4)
/local/domain/0/backend/vif/4/3/mac = "00:16:3e:02:44:76"   (n0,r4)
/local/domain/0/backend/vif/4/3/online = "1"   (n0,r4)
/local/domain/0/backend/vif/4/3/frontend-id = "4"   (n0,r4)
/local/domain/0/backend/vif/4/3/model = "e1000"   (n0,r4)
/local/domain/0/backend/vif/4/3/vifname = "xvif4i3"   (n0,r4)
/local/domain/0/backend/vif/4/3/feature-rx-copy = "1"   (n0,r4)
/local/domain/0/backend/vif/4/3/feature-rx-flip = "1"   (n0,r4)
/local/domain/0/backend/vif/4/3/hotplug-status = "connected"   (n0,r4)
/local/domain/0/backend/vif/4/4 = ""   (n0,r4)
/local/domain/0/backend/vif/4/4/bridge = "bridge2303"   (n0,r4)
/local/domain/0/backend/vif/4/4/domain = "pfsense"   (n0,r4)
/local/domain/0/backend/vif/4/4/handle = "4"   (n0,r4)
/local/domain/0/backend/vif/4/4/uuid =
"2d8bb556-ef47-62b3-1956-1e8fb5b43f4a"   (n0,r4)
/local/domain/0/backend/vif/4/4/script =
"/usr/pkg/etc/xen/scripts/vif-bridge"   (n0,r4)
/local/domain/0/backend/vif/4/4/state = "2"   (n0,r4)
/local/domain/0/backend/vif/4/4/frontend =
"/local/domain/4/device/vif/4"   (n0,r4)
/local/domain/0/backend/vif/4/4/mac = "00:16:3e:12:18:2c"   (n0,r4)
/local/domain/0/backend/vif/4/4/online = "1"   (n0,r4)
/local/domain/0/backend/vif/4/4/frontend-id = "4"   (n0,r4)
/local/domain/0/backend/vif/4/4/model = "e1000"   (n0,r4)
/local/domain/0/backend/vif/4/4/vifname = "xvif4i4"   (n0,r4)
/local/domain/0/backend/vif/4/4/feature-rx-copy = "1"   (n0,r4)
/local/domain/0/backend/vif/4/4/feature-rx-flip = "1"   (n0,r4)
/local/domain/0/backend/vif/4/4/hotplug-status = "connected"   (n0,r4)
/local/domain/0/backend/vif/4/5 = ""   (n0,r4)
/local/domain/0/backend/vif/4/5/bridge = "bridge2304"   (n0,r4)
/local/domain/0/backend/vif/4/5/domain = "pfsense"   (n0,r4)
/local/domain/0/backend/vif/4/5/handle = "5"   (n0,r4)
/local/domain/0/backend/vif/4/5/uuid =
"af2b48fb-d55c-ecb2-6c45-4669e2b9d93a"   (n0,r4)
/local/domain/0/backend/vif/4/5/script =
"/usr/pkg/etc/xen/scripts/vif-bridge"   (n0,r4)
/local/domain/0/backend/vif/4/5/state = "2"   (n0,r4)
/local/domain/0/backend/vif/4/5/frontend =
"/local/domain/4/device/vif/5"   (n0,r4)
/local/domain/0/backend/vif/4/5/mac = "00:16:3e:1d:d8:cf"   (n0,r4)
/local/domain/0/backend/vif/4/5/online = "1"   (n0,r4)
/local/domain/0/backend/vif/4/5/frontend-id = "4"   (n0,r4)
/local/domain/0/backend/vif/4/5/model = "e1000"   (n0,r4)
/local/domain/0/backend/vif/4/5/vifname = "xvif4i5"   (n0,r4)
/local/domain/0/backend/vif/4/5/feature-rx-copy = "1"   (n0,r4)
/local/domain/0/backend/vif/4/5/feature-rx-flip = "1"   (n0,r4)
/local/domain/0/backend/vif/4/5/hotplug-status = "connected"   (n0,r4)
/local/domain/0/backend/vif/6 = ""   (r0)
/local/domain/0/backend/console = ""   (r0)
/local/domain/0/backend/console/1 = ""   (r0)
/local/domain/0/backend/console/2 = ""   (r0)
/local/domain/0/backend/console/2/0 = ""   (n0,r2)
/local/domain/0/backend/console/2/0/domain = "monitor"   (n0,r2)
/local/domain/0/backend/console/2/0/protocol = "vt100"   (n0,r2)
/local/domain/0/backend/console/2/0/uuid =
"efc75093-b206-744a-a678-f6b6b6fea7bb"   (n0,r2)
/local/domain/0/backend/console/2/0/frontend =
"/local/domain/2/device/console/0"   (n0,r2)
/local/domain/0/backend/console/2/0/state = "1"   (n0,r2)
/local/domain/0/backend/console/2/0/location = "2"   (n0,r2)
/local/domain/0/backend/console/2/0/online = "1"   (n0,r2)
/local/domain/0/backend/console/2/0/frontend-id = "2"   (n0,r2)
/local/domain/0/backend/console/3 = ""   (r0)
/local/domain/0/backend/console/4 = ""   (r0)
/local/domain/0/backend/console/4/0 = ""   (n0,r4)
/local/domain/0/backend/console/4/0/domain = "pfsense"   (n0,r4)
/local/domain/0/backend/console/4/0/protocol = "vt100"   (n0,r4)
/local/domain/0/backend/console/4/0/uuid =
"fae1fdfc-d4b2-5259-fa14-120c8aa18ff1"   (n0,r4)
/local/domain/0/backend/console/4/0/frontend =
"/local/domain/4/device/console/0"   (n0,r4)
/local/domain/0/backend/console/4/0/state = "1"   (n0,r4)
/local/domain/0/backend/console/4/0/location = "3"   (n0,r4)
/local/domain/0/backend/console/4/0/online = "1"   (n0,r4)
/local/domain/0/backend/console/4/0/frontend-id = "4"   (n0,r4)
/local/domain/0/backend/console/6 = ""   (r0)
/local/domain/2 = ""   (n0,r2)
/local/domain/2/vm = "/vm/9ed701d5-5fa4-ca02-f74c-4c08ea68e436"   (n0,r2)
/local/domain/2/device = ""   (n2)
/local/domain/2/device/vbd = ""   (n2)
/local/domain/2/device/vbd/51714 = ""   (n2,r0)
/local/domain/2/device/vbd/51714/virtual-device = "51714"   (n2,r0)
/local/domain/2/device/vbd/51714/device-type = "disk"   (n2,r0)
/local/domain/2/device/vbd/51714/protocol = "x86_32-abi"   (n2,r0)
/local/domain/2/device/vbd/51714/backend-id = "0"   (n2,r0)
/local/domain/2/device/vbd/51714/state = "4"   (n2,r0)
/local/domain/2/device/vbd/51714/backend =
"/local/domain/0/backend/vbd/2/51714"   (n2,r0)
/local/domain/2/device/vbd/51714/ring-ref = "8"   (n2,r0)
/local/domain/2/device/vbd/51714/event-channel = "8"   (n2,r0)
/local/domain/2/device/vbd/51713 = ""   (n2,r0)
/local/domain/2/device/vbd/51713/virtual-device = "51713"   (n2,r0)
/local/domain/2/device/vbd/51713/device-type = "disk"   (n2,r0)
/local/domain/2/device/vbd/51713/protocol = "x86_32-abi"   (n2,r0)
/local/domain/2/device/vbd/51713/backend-id = "0"   (n2,r0)
/local/domain/2/device/vbd/51713/state = "4"   (n2,r0)
/local/domain/2/device/vbd/51713/backend =
"/local/domain/0/backend/vbd/2/51713"   (n2,r0)
/local/domain/2/device/vbd/51713/ring-ref = "9"   (n2,r0)
/local/domain/2/device/vbd/51713/event-channel = "9"   (n2,r0)
/local/domain/2/device/vif = ""   (n2)
/local/domain/2/device/vif/0 = ""   (n2,r0)
/local/domain/2/device/vif/0/mac = "00:16:3e:7d:57:5a"   (n2,r0)
/local/domain/2/device/vif/0/handle = "0"   (n2,r0)
/local/domain/2/device/vif/0/protocol = "x86_32-abi"   (n2,r0)
/local/domain/2/device/vif/0/backend-id = "0"   (n2,r0)
/local/domain/2/device/vif/0/state = "4"   (n2,r0)
/local/domain/2/device/vif/0/backend =
"/local/domain/0/backend/vif/2/0"   (n2,r0)
/local/domain/2/device/vif/0/tx-ring-ref = "768"   (n2,r0)
/local/domain/2/device/vif/0/rx-ring-ref = "769"   (n2,r0)
/local/domain/2/device/vif/0/event-channel = "10"   (n2,r0)
/local/domain/2/device/vif/0/request-rx-copy = "1"   (n2,r0)
/local/domain/2/device/vif/0/feature-rx-notify = "1"   (n2,r0)
/local/domain/2/device/vif/0/feature-sg = "1"   (n2,r0)
/local/domain/2/device/vif/0/feature-gso-tcpv4 = "1"   (n2,r0)
/local/domain/2/device/vif/0/feature-smart-poll = "0"   (n2,r0)
/local/domain/2/device/console = ""   (n2)
/local/domain/2/device/console/0 = ""   (n2,r0)
/local/domain/2/device/console/0/protocol = "x86_32-abi"   (n2,r0)
/local/domain/2/device/console/0/state = "1"   (n2,r0)
/local/domain/2/device/console/0/backend-id = "0"   (n2,r0)
/local/domain/2/device/console/0/backend =
"/local/domain/0/backend/console/2/0"   (n2,r0)
/local/domain/2/control = ""   (n2)
/local/domain/2/control/platform-feature-multiprocessor-suspend = "1"   (n2)
/local/domain/2/error = ""   (n2)
/local/domain/2/memory = ""   (n2)
/local/domain/2/memory/target = "1048576"   (n2)
/local/domain/2/guest = ""   (n2)
/local/domain/2/hvmpv = ""   (n2)
/local/domain/2/data = ""   (n2)
/local/domain/2/console = ""   (n0,r2)
/local/domain/2/console/tty = "/dev/pts/1"   (n0,r2)
/local/domain/2/console/ring-ref = "2234588"   (n0,r2)
/local/domain/2/console/port = "2"   (n0,r2)
/local/domain/2/console/limit = "1048576"   (n0,r2)
/local/domain/2/console/type = "xenconsoled"   (n0,r2)
/local/domain/2/device-misc = ""   (n0,r2)
/local/domain/2/device-misc/vif = ""   (n0,r2)
/local/domain/2/device-misc/vif/nextDeviceID = "1"   (n0,r2)
/local/domain/2/device-misc/console = ""   (n0,r2)
/local/domain/2/device-misc/console/nextDeviceID = "1"   (n0,r2)
/local/domain/2/image = ""   (n0,r2)
/local/domain/2/image/entry = "3242176512"   (n0,r2)
/local/domain/2/image/loader = "generic"   (n0,r2)
/local/domain/2/image/hv-start-low = "4118806528"   (n0,r2)
/local/domain/2/image/guest-os = "linux"   (n0,r2)
/local/domain/2/image/hypercall-page = "3238010880"   (n0,r2)
/local/domain/2/image/guest-version = "2.6"   (n0,r2)
/local/domain/2/image/pae-mode = "yes"   (n0,r2)
/local/domain/2/image/paddr-offset = "0"   (n0,r2)
/local/domain/2/image/virt-base = "3221225472"   (n0,r2)
/local/domain/2/image/suspend-cancel = "1"   (n0,r2)
/local/domain/2/image/features = ""   (n0,r2)
/local/domain/2/image/features/pae-pgdir-above-4gb = "1"   (n0,r2)
/local/domain/2/image/features/writable-page-tables = "0"   (n0,r2)
/local/domain/2/image/xen-version = "xen-3.0"   (n0,r2)
/local/domain/2/store = ""   (n0,r2)
/local/domain/2/store/ring-ref = "2234589"   (n0,r2)
/local/domain/2/store/port = "1"   (n0,r2)
/local/domain/2/description = ""   (n0,r2)
/local/domain/2/cpu = ""   (n0,r2)
/local/domain/2/cpu/0 = ""   (n0,r2)
/local/domain/2/cpu/0/availability = "online"   (n0,r2)
/local/domain/2/name = "monitor"   (n0,r2)
/local/domain/2/domid = "2"   (n0,r2)
/local/domain/4 = ""   (n0,r4)
/local/domain/4/vm = "/vm/134b4005-025d-d91e-9516-a995e88b818e"   (n0,r4)
/local/domain/4/device = ""   (n4)
/local/domain/4/device/vfb = ""   (n4)
/local/domain/4/device/vfb/0 = ""   (n4,r0)
/local/domain/4/device/vfb/0/state = "1"   (n4,r0)
/local/domain/4/device/vfb/0/backend-id = "0"   (n4,r0)
/local/domain/4/device/vfb/0/backend =
"/local/domain/0/backend/vfb/4/0"   (n4,r0)
/local/domain/4/device/console = ""   (n4)
/local/domain/4/device/console/0 = ""   (n4,r0)
/local/domain/4/device/console/0/state = "1"   (n4,r0)
/local/domain/4/device/console/0/backend-id = "0"   (n4,r0)
/local/domain/4/device/console/0/backend =
"/local/domain/0/backend/console/4/0"   (n4,r0)
/local/domain/4/device/vbd = ""   (n4)
/local/domain/4/device/vbd/51712 = ""   (n4,r0)
/local/domain/4/device/vbd/51712/backend-id = "0"   (n4,r0)
/local/domain/4/device/vbd/51712/virtual-device = "51712"   (n4,r0)
/local/domain/4/device/vbd/51712/device-type = "disk"   (n4,r0)
/local/domain/4/device/vbd/51712/state = "1"   (n4,r0)
/local/domain/4/device/vbd/51712/backend =
"/local/domain/0/backend/vbd/4/51712"   (n4,r0)
/local/domain/4/device/vif = ""   (n4)
/local/domain/4/device/vif/0 = ""   (n4,r0)
/local/domain/4/device/vif/0/backend-id = "0"   (n4,r0)
/local/domain/4/device/vif/0/mac = "00:16:3e:4e:bf:43"   (n4,r0)
/local/domain/4/device/vif/0/handle = "0"   (n4,r0)
/local/domain/4/device/vif/0/state = "1"   (n4,r0)
/local/domain/4/device/vif/0/backend =
"/local/domain/0/backend/vif/4/0"   (n4,r0)
/local/domain/4/device/vif/1 = ""   (n4,r0)
/local/domain/4/device/vif/1/backend-id = "0"   (n4,r0)
/local/domain/4/device/vif/1/mac = "00:16:3e:26:41:7a"   (n4,r0)
/local/domain/4/device/vif/1/handle = "1"   (n4,r0)
/local/domain/4/device/vif/1/state = "1"   (n4,r0)
/local/domain/4/device/vif/1/backend =
"/local/domain/0/backend/vif/4/1"   (n4,r0)
/local/domain/4/device/vif/2 = ""   (n4,r0)
/local/domain/4/device/vif/2/backend-id = "0"   (n4,r0)
/local/domain/4/device/vif/2/mac = "00:16:3e:5b:42:4c"   (n4,r0)
/local/domain/4/device/vif/2/handle = "2"   (n4,r0)
/local/domain/4/device/vif/2/state = "1"   (n4,r0)
/local/domain/4/device/vif/2/backend =
"/local/domain/0/backend/vif/4/2"   (n4,r0)
/local/domain/4/device/vif/3 = ""   (n4,r0)
/local/domain/4/device/vif/3/backend-id = "0"   (n4,r0)
/local/domain/4/device/vif/3/mac = "00:16:3e:02:44:76"   (n4,r0)
/local/domain/4/device/vif/3/handle = "3"   (n4,r0)
/local/domain/4/device/vif/3/state = "1"   (n4,r0)
/local/domain/4/device/vif/3/backend =
"/local/domain/0/backend/vif/4/3"   (n4,r0)
/local/domain/4/device/vif/4 = ""   (n4,r0)
/local/domain/4/device/vif/4/backend-id = "0"   (n4,r0)
/local/domain/4/device/vif/4/mac = "00:16:3e:12:18:2c"   (n4,r0)
/local/domain/4/device/vif/4/handle = "4"   (n4,r0)
/local/domain/4/device/vif/4/state = "1"   (n4,r0)
/local/domain/4/device/vif/4/backend =
"/local/domain/0/backend/vif/4/4"   (n4,r0)
/local/domain/4/device/vif/5 = ""   (n4,r0)
/local/domain/4/device/vif/5/backend-id = "0"   (n4,r0)
/local/domain/4/device/vif/5/mac = "00:16:3e:1d:d8:cf"   (n4,r0)
/local/domain/4/device/vif/5/handle = "5"   (n4,r0)
/local/domain/4/device/vif/5/state = "1"   (n4,r0)
/local/domain/4/device/vif/5/backend =
"/local/domain/0/backend/vif/4/5"   (n4,r0)
/local/domain/4/control = ""   (n4)
/local/domain/4/control/platform-feature-multiprocessor-suspend = "1"   (n4)
/local/domain/4/error = ""   (n4)
/local/domain/4/memory = ""   (n4)
/local/domain/4/memory/target = "524288"   (n4)
/local/domain/4/guest = ""   (n4)
/local/domain/4/hvmpv = ""   (n4)
/local/domain/4/data = ""   (n4)
/local/domain/4/device-misc = ""   (n0,r4)
/local/domain/4/device-misc/console = ""   (n0,r4)
/local/domain/4/device-misc/console/nextDeviceID = "1"   (n0,r4)
/local/domain/4/device-misc/vif = ""   (n0,r4)
/local/domain/4/device-misc/vif/nextDeviceID = "6"   (n0,r4)
/local/domain/4/image = ""   (n0,r4)
/local/domain/4/image/device-model-fifo =
"/var/run/xend/dm-4-1309957525.fifo"   (n0,r4)
/local/domain/4/image/device-model-pid = "11478"   (n0,r4)
/local/domain/4/image/suspend-cancel = "1"   (n0,r4)
/local/domain/4/console = ""   (n0,r4)
/local/domain/4/console/port = "3"   (n0,r4)
/local/domain/4/console/limit = "1048576"   (n0,r4)
/local/domain/4/console/type = "ioemu"   (n0,r4)
/local/domain/4/console/vnc-port = "5900"   (n0,r4)
/local/domain/4/console/vnc-listen = "0.0.0.0"   (n0,r4)
/local/domain/4/console/vnc-pass = "XXXXX"   (n0,r4)
/local/domain/4/description = ""   (n0,r4)
/local/domain/4/domid = "4"   (n0,r4)
/local/domain/4/cpu = ""   (n0,r4)
/local/domain/4/cpu/0 = ""   (n0,r4)
/local/domain/4/cpu/0/availability = "online"   (n0,r4)
/local/domain/4/store = ""   (n0,r4)
/local/domain/4/store/ring-ref = "1044476"   (n0,r4)
/local/domain/4/store/port = "2"   (n0,r4)
/local/domain/4/name = "pfsense"   (n0,r4)
/local/domain/4/serial = ""   (n0,r4)
/local/domain/4/serial/0 = ""   (n0,r4)
/local/domain/4/serial/0/tty = "/dev/pts/0"   (n0,r4)
/vm = ""   (n0)
/vm/00000000-0000-0000-0000-000000000000 = ""   (n0)
/vm/00000000-0000-0000-0000-000000000000/on_xend_stop = "ignore"   (n0)
/vm/00000000-0000-0000-0000-000000000000/pool_name = "Pool-0"   (n0)
/vm/00000000-0000-0000-0000-000000000000/shadow_memory = "0"   (n0)
/vm/00000000-0000-0000-0000-000000000000/uuid =
"00000000-0000-0000-0000-000000000000"   (r0)
/vm/00000000-0000-0000-0000-000000000000/on_reboot = "restart"   (n0)
/vm/00000000-0000-0000-0000-000000000000/image = "(linux (kernel '')
(superpages 0) (nomigrate 0) (tsc_mode 0))"   (n0)
/vm/00000000-0000-0000-0000-000000000000/image/ostype = "linux"   (n0)
/vm/00000000-0000-0000-0000-000000000000/image/kernel = ""   (n0)
/vm/00000000-0000-0000-0000-000000000000/image/cmdline = ""   (r0)
/vm/00000000-0000-0000-0000-000000000000/image/ramdisk = ""   (n0)
/vm/00000000-0000-0000-0000-000000000000/on_poweroff = "destroy"   (n0)
/vm/00000000-0000-0000-0000-000000000000/bootloader_args = ""   (n0)
/vm/00000000-0000-0000-0000-000000000000/on_xend_start = "ignore"   (n0)
/vm/00000000-0000-0000-0000-000000000000/on_crash = "restart"   (n0)
/vm/00000000-0000-0000-0000-000000000000/xend = ""   (n0)
/vm/00000000-0000-0000-0000-000000000000/xend/restart_count = "0"   (n0)
/vm/00000000-0000-0000-0000-000000000000/vcpus = "1"   (n0)
/vm/00000000-0000-0000-0000-000000000000/vcpu_avail = "1"   (n0)
/vm/00000000-0000-0000-0000-000000000000/bootloader = ""   (n0)
/vm/00000000-0000-0000-0000-000000000000/name = "Domain-0"   (n0)
/vm/9ed701d5-5fa4-ca02-f74c-4c08ea68e436 = ""   (n0)
/vm/9ed701d5-5fa4-ca02-f74c-4c08ea68e436/image = "(linux (kernel '')
(args 'root=/dev/xvda2 ro ') (superpages 0) (videoram 4) (pci ())
(nomigrate 0) (tsc_mode 0) (notes (HV_START_LOW 41188065\..."  (n0)
/vm/9ed701d5-5fa4-ca02-f74c-4c08ea68e436/image/ostype = "linux"   (n0)
/vm/9ed701d5-5fa4-ca02-f74c-4c08ea68e436/image/kernel =
"/var/run/xend/boot/boot_kernel.FMDkMY"   (n0)
/vm/9ed701d5-5fa4-ca02-f74c-4c08ea68e436/image/cmdline =
"root=/dev/xvda2 ro root=/dev/xvda2 ro "   (n0,r2)
/vm/9ed701d5-5fa4-ca02-f74c-4c08ea68e436/image/ramdisk =
"/var/run/xend/boot/boot_ramdisk.lCAz7b"   (n0)
/vm/9ed701d5-5fa4-ca02-f74c-4c08ea68e436/device = ""   (n0)
/vm/9ed701d5-5fa4-ca02-f74c-4c08ea68e436/device/vbd = ""   (n0)
/vm/9ed701d5-5fa4-ca02-f74c-4c08ea68e436/device/vbd/51714 = ""   (n0)
/vm/9ed701d5-5fa4-ca02-f74c-4c08ea68e436/device/vbd/51714/frontend =
"/local/domain/2/device/vbd/51714"   (n0)
/vm/9ed701d5-5fa4-ca02-f74c-4c08ea68e436/device/vbd/51714/frontend-id
= "2"   (n0)
/vm/9ed701d5-5fa4-ca02-f74c-4c08ea68e436/device/vbd/51714/backend-id =
"0"   (n0)
/vm/9ed701d5-5fa4-ca02-f74c-4c08ea68e436/device/vbd/51714/backend =
"/local/domain/0/backend/vbd/2/51714"   (n0)
/vm/9ed701d5-5fa4-ca02-f74c-4c08ea68e436/device/vbd/51713 = ""   (n0)
/vm/9ed701d5-5fa4-ca02-f74c-4c08ea68e436/device/vbd/51713/frontend =
"/local/domain/2/device/vbd/51713"   (n0)
/vm/9ed701d5-5fa4-ca02-f74c-4c08ea68e436/device/vbd/51713/frontend-id
= "2"   (n0)
/vm/9ed701d5-5fa4-ca02-f74c-4c08ea68e436/device/vbd/51713/backend-id =
"0"   (n0)
/vm/9ed701d5-5fa4-ca02-f74c-4c08ea68e436/device/vbd/51713/backend =
"/local/domain/0/backend/vbd/2/51713"   (n0)
/vm/9ed701d5-5fa4-ca02-f74c-4c08ea68e436/device/vif = ""   (n0)
/vm/9ed701d5-5fa4-ca02-f74c-4c08ea68e436/device/vif/0 = ""   (n0)
/vm/9ed701d5-5fa4-ca02-f74c-4c08ea68e436/device/vif/0/frontend =
"/local/domain/2/device/vif/0"   (n0)
/vm/9ed701d5-5fa4-ca02-f74c-4c08ea68e436/device/vif/0/frontend-id = "2"   (n0)
/vm/9ed701d5-5fa4-ca02-f74c-4c08ea68e436/device/vif/0/backend-id = "0"   (n0)
/vm/9ed701d5-5fa4-ca02-f74c-4c08ea68e436/device/vif/0/backend =
"/local/domain/0/backend/vif/2/0"   (n0)
/vm/9ed701d5-5fa4-ca02-f74c-4c08ea68e436/device/console = ""   (n0)
/vm/9ed701d5-5fa4-ca02-f74c-4c08ea68e436/device/console/0 = ""   (n0)
/vm/9ed701d5-5fa4-ca02-f74c-4c08ea68e436/device/console/0/frontend =
"/local/domain/2/device/console/0"   (n0)
/vm/9ed701d5-5fa4-ca02-f74c-4c08ea68e436/device/console/0/frontend-id
= "2"   (n0)
/vm/9ed701d5-5fa4-ca02-f74c-4c08ea68e436/device/console/0/backend-id =
"0"   (n0)
/vm/9ed701d5-5fa4-ca02-f74c-4c08ea68e436/device/console/0/backend =
"/local/domain/0/backend/console/2/0"   (n0)
/vm/9ed701d5-5fa4-ca02-f74c-4c08ea68e436/on_xend_stop = "ignore"   (n0)
/vm/9ed701d5-5fa4-ca02-f74c-4c08ea68e436/pool_name = "Pool-0"   (n0)
/vm/9ed701d5-5fa4-ca02-f74c-4c08ea68e436/shadow_memory = "0"   (n0)
/vm/9ed701d5-5fa4-ca02-f74c-4c08ea68e436/uuid =
"9ed701d5-5fa4-ca02-f74c-4c08ea68e436"   (n0,r2)
/vm/9ed701d5-5fa4-ca02-f74c-4c08ea68e436/on_reboot = "restart"   (n0)
/vm/9ed701d5-5fa4-ca02-f74c-4c08ea68e436/start_time = "1309863108.89"   (n0)
/vm/9ed701d5-5fa4-ca02-f74c-4c08ea68e436/on_poweroff = "destroy"   (n0)
/vm/9ed701d5-5fa4-ca02-f74c-4c08ea68e436/bootloader_args = "-q"   (n0)
/vm/9ed701d5-5fa4-ca02-f74c-4c08ea68e436/on_xend_start = "ignore"   (n0)
/vm/9ed701d5-5fa4-ca02-f74c-4c08ea68e436/on_crash = "restart"   (n0)
/vm/9ed701d5-5fa4-ca02-f74c-4c08ea68e436/xend = ""   (n0)
/vm/9ed701d5-5fa4-ca02-f74c-4c08ea68e436/xend/restart_count = "0"   (n0)
/vm/9ed701d5-5fa4-ca02-f74c-4c08ea68e436/vcpus = "1"   (n0)
/vm/9ed701d5-5fa4-ca02-f74c-4c08ea68e436/vcpu_avail = "1"   (n0)
/vm/9ed701d5-5fa4-ca02-f74c-4c08ea68e436/bootloader =
"/usr/pkg/bin/pygrub"   (n0)
/vm/9ed701d5-5fa4-ca02-f74c-4c08ea68e436/name = "monitor"   (n0)
/vm/134b4005-025d-d91e-9516-a995e88b818e = ""   (n0)
/vm/134b4005-025d-d91e-9516-a995e88b818e/image = "(hvm (kernel '')
(superpages 0) (videoram 4) (hpet 0) (stdvga 0) (vnclisten 0.0.0.0)
(loader /usr/pkg/lib/xen/boot/hvmloader) (xen_platform_p\..."  (n0)
/vm/134b4005-025d-d91e-9516-a995e88b818e/image/ostype = "hvm"   (n0)
/vm/134b4005-025d-d91e-9516-a995e88b818e/image/kernel = ""   (n0)
/vm/134b4005-025d-d91e-9516-a995e88b818e/image/cmdline = ""   (n0,r4)
/vm/134b4005-025d-d91e-9516-a995e88b818e/image/ramdisk = ""   (n0)
/vm/134b4005-025d-d91e-9516-a995e88b818e/image/dmargs = "-domain-name
pfsense -videoram 4 -k es -vnc 0.0.0.0:0,password -vncunused -vcpus 1
-vcpu_avail 0x1 -boot c -localtime -serial pty -acpi -net \..."
(n0,r4)
/vm/134b4005-025d-d91e-9516-a995e88b818e/image/device-model =
"/usr/pkg/libexec/qemu-dm"   (n0)
/vm/134b4005-025d-d91e-9516-a995e88b818e/image/display = ""   (n0)
/vm/134b4005-025d-d91e-9516-a995e88b818e/vncpasswd = "\000"   (n0,r4)
/vm/134b4005-025d-d91e-9516-a995e88b818e/rtc = ""   (n0)
/vm/134b4005-025d-d91e-9516-a995e88b818e/rtc/timeoffset = "-7199"   (n0,r4)
/vm/134b4005-025d-d91e-9516-a995e88b818e/device = ""   (n0)
/vm/134b4005-025d-d91e-9516-a995e88b818e/device/vfb = ""   (n0)
/vm/134b4005-025d-d91e-9516-a995e88b818e/device/vfb/0 = ""   (n0)
/vm/134b4005-025d-d91e-9516-a995e88b818e/device/vfb/0/frontend =
"/local/domain/4/device/vfb/0"   (n0)
/vm/134b4005-025d-d91e-9516-a995e88b818e/device/vfb/0/frontend-id = "4"   (n0)
/vm/134b4005-025d-d91e-9516-a995e88b818e/device/vfb/0/backend-id = "0"   (n0)
/vm/134b4005-025d-d91e-9516-a995e88b818e/device/vfb/0/backend =
"/local/domain/0/backend/vfb/4/0"   (n0)
/vm/134b4005-025d-d91e-9516-a995e88b818e/device/console = ""   (n0)
/vm/134b4005-025d-d91e-9516-a995e88b818e/device/console/0 = ""   (n0)
/vm/134b4005-025d-d91e-9516-a995e88b818e/device/console/0/frontend =
"/local/domain/4/device/console/0"   (n0)
/vm/134b4005-025d-d91e-9516-a995e88b818e/device/console/0/frontend-id
= "4"   (n0)
/vm/134b4005-025d-d91e-9516-a995e88b818e/device/console/0/backend-id =
"0"   (n0)
/vm/134b4005-025d-d91e-9516-a995e88b818e/device/console/0/backend =
"/local/domain/0/backend/console/4/0"   (n0)
/vm/134b4005-025d-d91e-9516-a995e88b818e/device/vbd = ""   (n0)
/vm/134b4005-025d-d91e-9516-a995e88b818e/device/vbd/51712 = ""   (n0)
/vm/134b4005-025d-d91e-9516-a995e88b818e/device/vbd/51712/frontend =
"/local/domain/4/device/vbd/51712"   (n0)
/vm/134b4005-025d-d91e-9516-a995e88b818e/device/vbd/51712/frontend-id
= "4"   (n0)
/vm/134b4005-025d-d91e-9516-a995e88b818e/device/vbd/51712/backend-id =
"0"   (n0)
/vm/134b4005-025d-d91e-9516-a995e88b818e/device/vbd/51712/backend =
"/local/domain/0/backend/vbd/4/51712"   (n0)
/vm/134b4005-025d-d91e-9516-a995e88b818e/device/vif = ""   (n0)
/vm/134b4005-025d-d91e-9516-a995e88b818e/device/vif/0 = ""   (n0)
/vm/134b4005-025d-d91e-9516-a995e88b818e/device/vif/0/frontend =
"/local/domain/4/device/vif/0"   (n0)
/vm/134b4005-025d-d91e-9516-a995e88b818e/device/vif/0/frontend-id = "4"   (n0)
/vm/134b4005-025d-d91e-9516-a995e88b818e/device/vif/0/backend-id = "0"   (n0)
/vm/134b4005-025d-d91e-9516-a995e88b818e/device/vif/0/backend =
"/local/domain/0/backend/vif/4/0"   (n0)
/vm/134b4005-025d-d91e-9516-a995e88b818e/device/vif/1 = ""   (n0)
/vm/134b4005-025d-d91e-9516-a995e88b818e/device/vif/1/frontend =
"/local/domain/4/device/vif/1"   (n0)
/vm/134b4005-025d-d91e-9516-a995e88b818e/device/vif/1/frontend-id = "4"   (n0)
/vm/134b4005-025d-d91e-9516-a995e88b818e/device/vif/1/backend-id = "0"   (n0)
/vm/134b4005-025d-d91e-9516-a995e88b818e/device/vif/1/backend =
"/local/domain/0/backend/vif/4/1"   (n0)
/vm/134b4005-025d-d91e-9516-a995e88b818e/device/vif/2 = ""   (n0)
/vm/134b4005-025d-d91e-9516-a995e88b818e/device/vif/2/frontend =
"/local/domain/4/device/vif/2"   (n0)
/vm/134b4005-025d-d91e-9516-a995e88b818e/device/vif/2/frontend-id = "4"   (n0)
/vm/134b4005-025d-d91e-9516-a995e88b818e/device/vif/2/backend-id = "0"   (n0)
/vm/134b4005-025d-d91e-9516-a995e88b818e/device/vif/2/backend =
"/local/domain/0/backend/vif/4/2"   (n0)
/vm/134b4005-025d-d91e-9516-a995e88b818e/device/vif/3 = ""   (n0)
/vm/134b4005-025d-d91e-9516-a995e88b818e/device/vif/3/frontend =
"/local/domain/4/device/vif/3"   (n0)
/vm/134b4005-025d-d91e-9516-a995e88b818e/device/vif/3/frontend-id = "4"   (n0)
/vm/134b4005-025d-d91e-9516-a995e88b818e/device/vif/3/backend-id = "0"   (n0)
/vm/134b4005-025d-d91e-9516-a995e88b818e/device/vif/3/backend =
"/local/domain/0/backend/vif/4/3"   (n0)
/vm/134b4005-025d-d91e-9516-a995e88b818e/device/vif/4 = ""   (n0)
/vm/134b4005-025d-d91e-9516-a995e88b818e/device/vif/4/frontend =
"/local/domain/4/device/vif/4"   (n0)
/vm/134b4005-025d-d91e-9516-a995e88b818e/device/vif/4/frontend-id = "4"   (n0)
/vm/134b4005-025d-d91e-9516-a995e88b818e/device/vif/4/backend-id = "0"   (n0)
/vm/134b4005-025d-d91e-9516-a995e88b818e/device/vif/4/backend =
"/local/domain/0/backend/vif/4/4"   (n0)
/vm/134b4005-025d-d91e-9516-a995e88b818e/device/vif/5 = ""   (n0)
/vm/134b4005-025d-d91e-9516-a995e88b818e/device/vif/5/frontend =
"/local/domain/4/device/vif/5"   (n0)
/vm/134b4005-025d-d91e-9516-a995e88b818e/device/vif/5/frontend-id = "4"   (n0)
/vm/134b4005-025d-d91e-9516-a995e88b818e/device/vif/5/backend-id = "0"   (n0)
/vm/134b4005-025d-d91e-9516-a995e88b818e/device/vif/5/backend =
"/local/domain/0/backend/vif/4/5"   (n0)
/vm/134b4005-025d-d91e-9516-a995e88b818e/on_xend_stop = "ignore"   (n0)
/vm/134b4005-025d-d91e-9516-a995e88b818e/pool_name = "Pool-0"   (n0)
/vm/134b4005-025d-d91e-9516-a995e88b818e/shadow_memory = "5"   (n0)
/vm/134b4005-025d-d91e-9516-a995e88b818e/uuid =
"134b4005-025d-d91e-9516-a995e88b818e"   (n0,r4)
/vm/134b4005-025d-d91e-9516-a995e88b818e/on_reboot = "restart"   (n0)
/vm/134b4005-025d-d91e-9516-a995e88b818e/start_time = "1309957525.3"   (n0)
/vm/134b4005-025d-d91e-9516-a995e88b818e/on_poweroff = "destroy"   (n0)
/vm/134b4005-025d-d91e-9516-a995e88b818e/bootloader_args = ""   (n0)
/vm/134b4005-025d-d91e-9516-a995e88b818e/on_xend_start = "ignore"   (n0)
/vm/134b4005-025d-d91e-9516-a995e88b818e/on_crash = "restart"   (n0)
/vm/134b4005-025d-d91e-9516-a995e88b818e/xend = ""   (n0)
/vm/134b4005-025d-d91e-9516-a995e88b818e/xend/restart_count = "1"   (n0)
/vm/134b4005-025d-d91e-9516-a995e88b818e/xend/last_shutdown_reason =
"reboot"   (n0)
/vm/134b4005-025d-d91e-9516-a995e88b818e/vcpus = "1"   (n0)
/vm/134b4005-025d-d91e-9516-a995e88b818e/vcpu_avail = "1"   (n0)
/vm/134b4005-025d-d91e-9516-a995e88b818e/bootloader = ""   (n0)
/vm/134b4005-025d-d91e-9516-a995e88b818e/name = "pfsense"   (n0)

Thanks and regards, Roger.

2011/7/1 Roger Pau Monnà <roger.pau@xxxxxxxxxxxxx>:
> Well, doing some more tests I've found that this doesn't happen all
> the time, only when Dom0 doesn't detach the devices when the machine
> is shutdown. Usually I see:
>
> xbd backend: detach device dm0f for domain 11
> xbd backend: detach device dm0d for domain 11
> xbd backend: detach device dm0e for domain 11
>
> But sometimes, and I don't know why, devices are not detached.
>
> 2011/7/1 Roger Pau Monnà <roger.pau@xxxxxxxxxxxxx>:
>> Hello,
>>
>> When rebooting a Debian DomU PV with Xen 4.1.1 on NetBSD Dom0, the
>> guests can no longer access any devices (or I think so), so it is
>> unable to find the disk and boot the system. This happens when
>> performing a reboot inside the machine or when shutting it down and
>> starting again (with xm shutdown <domu> xm create <domu>). The
>> configuration file used is:
>>
>> bootloader = '/usr/pkg/bin/pygrub'
>>
>> vcpus    = '1'
>> memory   Â= '1024'
>>
>> root    Â= '/dev/xvda2 ro'
>> disk    Â= [
>> Â Â Â Â Â Â Â Â Â'phy:/dev/mapper/guests-one,xvda2,w',
>> Â Â Â Â Â Â Â Â Â'phy:/dev/mapper/guests-oneswap,xvda1,w',
>> Â Â Â Â Â Â Â Â Â'phy:/dev/mapper/guests-images,xvdb,w',
>> Â Â Â Â Â Â Â]
>>
>> name    Â= 'one'
>> vif     = [ 'mac=00:16:3E:9C:F2:5E, bridge=bridge1' ]
>>
>> on_poweroff = 'destroy'
>> on_reboot  = 'restart'
>> on_crash  Â= 'restart'
>>
>> The trace of xend when falling is the following (there doesn't seem to
>> be any error):
>>
>> [2011-07-01 12:50:08 334] DEBUG (XendDomainInfo:103)
>> XendDomainInfo.create(['vm', ['name', 'one'], ['memory', '1024'],
>> ['on_poweroff', 'destroy'], ['on_reboot', 'restart'], ['on_crash',
>> 'restart'], ['on_xend_start', 'ignore'], ['on_xend_stop', 'ignore'],
>> ['vcpus', '1'], ['oos', 1], ['bootloader', '/usr/pkg/bin/pygrub'],
>> ['bootloader_args', '-q'], ['image', ['linux', ['root', '/dev/xvda2
>> ro'], ['videoram', 4], ['tsc_mode', 0], ['nomigrate', 0]]],
>> ['s3_integrity', 1], ['device', ['vbd', ['uname',
>> 'phy:/dev/mapper/guests-one'], ['dev', 'xvda2'], ['mode', 'w']]],
>> ['device', ['vbd', ['uname', 'phy:/dev/mapper/guests-oneswap'],
>> ['dev', 'xvda1'], ['mode', 'w']]], ['device', ['vbd', ['uname',
>> 'phy:/dev/mapper/guests-images'], ['dev', 'xvdb'], ['mode', 'w']]],
>> ['device', ['vif', ['bridge', 'bridge1'], ['mac',
>> '00:16:3E:9C:F2:5E']]]])
>> [2011-07-01 12:50:08 334] DEBUG (XendDomainInfo:2498)
>> XendDomainInfo.constructDomain
>> [2011-07-01 12:50:08 334] DEBUG (balloon:187) Balloon: 14438228 KiB
>> free; need 16384; done.
>> [2011-07-01 12:50:08 334] DEBUG (XendDomain:476) Adding Domain: 5
>> [2011-07-01 12:50:08 334] DEBUG (XendDomainInfo:2836)
>> XendDomainInfo.initDomain: 5 256
>> [2011-07-01 12:50:08 1116] DEBUG (XendBootloader:114) Launching
>> bootloader as ['/usr/pkg/bin/pygrub', '--args=root=/dev/xvda2 ro ',
>> '--output=/var/run/xend/boot/xenbl.30826', '-q',
>> '/dev/mapper/rguests-one'].
>> [2011-07-01 12:50:09 334] DEBUG (XendDomainInfo:2863)
>> _initDomain:shadow_memory=0x0, memory_static_max=0x40000000,
>> memory_static_min=0x0.
>> [2011-07-01 12:50:09 334] INFO (image:182) buildDomain os=linux dom=5 vcpus=1
>> [2011-07-01 12:50:09 334] DEBUG (image:721) domid     Â= 5
>> [2011-07-01 12:50:09 334] DEBUG (image:722) memsize    Â= 1024
>> [2011-07-01 12:50:09 334] DEBUG (image:723) image     Â=
>> /var/run/xend/boot/boot_kernel.Np2Nce
>> [2011-07-01 12:50:09 334] DEBUG (image:724) store_evtchn  = 1
>> [2011-07-01 12:50:09 334] DEBUG (image:725) console_evtchn = 2
>> [2011-07-01 12:50:09 334] DEBUG (image:726) cmdline    Â=
>> root=/dev/xvda2 ro root=/dev/xvda2 ro
>> [2011-07-01 12:50:09 334] DEBUG (image:727) ramdisk    Â=
>> /var/run/xend/boot/boot_ramdisk.1TCu4L
>> [2011-07-01 12:50:09 334] DEBUG (image:728) vcpus     Â= 1
>> [2011-07-01 12:50:09 334] DEBUG (image:729) features    =
>> [2011-07-01 12:50:09 334] DEBUG (image:730) flags     Â= 0
>> [2011-07-01 12:50:09 334] DEBUG (image:731) superpages   = 0
>> [2011-07-01 12:50:10 334] INFO (XendDomainInfo:2357) createDevice: vbd
>> : {'uuid': 'b4035cf4-a968-bf67-8b71-b1bb032221b7', 'bootable': 1,
>> 'driver': 'paravirtualised', 'dev': 'xvda2', 'uname':
>> 'phy:/dev/mapper/guests-one', 'mode': 'w'}
>> [2011-07-01 12:50:10 334] DEBUG (DevController:95) DevController:
>> writing {'virtual-device': '51714', 'device-type': 'disk', 'protocol':
>> 'x86_32-abi', 'backend-id': '0', 'state': '1', 'backend':
>> '/local/domain/0/backend/vbd/5/51714'} to
>> /local/domain/5/device/vbd/51714.
>> [2011-07-01 12:50:10 334] DEBUG (DevController:97) DevController:
>> writing {'domain': 'one', 'frontend':
>> '/local/domain/5/device/vbd/51714', 'uuid':
>> 'b4035cf4-a968-bf67-8b71-b1bb032221b7', 'bootable': '1', 'dev':
>> 'xvda2', 'state': '1', 'params': '/dev/mapper/guests-one', 'mode':
>> 'w', 'online': '1', 'frontend-id': '5', 'type': 'phy'} to
>> /local/domain/0/backend/vbd/5/51714.
>> [2011-07-01 12:50:10 334] INFO (XendDomainInfo:2357) createDevice: vbd
>> : {'uuid': 'd58b9e34-3921-1d51-4554-3610395dd909', 'bootable': 0,
>> 'driver': 'paravirtualised', 'dev': 'xvda1', 'uname':
>> 'phy:/dev/mapper/guests-oneswap', 'mode': 'w'}
>> [2011-07-01 12:50:10 334] DEBUG (DevController:95) DevController:
>> writing {'virtual-device': '51713', 'device-type': 'disk', 'protocol':
>> 'x86_32-abi', 'backend-id': '0', 'state': '1', 'backend':
>> '/local/domain/0/backend/vbd/5/51713'} to
>> /local/domain/5/device/vbd/51713.
>> [2011-07-01 12:50:10 334] DEBUG (DevController:97) DevController:
>> writing {'domain': 'one', 'frontend':
>> '/local/domain/5/device/vbd/51713', 'uuid':
>> 'd58b9e34-3921-1d51-4554-3610395dd909', 'bootable': '0', 'dev':
>> 'xvda1', 'state': '1', 'params': '/dev/mapper/guests-oneswap', 'mode':
>> 'w', 'online': '1', 'frontend-id': '5', 'type': 'phy'} to
>> /local/domain/0/backend/vbd/5/51713.
>> [2011-07-01 12:50:10 334] INFO (XendDomainInfo:2357) createDevice: vbd
>> : {'uuid': '9ed36d54-a229-3919-d5d2-5ffcdf2b54a6', 'bootable': 0,
>> 'driver': 'paravirtualised', 'dev': 'xvdb', 'uname':
>> 'phy:/dev/mapper/guests-images', 'mode': 'w'}
>> [2011-07-01 12:50:10 334] DEBUG (DevController:95) DevController:
>> writing {'virtual-device': '51728', 'device-type': 'disk', 'protocol':
>> 'x86_32-abi', 'backend-id': '0', 'state': '1', 'backend':
>> '/local/domain/0/backend/vbd/5/51728'} to
>> /local/domain/5/device/vbd/51728.
>> [2011-07-01 12:50:10 334] DEBUG (DevController:97) DevController:
>> writing {'domain': 'one', 'frontend':
>> '/local/domain/5/device/vbd/51728', 'uuid':
>> '9ed36d54-a229-3919-d5d2-5ffcdf2b54a6', 'bootable': '0', 'dev':
>> 'xvdb', 'state': '1', 'params': '/dev/mapper/guests-images', 'mode':
>> 'w', 'online': '1', 'frontend-id': '5', 'type': 'phy'} to
>> /local/domain/0/backend/vbd/5/51728.
>> [2011-07-01 12:50:10 334] INFO (XendDomainInfo:2357) createDevice: vif
>> : {'bridge': 'bridge1', 'mac': '00:16:3E:9C:F2:5E', 'uuid':
>> '5487642b-3781-f3ff-deb5-b7da6d2ee40b'}
>> [2011-07-01 12:50:10 334] DEBUG (DevController:95) DevController:
>> writing {'mac': '00:16:3E:9C:F2:5E', 'handle': '0', 'protocol':
>> 'x86_32-abi', 'backend-id': '0', 'state': '1', 'backend':
>> '/local/domain/0/backend/vif/5/0'} to /local/domain/5/device/vif/0.
>> [2011-07-01 12:50:10 334] DEBUG (DevController:97) DevController:
>> writing {'bridge': 'bridge1', 'domain': 'one', 'handle': '0', 'uuid':
>> '5487642b-3781-f3ff-deb5-b7da6d2ee40b', 'script':
>> '/usr/pkg/etc/xen/scripts/vif-bridge', 'mac': '00:16:3E:9C:F2:5E',
>> 'frontend-id': '5', 'state': '1', 'online': '1', 'frontend':
>> '/local/domain/5/device/vif/0'} to /local/domain/0/backend/vif/5/0.
>> [2011-07-01 12:50:10 334] DEBUG (XendDomainInfo:3420) Storing VM
>> details: {'on_xend_stop': 'ignore', 'pool_name': 'Pool-0',
>> 'shadow_memory': '0', 'uuid': '714dbd21-4665-1737-b76e-40a44eaf9f9a',
>> 'on_reboot': 'restart', 'start_time': '1309517410.33', 'on_poweroff':
>> 'destroy', 'bootloader_args': '-q', 'on_xend_start': 'ignore',
>> 'on_crash': 'restart', 'xend/restart_count': '0', 'vcpus': '1',
>> 'vcpu_avail': '1', 'bootloader': '/usr/pkg/bin/pygrub', 'image':
>> "(linux (kernel '') (args 'root=/dev/xvda2 ro ') (superpages 0)
>> (videoram 4) (pci ()) (nomigrate 0) (tsc_mode 0) (notes (HV_START_LOW
>> 4118806528) (FEATURES '!writable_page_tables|pae_pgdir_above_4gb')
>> (VIRT_BASE 3221225472) (GUEST_VERSION 2.6) (PADDR_OFFSET 0) (GUEST_OS
>> linux) (HYPERCALL_PAGE 3238010880) (LOADER generic) (SUSPEND_CANCEL 1)
>> (PAE_MODE yes) (ENTRY 3242176512) (XEN_VERSION xen-3.0)))", 'name':
>> 'one'}
>> [2011-07-01 12:50:10 334] DEBUG (XendDomainInfo:1794) Storing domain
>> details: {'console/ring-ref': '2237141', 'image/entry': '3242176512',
>> 'console/port': '2', 'store/ring-ref': '2237142', 'image/loader':
>> 'generic', 'vm': '/vm/714dbd21-4665-1737-b76e-40a44eaf9f9a',
>> 'control/platform-feature-multiprocessor-suspend': '1',
>> 'image/hv-start-low': '4118806528', 'image/guest-os': 'linux',
>> 'image/virt-base': '3221225472', 'memory/target': '1048576',
>> 'image/guest-version': '2.6', 'image/pae-mode': 'yes', 'description':
>> '', 'console/limit': '1048576', 'image/paddr-offset': '0',
>> 'image/hypercall-page': '3238010880', 'image/suspend-cancel': '1',
>> 'cpu/0/availability': 'online', 'image/features/pae-pgdir-above-4gb':
>> '1', 'image/features/writable-page-tables': '0', 'console/type':
>> 'xenconsoled', 'name': 'one', 'domid': '5', 'image/xen-version':
>> 'xen-3.0', 'store/port': '1'}
>> [2011-07-01 12:50:10 334] DEBUG (DevController:95) DevController:
>> writing {'protocol': 'x86_32-abi', 'state': '1', 'backend-id': '0',
>> 'backend': '/local/domain/0/backend/console/5/0'} to
>> /local/domain/5/device/console/0.
>> [2011-07-01 12:50:10 334] DEBUG (DevController:97) DevController:
>> writing {'domain': 'one', 'frontend':
>> '/local/domain/5/device/console/0', 'uuid':
>> 'daa05ecd-7272-60a1-5d00-0c1dc3d7a19c', 'frontend-id': '5', 'state':
>> '1', 'location': '2', 'online': '1', 'protocol': 'vt100'} to
>> /local/domain/0/backend/console/5/0.
>> [2011-07-01 12:50:10 334] DEBUG (XendDomainInfo:1881)
>> XendDomainInfo.handleShutdownWatch
>> [2011-07-01 12:50:10 334] DEBUG (DevController:139) Waiting for devices tap2.
>> [2011-07-01 12:50:10 334] DEBUG (DevController:139) Waiting for devices vif.
>> [2011-07-01 12:50:10 334] DEBUG (DevController:144) Waiting for 0.
>> [2011-07-01 12:50:10 334] DEBUG (DevController:628)
>> hotplugStatusCallback /local/domain/0/backend/vif/5/0/hotplug-status.
>> [2011-07-01 12:50:10 334] DEBUG (DevController:642) hotplugStatusCallback 1.
>> [2011-07-01 12:50:10 334] DEBUG (DevController:139) Waiting for devices vkbd.
>> [2011-07-01 12:50:10 334] DEBUG (DevController:139) Waiting for devices 
>> ioports.
>> [2011-07-01 12:50:10 334] DEBUG (DevController:139) Waiting for devices tap.
>> [2011-07-01 12:50:10 334] DEBUG (DevController:139) Waiting for devices vif2.
>> [2011-07-01 12:50:10 334] DEBUG (DevController:139) Waiting for devices 
>> console.
>> [2011-07-01 12:50:10 334] DEBUG (DevController:144) Waiting for 0.
>> [2011-07-01 12:50:10 334] DEBUG (DevController:139) Waiting for devices 
>> vscsi.
>> [2011-07-01 12:50:10 334] DEBUG (DevController:139) Waiting for devices vbd.
>> [2011-07-01 12:50:10 334] DEBUG (DevController:144) Waiting for 51714.
>> [2011-07-01 12:50:10 334] DEBUG (DevController:628)
>> hotplugStatusCallback
>> /local/domain/0/backend/vbd/5/51714/hotplug-status.
>> [2011-07-01 12:50:10 334] DEBUG (DevController:642) hotplugStatusCallback 1.
>> [2011-07-01 12:50:10 334] DEBUG (DevController:144) Waiting for 51713.
>> [2011-07-01 12:50:10 334] DEBUG (DevController:628)
>> hotplugStatusCallback
>> /local/domain/0/backend/vbd/5/51713/hotplug-status.
>> [2011-07-01 12:50:10 334] DEBUG (DevController:642) hotplugStatusCallback 1.
>> [2011-07-01 12:50:10 334] DEBUG (DevController:144) Waiting for 51728.
>> [2011-07-01 12:50:10 334] DEBUG (DevController:628)
>> hotplugStatusCallback
>> /local/domain/0/backend/vbd/5/51728/hotplug-status.
>> [2011-07-01 12:50:10 334] DEBUG (DevController:642) hotplugStatusCallback 1.
>> [2011-07-01 12:50:10 334] DEBUG (DevController:139) Waiting for devices irq.
>> [2011-07-01 12:50:10 334] DEBUG (DevController:139) Waiting for devices vfb.
>> [2011-07-01 12:50:10 334] DEBUG (DevController:139) Waiting for devices pci.
>> [2011-07-01 12:50:10 334] DEBUG (DevController:139) Waiting for devices vusb.
>> [2011-07-01 12:50:10 334] DEBUG (DevController:139) Waiting for devices vtpm.
>> [2011-07-01 12:50:10 334] INFO (XendDomain:1225) Domain one (5) unpaused.
>>
>> So if I shutdown one of my guests, I have to restart the Dom0 to be
>> able to launch the domain again. Also the kernel messages in the Dom0
>> when the machine cannot attach the devices:
>>
>> xbdback backend/vbd/5/51714: can't VOP_OPEN device 0xa904: 16
>> xbdback backend/vbd/5/51714: can't VOP_OPEN device 0xa904: 16
>> xbdback backend/vbd/5/51713: can't VOP_OPEN device 0xa903: 16
>> xbdback backend/vbd/5/51713: can't VOP_OPEN device 0xa903: 16
>> xbdback backend/vbd/5/51728: can't VOP_OPEN device 0xa905: 16
>> xbdback backend/vbd/5/51728: can't VOP_OPEN device 0xa905: 16
>> xvif5i0: Ethernet address 00:16:3e:9d:f2:5e
>> xbd backend domain 5 handle 0xca02 (51714) using event channel 34,
>> protocol x86_32-abi
>> xbd backend domain 5 handle 0xca01 (51713) using event channel 35,
>> protocol x86_32-abi
>> xbd backend domain 5 handle 0xca10 (51728) using event channel 36,
>> protocol x86_32-abi
>>
>> These messages in Dom0 are different than the ones shown when the
>> devices can be attached correctly, here is the output from the first
>> boot of the DomU:
>>
>> xbd backend: attach device guests-one (size 20971520) for domain 2
>> xbdback backend/vbd/2/51714: can't VOP_OPEN device 0xa904: 16
>> xbd backend: attach device guests-oneswap (size 2097152) for domain 2
>> xbdback backend/vbd/2/51713: can't VOP_OPEN device 0xa903: 16
>> xbd backend: attach device guests-images (size 1677721600) for domain 2
>> xbdback backend/vbd/2/51728: can't VOP_OPEN device 0xa905: 16
>> xvif2i0: Ethernet address 00:16:3e:9d:f2:5e
>> xbd backend domain 2 handle 0xca02 (51714) using event channel 20,
>> protocol x86_32-abi
>> xbd backend domain 2 handle 0xca01 (51713) using event channel 21,
>> protocol x86_32-abi
>> xbd backend domain 2 handle 0xca10 (51728) using event channel 22,
>> protocol x86_32-abi
>>
>> It seems that the Dom0 is not even trying to attach the devices to the
>> guest (again it's just a guess). Finally here's the output form the
>> DomU booting sequence:
>>
>> [ Â Â0.000000] Reserving virtual address space above 0xf5800000
>> [ Â Â0.000000] Initializing cgroup subsys cpuset
>> [ Â Â0.000000] Initializing cgroup subsys cpu
>> [ Â Â0.000000] Linux version 2.6.32-5-xen-686 (Debian 2.6.32-35)
>> (dannf@xxxxxxxxxx) (gcc version 4.3.5 (Debian 4.3.5-4) ) #1 SMP Mon
>> Jun 13 09:07:50 UTC 2011
>> [ Â Â0.000000] KERNEL supported cpus:
>> [ Â Â0.000000] Â Intel GenuineIntel
>> [ Â Â0.000000] Â AMD AuthenticAMD
>> [ Â Â0.000000] Â NSC Geode by NSC
>> [ Â Â0.000000] Â Cyrix CyrixInstead
>> [ Â Â0.000000] Â Centaur CentaurHauls
>> [ Â Â0.000000] Â Transmeta GenuineTMx86
>> [ Â Â0.000000] Â Transmeta TransmetaCPU
>> [ Â Â0.000000] Â UMC UMC UMC UMC
>> [ Â Â0.000000] ACPI in unprivileged domain disabled
>> [ Â Â0.000000] released 0 pages of unused memory
>> [ Â Â0.000000] BIOS-provided physical RAM map:
>> [ Â Â0.000000] ÂXen: 0000000000000000 - 00000000000a0000 (usable)
>> [ Â Â0.000000] ÂXen: 00000000000a0000 - 0000000000100000 (reserved)
>> [ Â Â0.000000] ÂXen: 0000000000100000 - 0000000040000000 (usable)
>> [ Â Â0.000000] DMI not present or invalid.
>> [ Â Â0.000000] last_pfn = 0x40000 max_arch_pfn = 0x1000000
>> [ Â Â0.000000] init_memory_mapping: 0000000000000000-000000002cffe000
>> [ Â Â0.000000] NX (Execute Disable) protection: active
>> [ Â Â0.000000] RAMDISK: 0164d000 - 02a35000
>> [ Â Â0.000000] 304MB HIGHMEM available.
>> [ Â Â0.000000] 719MB LOWMEM available.
>> [ Â Â0.000000] Â mapped low ram: 0 - 2cffe000
>> [ Â Â0.000000] Â low ram: 0 - 2cffe000
>> [ Â Â0.000000] Â node 0 low ram: 00000000 - 2cffe000
>> [ Â Â0.000000] Â node 0 bootmap 00007000 - 0000ca00
>> [ Â Â0.000000] (9 early reservations) ==> bootmem [0000000000 - 002cffe000]
>> [ Â Â0.000000] Â #0 [0000000000 - 0000001000] Â BIOS data page ==>
>> [0000000000 - 0000001000]
>> [ Â Â0.000000] Â #1 [0002b38000 - 0002b50000] Â XEN PAGETABLES ==>
>> [0002b38000 - 0002b50000]
>> [ Â Â0.000000] Â #2 [0000001000 - 0000002000] Â ÂEX TRAMPOLINE ==>
>> [0000001000 - 0000002000]
>> [ Â Â0.000000] Â #3 [0000006000 - 0000007000] Â Â Â TRAMPOLINE ==>
>> [0000006000 - 0000007000]
>> [ Â Â0.000000] Â #4 [0001000000 - 00015278f4] Â ÂTEXT DATA BSS ==>
>> [0001000000 - 00015278f4]
>> [ Â Â0.000000] Â #5 [000164d000 - 0002a35000] Â Â Â Â ÂRAMDISK ==>
>> [000164d000 - 0002a35000]
>> [ Â Â0.000000] Â #6 [0002a35000 - 0002b38000] Â XEN START INFO ==>
>> [0002a35000 - 0002b38000]
>> [ Â Â0.000000] Â #7 [0000100000 - 0000251000] Â Â Â Â ÂPGTABLE ==>
>> [0000100000 - 0000251000]
>> [ Â Â0.000000] Â #8 [0000007000 - 000000d000] Â Â Â Â ÂBOOTMAP ==>
>> [0000007000 - 000000d000]
>> [ Â Â0.000000] Zone PFN ranges:
>> [ Â Â0.000000] Â DMA Â Â Â0x00000000 -> 0x00001000
>> [  Â0.000000]  Normal  0x00001000 -> 0x0002cffe
>> [ Â Â0.000000] Â HighMem Â0x0002cffe -> 0x00040000
>> [ Â Â0.000000] Movable zone start PFN for each node
>> [ Â Â0.000000] early_node_map[2] active PFN ranges
>> [ Â Â0.000000] Â Â 0: 0x00000000 -> 0x000000a0
>> [ Â Â0.000000] Â Â 0: 0x00000100 -> 0x00040000
>> [ Â Â0.000000] Using APIC driver default
>> [ Â Â0.000000] SFI: Simple Firmware Interface v0.7 http://simplefirmware.org
>> [ Â Â0.000000] SMP: Allowing 1 CPUs, 0 hotplug CPUs
>> [ Â Â0.000000] Local APIC disabled by BIOS -- you can enable it with "lapic"
>> [ Â Â0.000000] APIC: disable apic facility
>> [ Â Â0.000000] PM: Registered nosave memory: 00000000000a0000 - 
>> 0000000000100000
>> [ Â Â0.000000] Allocating PCI resources starting at 40000000 (gap:
>> 40000000:c0000000)
>> [ Â Â0.000000] Booting paravirtualized kernel on Xen
>> [ Â Â0.000000] Xen version: 4.1.1 (preserve-AD)
>> [ Â Â0.000000] NR_CPUS:32 nr_cpumask_bits:32 nr_cpu_ids:1 nr_node_ids:1
>> [ Â Â0.000000] PERCPU: Embedded 15 pages/cpu @c3357000 s37688 r0 d23752 
>> u65536
>> [ Â Â0.000000] pcpu-alloc: s37688 r0 d23752 u65536 alloc=16*4096
>> [ Â Â0.000000] pcpu-alloc: [0] 0
>> [ Â Â0.000000] Xen: using vcpu_info placement
>> [ Â Â0.000000] Built 1 zonelists in Zone order, mobility grouping on.
>> Total pages: 259999
>> [ Â Â0.000000] Kernel command line: root=/dev/xvda2 ro root=/dev/xvda2 ro
>> [ Â Â0.000000] PID hash table entries: 4096 (order: 2, 16384 bytes)
>> [ Â Â0.000000] Dentry cache hash table entries: 131072 (order: 7, 524288 
>> bytes)
>> [ Â Â0.000000] Inode-cache hash table entries: 65536 (order: 6, 262144 bytes)
>> [ Â Â0.000000] Enabling fast FPU save and restore... done.
>> [ Â Â0.000000] Enabling unmasked SIMD FPU exception support... done.
>> [ Â Â0.000000] Initializing CPU#0
>> [ Â Â0.000000] Initializing HighMem for node 0 (0002cffe:00040000)
>> [ Â Â0.000000] Memory: 1010276k/1048576k available (2636k kernel code,
>> 37240k reserved, 1438k data, 404k init, 311304k highmem)
>> [ Â Â0.000000] virtual kernel memory layout:
>> [ Â Â0.000000] Â Â fixmap Â: 0xf5556000 - 0xf57ff000 Â (2724 kB)
>> [  Â0.000000]   pkmap  : 0xf5000000 - 0xf5200000  (2048 kB)
>> [ Â Â0.000000] Â Â vmalloc : 0xed7fe000 - 0xf4ffe000 Â ( 120 MB)
>> [ Â Â0.000000] Â Â lowmem Â: 0xc0000000 - 0xecffe000 Â ( 719 MB)
>> [ Â Â0.000000] Â Â Â .init : 0xc13fb000 - 0xc1460000 Â ( 404 kB)
>> [ Â Â0.000000] Â Â Â .data : 0xc1293071 - 0xc13fab18 Â (1438 kB)
>> [ Â Â0.000000] Â Â Â .text : 0xc1000000 - 0xc1293071 Â (2636 kB)
>> [ Â Â0.000000] SLUB: Genslabs=13, HWalign=64, Order=0-3, MinObjects=0,
>> CPUs=1, Nodes=1
>> [ Â Â0.000000] Hierarchical RCU implementation.
>> [ Â Â0.000000] NR_IRQS:1536
>> [ Â Â0.000000] Console: colour dummy device 80x25
>> [ Â Â0.000000] console [tty0] enabled
>> [ Â Â0.000000] console [hvc0] enabled
>> [ Â Â0.000000] installing Xen timer for CPU 0
>> [ Â Â0.000000] Detected 2128.064 MHz processor.
>> [ Â Â0.004000] Calibrating delay loop (skipped), value calculated
>> using timer frequency.. 4256.12 BogoMIPS (lpj=8512256)
>> [ Â Â0.004000] Security Framework initialized
>> [ Â Â0.004000] SELinux: ÂDisabled at boot.
>> [ Â Â0.004000] Mount-cache hash table entries: 512
>> [ Â Â0.004000] Initializing cgroup subsys ns
>> [ Â Â0.004000] Initializing cgroup subsys cpuacct
>> [ Â Â0.004000] Initializing cgroup subsys devices
>> [ Â Â0.004000] Initializing cgroup subsys freezer
>> [ Â Â0.004000] Initializing cgroup subsys net_cls
>> [ Â Â0.004000] CPU: L1 I cache: 32K, L1 D cache: 32K
>> [ Â Â0.004000] CPU: L2 cache: 256K
>> [ Â Â0.004000] CPU: L3 cache: 8192K
>> [ Â Â0.004000] CPU: Unsupported number of siblings 32
>> [ Â Â0.004000] Performance Events: unsupported p6 CPU model 44 no PMU
>> driver, software events only.
>> [ Â Â0.004000] SMP alternatives: switching to UP code
>> [ Â Â0.004000] Freeing SMP alternatives: 14k freed
>> [ Â Â0.004176] Brought up 1 CPUs
>> [ Â Â0.004312] devtmpfs: initialized
>> [ Â Â0.004811] Grant table initialized
>> [ Â Â0.004820] regulator: core version 0.5
>> [ Â Â0.004887] NET: Registered protocol family 16
>> [ Â Â0.005714] PCI: setting up Xen PCI frontend stub
>> [ Â Â0.006363] bio: create slab <bio-0> at 0
>> [ Â Â0.006442] ACPI: Interpreter disabled.
>> [ Â Â0.006487] xen_balloon: Initialising balloon driver with page order 0.
>> [ Â Â0.006548] vgaarb: loaded
>> [ Â Â0.006632] PCI: System does not support PCI
>> [ Â Â0.006640] PCI: System does not support PCI
>> [ Â Â0.006739] Switching to clocksource xen
>> [ Â Â0.008000] pnp: PnP ACPI: disabled
>> [ Â Â0.008000] PnPBIOS: Disabled
>> [ Â Â0.008000] NET: Registered protocol family 2
>> [ Â Â0.008000] IP route cache hash table entries: 32768 (order: 5, 131072 
>> bytes)
>> [ Â Â0.008000] TCP established hash table entries: 131072 (order: 8,
>> 1048576 bytes)
>> [ Â Â0.008000] TCP bind hash table entries: 65536 (order: 7, 524288 bytes)
>> [ Â Â0.008000] TCP: Hash tables configured (established 131072 bind 65536)
>> [ Â Â0.008000] TCP reno registered
>> [ Â Â0.008000] NET: Registered protocol family 1
>> [ Â Â0.008000] Unpacking initramfs...
>> [ Â Â0.060149] Freeing initrd memory: 20384k freed
>> [ Â Â0.065656] platform rtc_cmos: registered platform RTC device (no
>> PNP device found)
>> [ Â Â0.164407] audit: initializing netlink socket (disabled)
>> [ Â Â0.164428] type=2000 audit(1309517411.913:1): initialized
>> [ Â Â0.169248] highmem bounce pool size: 64 pages
>> [ Â Â0.169261] HugeTLB registered 2 MB page size, pre-allocated 0 pages
>> [ Â Â0.170965] VFS: Disk quotas dquot_6.5.2
>> [ Â Â0.171029] Dquot-cache hash table entries: 1024 (order 0, 4096 bytes)
>> [ Â Â0.171161] msgmni has been set to 1406
>> [ Â Â0.171400] alg: No test for stdrng (krng)
>> [ Â Â0.171473] Block layer SCSI generic (bsg) driver version 0.4
>> loaded (major 253)
>> [ Â Â0.171484] io scheduler noop registered
>> [ Â Â0.171490] io scheduler anticipatory registered
>> [ Â Â0.171497] io scheduler deadline registered
>> [ Â Â0.171541] io scheduler cfq registered (default)
>> [ Â Â0.171713] isapnp: ISA Plug & Play support disabled
>> [ Â Â0.175877] registering netback
>> [ Â Â0.177865] Linux agpgart interface v0.103
>> [ Â Â0.177989] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
>> [ Â Â0.178263] PNP: No PS/2 controller found. Probing ports directly.
>> [ Â Â0.179084] i8042.c: No controller found.
>> [ Â Â0.179120] mice: PS/2 mouse device common for all mice
>> [ Â Â0.179288] rtc_cmos rtc_cmos: rtc core: registered rtc_cmos as rtc0
>> [ Â Â0.179366] cpuidle: using governor ladder
>> [ Â Â0.179373] cpuidle: using governor menu
>> [ Â Â0.179382] No iBFT detected.
>> [ Â Â0.179646] TCP cubic registered
>> [ Â Â0.179814] NET: Registered protocol family 10
>> [ Â Â0.180472] Mobile IPv6
>> [ Â Â0.180480] NET: Registered protocol family 17
>> [ Â Â0.180499] Using IPI No-Shortcut mode
>> [ Â Â0.180597] registered taskstats version 1
>> [ Â Â0.180613] XENBUS: Device with no driver: device/vbd/51714
>> [ Â Â0.180620] XENBUS: Device with no driver: device/vbd/51713
>> [ Â Â0.180626] XENBUS: Device with no driver: device/vbd/51728
>> [ Â Â0.180633] XENBUS: Device with no driver: device/vif/0
>> [ Â Â0.180639] XENBUS: Device with no driver: device/console/0
>> [ Â Â0.180660] 
>> /tmp/buildd/linux-2.6-2.6.32/debian/build/source_i386_xen/drivers/rtc/hctosys.c:
>> unable to open rtc device (rtc0)
>> [ Â Â0.180685] Initalizing network drop monitor service
>> [ Â Â0.180726] Freeing unused kernel memory: 404k freed
>> [ Â Â0.181523] Write protecting the kernel text: 2640k
>> [ Â Â0.181776] Write protecting the kernel read-only data: 948k
>> Loading, please wait...
>> [ Â Â0.220445] udev[47]: starting version 164
>> [ Â Â0.286743] Initialising Xen virtual ethernet driver.
>> [ Â Â5.428092] XENBUS: Waiting for devices to initialise:
>> 295s...290s...285s...280s...275s...270s...265s...260s...255s...250s...245s...240s...235s...230s...225s...220s...215s...210s...205s...200s...195s...190s...185s...180s...175s...170s...165s...160s...155s...150s...145s...140s...135s...130s...125s...udevd[47]:
>> worker [54] unexpectedly returned with status 0x0100
>>
>> udevd[47]: worker [54] failed while handling '/devices/vbd-51713'
>>
>> udevd[47]: worker [55] unexpectedly returned with status 0x0100
>>
>> udevd[47]: worker [55] failed while handling '/devices/vbd-51714'
>>
>> udevd[47]: worker [56] unexpectedly returned with status 0x0100
>>
>> udevd[47]: worker [56] failed while handling '/devices/vbd-51728'
>>
>> Begin: Loading essential drivers ... done.
>> Begin: Running /scripts/init-premount ... done.
>> Begin: Mounting root file system ... Begin: Running /scripts/local-top ... 
>> done.
>> Begin: Waiting for root file system ...
>> 120s...115s...110s...105s...100s...95s...90s...done.
>> Gave up waiting for root device. ÂCommon problems:
>> Â- Boot args (cat /proc/cmdline)
>> Â - Check rootdelay= (did the system wait long enough?)
>> Â - Check root= (did the system wait for the right device?)
>> Â- Missing modules (cat /proc/modules; ls /dev)
>> ALERT! Â/dev/xvda2 does not exist. ÂDropping to a shell!
>>
>>
>> BusyBox v1.17.1 (Debian 1:1.17.1-8) built-in shell (ash)
>> Enter 'help' for a list of built-in commands.
>>
>> /bin/sh: can't access tty; job control turned off
>> (initramfs) 
>> 85s...80s...75s...70s...65s...60s...55s...50s...45s...40s...35s...30s...25s...20s...15s...10s...5s...0s...
>> [ Â300.332294] XENBUS: Timeout connecting to device: device/vbd/51714
>> (local state 3, remote state 2)
>> [ Â300.332418] XENBUS: Timeout connecting to device: device/vbd/51713
>> (local state 3, remote state 2)
>> [ Â300.332533] XENBUS: Timeout connecting to device: device/vbd/51728
>> (local state 3, remote state 2)
>>
>> Also my xm info:
>>
>> host          : odin
>> release        Â: 5.99.52
>> version        Â: NetBSD 5.99.52 (XEN3_DOM0) #0: Wed Jun 22
>> 15:02:28 CEST 2011
>> royger@odin:/usr/obj/sys/arch/amd64/compile/XEN3_DOM0
>> machine        Â: amd64
>> nr_cpus        Â: 4
>> nr_nodes        : 1
>> cores_per_socket    : 4
>> threads_per_core    : 1
>> cpu_mhz        Â: 2128
>> hw_caps        Â:
>> bfebfbff:2c100800:00000000:00003f40:029ee3ff:00000000:00000001:00000000
>> virt_caps       Â: hvm hvm_directio
>> total_memory      : 16371
>> free_memory      Â: 13079
>> free_cpus       Â: 0
>> xen_major       Â: 4
>> xen_minor       Â: 1
>> xen_extra       Â: .1
>> xen_caps        : xen-3.0-x86_64 xen-3.0-x86_32p hvm-3.0-x86_32
>> hvm-3.0-x86_32p hvm-3.0-x86_64
>> xen_scheduler     Â: credit
>> xen_pagesize      : 4096
>> platform_params    Â: virt_start=0xffff800000000000
>> xen_changeset     Â: unavailable
>> xen_commandline    Â: dom0_mem=512M dom0_max_vcpus=1 dom0_vcpus_pin
>> console=com1 com1=115200,8n1
>> cc_compiler      Â: gcc version 4.1.3 20080704 prerelease (NetBSD
>> nb2 20081120)
>> cc_compile_by     Â: root
>> cc_compile_domain   Â:
>> cc_compile_date    Â: Wed Jun 22 11:36:28 CEST 2011
>> xend_config_format   : 4
>>
>> Well, I hope I haven't send too much, I'm sure some of this logs are
>> useless, but since I don't know where the problem is I prefer to send
>> everything I can. Hope someone can give me a hand with this one.
>>
>> Thanks and regards, Roger.
>>
>

_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-devel


 


Rackspace

Lists.xenproject.org is hosted with RackSpace, monitoring our
servers 24x7x365 and backed by RackSpace's Fanatical Support®.