Hi Everyone,
I’m trying to get Xen to use a native DRBD device but
it seems it will not create the virtual machine. It does not seem to like the
DRBD device type, any ideas on what might be wrong?
I’m pretty sure my xen config file is OK and the DRBD
device looks fine too.
Full details below.
xm create centostest
Using config file "./centostest".
Error: Device 768 (vbd) could not be connected.
/etc/xen/scripts/block failed; error detected.
drbd.conf contents:
global { usage-count no; }
resource xendrbd0 {
protocol C;
startup { wfc-timeout 0; degr-wfc-timeout 120; }
disk { on-io-error detach; } # or panic, ...
net { cram-hmac-alg "sha1"; shared-secret
"whateverpass";allow-two-primaries;after-sb-0pri
discard-zero-changes;after-sb-1pri discard-secondary;max-buffers 8192; }
syncer { rate 500M; }
on mrhappy.whatever.com {
device /dev/drbd0;
disk /dev/data1/dns1;
address 192.168.10.160:7788;
meta-disk internal;
}
on mrtickle.whatever.com{
device /dev/drbd0;
disk /dev/data1/dns1;
address 192.168.10.161:7788;
meta-disk internal;
}
}
Contents of config file ("centostest"):
name = 'dns1'
uuid = '53299e20-a828-a53a-53b8-88cfb9aa91f9'
maxmem = 2048
memory = 2048
vcpus = 2
builder = 'hvm'
kernel = '/usr/lib/xen/boot/hvmloader'
pae = 1
acpi = 1
apic = 1
hap = 1
device_model = '/usr/lib64/xen/bin/qemu-dm'
sdl = 1
vnc = 1
disk = [ 'drbd:drbd0,hda,w' ,'file:/root/centos52.iso,hdc:cdrom,r'
]
boot = 'd'
vif = [ 'mac=00:16:3e:14:13:77,bridge=virbr0,type=ioemu' ]
serial = 'pty'
xm info:
host : mrhappy.whatever.com
release : 2.6.18-92.1.6.el5xen
version : #1 SMP Wed Jun 25 14:13:10 EDT 2008
machine : x86_64
nr_cpus : 8
nr_nodes : 2
cores_per_socket : 4
threads_per_core : 1
cpu_mhz : 2000
hw_caps :
178bf3ff:efd3fbff:00000000:00000110:00802001:00000000:000007ff
total_memory : 16383
free_memory : 15635
node_to_cpu : node0:0-3
node1:4-7
xen_major : 3
xen_minor : 2
xen_extra : .1
xen_caps : xen-3.0-x86_64 xen-3.0-x86_32p
hvm-3.0-x86_32 hvm-3.0-x86_32p hvm-3.0-x86_64
xen_scheduler : credit
xen_pagesize : 4096
platform_params : virt_start=0xffff800000000000
xen_changeset : unavailable
cc_compiler : gcc version 4.1.2 20071124 (Red Hat
4.1.2-42)
cc_compile_by : root
cc_compile_domain : labor.lan
cc_compile_date : Thu Jul 17 17:17:42 CEST 2008
xend_config_format : 4
cat /proc/drbd:
version: 8.2.6 (api:88/proto:86-88)
GIT-hash: 3e69822d3bb4920a8c1bfdf7d647169eba7d2eb4 build by
root@xxxxxxxxxxxxxxxxxxxx, 2008-08-05 14:04:25
0: cs:Connected st:Primary/Secondary ds:UpToDate/UpToDate C
r---
ns:10485404 nr:0 dw:0 dr:10485404 al:0 bm:640 lo:0 pe:0
ua:0 ap:0 oos:0
xm log:
[2008-08-05 16:38:08 5979] DEBUG (XendDomainInfo:84)
XendDomainInfo.create([\047vm\047, [\047name\047, \047dns1\047],
[\047memory\047, 2048], [\047maxmem\047, 2048], [\047on_poweroff\047,
\047destroy\047], [\047on_reboot\047, \047restart\047], [\047on_crash\047,
\047restart\047], [\047vcpus\047, 2], [\047on_xend_start\047, \047ignore\047],
[\047on_xend_stop\047, \047ignore\047], [\047uuid\047,
\04753299e20-a828-a53a-53b8-88cfb9aa91f9\047], [\047image\047, [\047hvm\047,
[\047kernel\047, \047/usr/lib/xen/boot/hvmloader\047], [\047device_model\047,
\047/usr/lib64/xen/bin/qemu-dm\047], [\047pae\047, 1], [\047vcpus\047, 2],
[\047boot\047, \047d\047], [\047fda\047, \047\047], [\047fdb\047, \047\047],
[\047timer_mode\047, 0], [\047localtime\047, 0], [\047serial\047, \047pty\047],
[\047stdvga\047, 0], [\047isa\047, 0], [\047nographic\047, 0],
[\047soundhw\047, \047\047], [\047vnc\047, 1], [\047vncunused\047, 1],
[\047sdl\047, 1], [\047xauthority\047, \047/root/.Xauthority\047],
[\047rtc_timeoffset\047, \0470\047], [\047monitor\047, 0], [\047acpi\047, 1],
[\047apic\047, 1], [\047usb\047, 0], [\047usbdevice\047, \047\047],
[\047keymap\047, \047\047], [\047pci\047, []], [\047guest_os_type\047,
\047default\047]]], [\047device\047, [\047vbd\047, [\047uname\047, \047drbd:drbd0\047],
[\047dev\047, \047hda\047], [\047mode\047, \047w\047]]], [\047device\047,
[\047vbd\047, [\047uname\047, \047file:/root/centos52.iso\047], [\047dev\047,
\047hdc:cdrom\047], [\047mode\047, \047r\047]]], [\047device\047, [\047vif\047,
[\047bridge\047, \047virbr0\047], [\047mac\047, \04700:16:3e:14:13:77\047],
[\047type\047, \047ioemu\047]]]])
[2008-08-05 16:38:08 5979] DEBUG (XendDomainInfo:1618)
XendDomainInfo.constructDomain
[2008-08-05 16:38:08 5979] DEBUG (balloon:132) Balloon:
16010568 KiB free; need 2048; done.
[2008-08-05 16:38:08 5979] DEBUG (XendDomain:443) Adding
Domain: 19
[2008-08-05 16:38:08 5979] DEBUG (XendDomainInfo:1703)
XendDomainInfo.initDomain: 19 256
[2008-08-05 16:38:08 5979] DEBUG (image:234) No VNC passwd
configured for vfb access
[2008-08-05 16:38:08 5979] DEBUG (image:476) args: boot,
val: d
[2008-08-05 16:38:08 5979] DEBUG (image:476) args: fda, val:
None
[2008-08-05 16:38:08 5979] DEBUG (image:476) args: fdb, val:
None
[2008-08-05 16:38:08 5979] DEBUG (image:476) args: soundhw,
val: None
[2008-08-05 16:38:08 5979] DEBUG (image:476) args:
localtime, val: 0
[2008-08-05 16:38:08 5979] DEBUG (image:476) args: serial,
val: pty
[2008-08-05 16:38:08 5979] DEBUG (image:476) args: std-vga,
val: 0
[2008-08-05 16:38:08 5979] DEBUG (image:476) args: isa, val:
0
[2008-08-05 16:38:08 5979] DEBUG (image:476) args: acpi,
val: 1
[2008-08-05 16:38:08 5979] DEBUG (image:476) args: usb, val:
0
[2008-08-05 16:38:08 5979] DEBUG (image:476) args:
usbdevice, val: None
[2008-08-05 16:38:08 5979] DEBUG (image:476) args: pci, val:
[]
[2008-08-05 16:38:08 5979] DEBUG (XendDomainInfo:1738)
_initDomain:shadow_memory=0x0, memory_static_max=0x80000000,
memory_static_min=0x0.
[2008-08-05 16:38:08 5979] DEBUG (balloon:132) Balloon:
16009272 KiB free; need 2123776; done.
[2008-08-05 16:38:08 5979] INFO (image:139) buildDomain
os=hvm dom=19 vcpus=2
[2008-08-05 16:38:08 5979] DEBUG (image:523) domid
= 19
[2008-08-05 16:38:08 5979] DEBUG (image:524) image
= /usr/lib/xen/boot/hvmloader
[2008-08-05 16:38:08 5979] DEBUG (image:525) store_evtchn
= 3
[2008-08-05 16:38:08 5979] DEBUG (image:526) memsize
= 2048
[2008-08-05 16:38:08 5979] DEBUG (image:527) vcpus
= 2
[2008-08-05 16:38:08 5979] DEBUG (image:528) acpi
= 1
[2008-08-05 16:38:08 5979] DEBUG (image:529) apic
= 1
[2008-08-05 16:38:08 5979] INFO (XendDomainInfo:1514)
createDevice: vfb : {\047vncunused\047: 1, \047other_config\047:
{\047vncunused\047: 1, \047type\047: \047vnc\047}, \047type\047: \047vnc\047,
\047uuid\047: \0479acbc98f-794d-e5a7-ff61-82074bf72ea5\047}
[2008-08-05 16:38:08 5979] DEBUG (DevController:118)
DevController: writing {\047state\047: \0471\047, \047backend-id\047:
\0470\047, \047backend\047: \047/local/domain/0/backend/vfb/19/0\047} to
/local/domain/19/device/vfb/0.
[2008-08-05 16:38:08 5979] DEBUG (DevController:120)
DevController: writing {\047vncunused\047: \0471\047, \047domain\047:
\047dns1\047, \047frontend\047: \047/local/domain/19/device/vfb/0\047,
\047uuid\047: \0479acbc98f-794d-e5a7-ff61-82074bf72ea5\047, \047state\047:
\0471\047, \047online\047: \0471\047, \047frontend-id\047: \04719\047,
\047type\047: \047vnc\047} to /local/domain/0/backend/vfb/19/0.
[2008-08-05 16:38:08 5979] INFO (XendDomainInfo:1514)
createDevice: vbd : {\047uuid\047:
\047b9ed2608-b441-17fd-77dc-f1e535e2b994\047, \047bootable\047: 1,
\047driver\047: \047paravirtualised\047, \047dev\047: \047hda\047,
\047uname\047: \047drbd:drbd0\047, \047mode\047: \047w\047}
[2008-08-05 16:38:08 5979] DEBUG (DevController:118)
DevController: writing {\047backend-id\047: \0470\047, \047virtual-device\047:
\047768\047, \047device-type\047: \047disk\047, \047state\047: \0471\047,
\047backend\047: \047/local/domain/0/backend/vbd/19/768\047} to
/local/domain/19/device/vbd/768.
[2008-08-05 16:38:08 5979] DEBUG (DevController:120)
DevController: writing {\047domain\047: \047dns1\047, \047frontend\047:
\047/local/domain/19/device/vbd/768\047, \047uuid\047:
\047b9ed2608-b441-17fd-77dc-f1e535e2b994\047, \047dev\047: \047hda\047, \047state\047:
\0471\047, \047params\047: \047drbd0\047, \047mode\047: \047w\047,
\047online\047: \0471\047, \047frontend-id\047: \04719\047, \047type\047:
\047drbd\047} to /local/domain/0/backend/vbd/19/768.
[2008-08-05 16:38:08 5979] INFO (XendDomainInfo:1514)
createDevice: vbd : {\047uuid\047:
\047cfacefb6-21c5-6594-728a-d97d10722455\047, \047bootable\047: 0,
\047driver\047: \047paravirtualised\047, \047dev\047: \047hdc:cdrom\047,
\047uname\047: \047file:/root/centos52.iso\047, \047mode\047: \047r\047}
[2008-08-05 16:38:08 5979] DEBUG (DevController:118)
DevController: writing {\047backend-id\047: \0470\047, \047virtual-device\047:
\0475632\047, \047device-type\047: \047cdrom\047, \047state\047: \0471\047,
\047backend\047: \047/local/domain/0/backend/vbd/19/5632\047} to
/local/domain/19/device/vbd/5632.
[2008-08-05 16:38:08 5979] DEBUG (DevController:120)
DevController: writing {\047domain\047: \047dns1\047, \047frontend\047:
\047/local/domain/19/device/vbd/5632\047, \047uuid\047:
\047cfacefb6-21c5-6594-728a-d97d10722455\047, \047dev\047: \047hdc\047,
\047state\047: \0471\047, \047params\047: \047/root/centos52.iso\047,
\047mode\047: \047r\047, \047online\047: \0471\047, \047frontend-id\047:
\04719\047, \047type\047: \047file\047} to /local/domain/0/backend/vbd/19/5632.
[2008-08-05 16:38:08 5979] INFO (XendDomainInfo:1514)
createDevice: vif : {\047bridge\047: \047virbr0\047, \047mac\047:
\04700:16:3e:14:13:77\047, \047type\047: \047ioemu\047, \047uuid\047:
\04792afe459-2d39-4b8f-df58-afc90aa175e9\047}
[2008-08-05 16:38:08 5979] DEBUG (DevController:118)
DevController: writing {\047state\047: \0471\047, \047backend-id\047:
\0470\047, \047backend\047: \047/local/domain/0/backend/vif/19/0\047} to
/local/domain/19/device/vif/0.
[2008-08-05 16:38:08 5979] DEBUG (DevController:120)
DevController: writing {\047bridge\047: \047virbr0\047, \047domain\047:
\047dns1\047, \047handle\047: \0470\047, \047uuid\047:
\04792afe459-2d39-4b8f-df58-afc90aa175e9\047, \047script\047:
\047/etc/xen/scripts/vif-bridge\047, \047mac\047: \04700:16:3e:14:13:77\047,
\047frontend-id\047: \04719\047, \047state\047: \0471\047, \047online\047:
\0471\047, \047frontend\047: \047/local/domain/19/device/vif/0\047,
\047type\047: \047ioemu\047} to /local/domain/0/backend/vif/19/0.
[2008-08-05 16:38:08 5979] INFO (image:289) spawning device
models: /usr/lib64/xen/bin/qemu-dm [\047/usr/lib64/xen/bin/qemu-dm\047,
\047-d\047, \04719\047, \047-domain-name\047, \047dns1\047, \047-vnc\047,
\047127.0.0.1:0\047, \047-vncunused\047, \047-vcpus\047, \0472\047, \047-boot\047,
\047d\047, \047-serial\047, \047pty\047, \047-acpi\047, \047-net\047,
\047nic,vlan=1,macaddr=00:16:3e:14:13:77,model=rtl8139\047, \047-net\047,
\047tap,vlan=1,bridge=virbr0\047, \047-M\047, \047xenfv\047]
[2008-08-05 16:38:08 5979] INFO (image:293) device model
pid: 13559
[2008-08-05 16:38:08 5979] DEBUG (XendDomainInfo:2195)
Storing VM details: {\047on_xend_stop\047: \047ignore\047,
\047shadow_memory\047: \04718\047, \047uuid\047:
\04753299e20-a828-a53a-53b8-88cfb9aa91f9\047, \047on_reboot\047:
\047restart\047, \047start_time\047: \0471217950688.7\047, \047on_poweroff\047:
\047destroy\047, \047on_xend_start\047: \047ignore\047, \047on_crash\047:
\047restart\047, \047xend/restart_count\047: \0470\047, \047vcpus\047:
\0472\047, \047vcpu_avail\047: \0473\047, \047image\047: \047(hvm (kernel
/usr/lib/xen/boot/hvmloader) (acpi 1) (apic 1) (boot d) (device_model
/usr/lib64/xen/bin/qemu-dm) (isa 0) (localtime 0) (monitor 0) (nographic 0)
(pae 1) (rtc_timeoffset 0) (serial pty) (sdl 1) (stdvga 0) (usb 0) (vnc 1)
(timer_mode 0) (vncunused 1) (xauthority /root/.Xauthority) (pci ())
(guest_os_type default) (notes (SUSPEND_CANCEL 1)))\047, \047name\047:
\047dns1\047}
[2008-08-05 16:38:08 5979] DEBUG (XendDomainInfo:1008)
Storing domain details: {\047console/port\047: \0474\047, \047name\047:
\047dns1\047, \047console/limit\047: \0471048576\047, \047store/port\047:
\0473\047, \047vm\047: \047/vm/53299e20-a828-a53a-53b8-88cfb9aa91f9\047,
\047domid\047: \04719\047, \047image/suspend-cancel\047: \0471\047, \047cpu/0/availability\047:
\047online\047, \047memory/target\047: \0472097152\047,
\047control/platform-feature-multiprocessor-suspend\047: \0471\047,
\047store/ring-ref\047: \047524286\047, \047cpu/1/availability\047:
\047online\047, \047console/type\047: \047ioemu\047}
[2008-08-05 16:38:08 5979] DEBUG (DevController:118)
DevController: writing {\047state\047: \0471\047, \047backend-id\047:
\0470\047, \047backend\047: \047/local/domain/0/backend/console/19/0\047} to
/local/domain/19/device/console/0.
[2008-08-05 16:38:08 5979] DEBUG (DevController:120)
DevController: writing {\047domain\047: \047dns1\047, \047frontend\047:
\047/local/domain/19/device/console/0\047, \047uuid\047:
\0476f515811-410e-6ebf-8f39-611bf496c88c\047, \047frontend-id\047: \04719\047,
\047state\047: \0471\047, \047location\047: \0474\047, \047online\047:
\0471\047, \047protocol\047: \047vt100\047} to
/local/domain/0/backend/console/19/0.
[2008-08-05 16:38:08 5979] DEBUG (XendDomainInfo:1092)
XendDomainInfo.handleShutdownWatch
[2008-08-05 16:38:08 5979] DEBUG (DevController:151) Waiting
for devices vif.
[2008-08-05 16:38:08 5979] DEBUG (DevController:156) Waiting
for 0.
[2008-08-05 16:38:08 5979] DEBUG (DevController:595)
hotplugStatusCallback /local/domain/0/backend/vif/19/0/hotplug-status.
[2008-08-05 16:38:09 5979] DEBUG (DevController:595)
hotplugStatusCallback /local/domain/0/backend/vif/19/0/hotplug-status.
[2008-08-05 16:38:09 5979] DEBUG (DevController:609)
hotplugStatusCallback 1.
[2008-08-05 16:38:09 5979] DEBUG (DevController:151) Waiting
for devices vbd.
[2008-08-05 16:38:09 5979] DEBUG (DevController:156) Waiting
for 768.
[2008-08-05 16:38:09 5979] DEBUG (DevController:595)
hotplugStatusCallback /local/domain/0/backend/vbd/19/768/hotplug-status.
[2008-08-05 16:38:09 5979] DEBUG (DevController:609)
hotplugStatusCallback 2.
[2008-08-05 16:38:09 5979] DEBUG (XendDomainInfo:1897)
XendDomainInfo.destroy: domid=19
[2008-08-05 16:38:09 5979] DEBUG (XendDomainInfo:1914)
XendDomainInfo.destroyDomain(19)
[2008-08-05 16:38:09 5979] DEBUG (XendDomainInfo:1529)
Destroying device model
[2008-08-05 16:38:10 5979] DEBUG (XendDomainInfo:1536)
Releasing devices
[2008-08-05 16:38:10 5979] DEBUG (XendDomainInfo:1542)
Removing vif/0
[2008-08-05 16:38:10 5979] DEBUG (XendDomainInfo:590)
XendDomainInfo.destroyDevice: deviceClass = vif, device = vif/0
[2008-08-05 16:38:10 5979] DEBUG (XendDomainInfo:1542)
Removing vbd/768
[2008-08-05 16:38:10 5979] DEBUG (XendDomainInfo:590)
XendDomainInfo.destroyDevice: deviceClass = vbd, device = vbd/768
[2008-08-05 16:38:10 5979] DEBUG (XendDomainInfo:1542)
Removing vbd/5632
[2008-08-05 16:38:10 5979] DEBUG (XendDomainInfo:590)
XendDomainInfo.destroyDevice: deviceClass = vbd, device = vbd/5632
[2008-08-05 16:38:10 5979] DEBUG (XendDomainInfo:1542)
Removing vfb/0
[2008-08-05 16:38:10 5979] DEBUG (XendDomainInfo:590)
XendDomainInfo.destroyDevice: deviceClass = vfb, device = vfb/0
[2008-08-05 16:38:10 5979] DEBUG (XendDomainInfo:1542)
Removing console/0
[2008-08-05 16:38:10 5979] DEBUG (XendDomainInfo:590)
XendDomainInfo.destroyDevice: deviceClass = console, device = console/0
[2008-08-05 16:38:10 5979] DEBUG (XendDomainInfo:1534) No
device model
[2008-08-05 16:38:10 5979] DEBUG (XendDomainInfo:1536)
Releasing devices
[2008-08-05 16:38:10 5979] DEBUG (DevController:595)
hotplugStatusCallback /local/domain/0/backend/vbd/9/769/hotplug-status.
[2008-08-05 16:38:10 5979] DEBUG (DevController:595)
hotplugStatusCallback /local/domain/0/backend/vbd/9/769/hotplug-status.