Re: [Xen-users] Centos 5.2 using LVM -> DRBD 0.82 -> Xen Problems

[Denis Cardon <denis.cardon@xxxxxxxxxxxxxxxxxxxxxx>]

Hi Robert,

> I’m trying to get Xen to use a native DRBD device but it seems it will 
> not create the virtual machine. It does not seem to like the DRBD device 
> type, any ideas on what might be wrong?
> I’m pretty sure my xen config file is OK and the DRBD device looks fine too.
>
> xm create centostest
> Using config file "./centostest".
> Error: Device 768 (vbd) could not be connected. /etc/xen/scripts/block 
> failed; error detected.
(...)

> Contents of config file ("centostest"):
(...)

> disk = [ 'drbd:drbd0,hda,w' ,'file:/root/centos52.iso,hdc:cdrom,r' ]
I guess the drbd type of block device is unknown to xen. /dev/drbd0 is 
just a standard block device, so it should be something like :
disk = [ 'phy:/dev/drbd0,hda,w' ,'file:/root/centos52.iso,hdc:cdrom,r' ]

In any case, I would advise you to slice your drbd device with lvm so 
you have more flexibility in block device management.
Cheers,

Denis


> boot = 'd'
>
> vif = [ 'mac=00:16:3e:14:13:77,bridge=virbr0,type=ioemu' ]
>
> serial = 'pty'
>
>  
>
>  
>
> xm info:
>
> host                   : mrhappy.whatever.com
>
> release                : 2.6.18-92.1.6.el5xen
>
> version                : #1 SMP Wed Jun 25 14:13:10 EDT 2008
>
> machine                : x86_64
>
> nr_cpus                : 8
>
> nr_nodes               : 2
>
> cores_per_socket       : 4
>
> threads_per_core       : 1
>
> cpu_mhz                : 2000
>
> hw_caps                : 
> 178bf3ff:efd3fbff:00000000:00000110:00802001:00000000:000007ff
> total_memory           : 16383
>
> free_memory            : 15635
>
> node_to_cpu            : node0:0-3
>
>                          node1:4-7
>
> xen_major              : 3
>
> xen_minor              : 2
>
> xen_extra              : .1
>
> xen_caps               : xen-3.0-x86_64 xen-3.0-x86_32p hvm-3.0-x86_32 
> hvm-3.0-x86_32p hvm-3.0-x86_64
> xen_scheduler          : credit
>
> xen_pagesize           : 4096
>
> platform_params        : virt_start=0xffff800000000000
>
> xen_changeset          : unavailable
>
> cc_compiler            : gcc version 4.1.2 20071124 (Red Hat 4.1.2-42)
>
> cc_compile_by          : root
>
> cc_compile_domain      : labor.lan
>
> cc_compile_date        : Thu Jul 17 17:17:42 CEST 2008
>
> xend_config_format     : 4
>
>  
>
>  
>
> cat /proc/drbd:
>
> version: 8.2.6 (api:88/proto:86-88)
>
> GIT-hash: 3e69822d3bb4920a8c1bfdf7d647169eba7d2eb4 build by 
> root@xxxxxxxxxxxxxxxxxxxx, 2008-08-05 14:04:25
>  0: cs:Connected st:Primary/Secondary ds:UpToDate/UpToDate C r---
>
>     ns:10485404 nr:0 dw:0 dr:10485404 al:0 bm:640 lo:0 pe:0 ua:0 ap:0 oos:0
>
>  
>
> xm log:
>
> [2008-08-05 16:38:08 5979] DEBUG (XendDomainInfo:84) 
> XendDomainInfo.create([\047vm\047, [\047name\047, \047dns1\047], 
> [\047memory\047, 2048], [\047maxmem\047, 2048], [\047on_poweroff\047, 
> \047destroy\047], [\047on_reboot\047, \047restart\047], 
> [\047on_crash\047, \047restart\047], [\047vcpus\047, 2], 
> [\047on_xend_start\047, \047ignore\047], [\047on_xend_stop\047, 
> \047ignore\047], [\047uuid\047, 
> \04753299e20-a828-a53a-53b8-88cfb9aa91f9\047], [\047image\047, 
> [\047hvm\047, [\047kernel\047, \047/usr/lib/xen/boot/hvmloader\047], 
> [\047device_model\047, \047/usr/lib64/xen/bin/qemu-dm\047], 
> [\047pae\047, 1], [\047vcpus\047, 2], [\047boot\047, \047d\047], 
> [\047fda\047, \047\047], [\047fdb\047, \047\047], [\047timer_mode\047, 
> 0], [\047localtime\047, 0], [\047serial\047, \047pty\047], 
> [\047stdvga\047, 0], [\047isa\047, 0], [\047nographic\047, 0], 
> [\047soundhw\047, \047\047], [\047vnc\047, 1], [\047vncunused\047, 1], 
> [\047sdl\047, 1], [\047xauthority\047, \047/root/.Xauthority\047], 
> [\047rtc_timeoffset\047, \0470\047], [\047monitor\047, 0], 
> [\047acpi\047, 1], [\047apic\047, 1], [\047usb\047, 0], 
> [\047usbdevice\047, \047\047], [\047keymap\047, \047\047], [\047pci\047, 
> []], [\047guest_os_type\047, \047default\047]]], [\047device\047, 
> [\047vbd\047, [\047uname\047, \047drbd:drbd0\047], [\047dev\047, 
> \047hda\047], [\047mode\047, \047w\047]]], [\047device\047, 
> [\047vbd\047, [\047uname\047, \047file:/root/centos52.iso\047], 
> [\047dev\047, \047hdc:cdrom\047], [\047mode\047, \047r\047]]], 
> [\047device\047, [\047vif\047, [\047bridge\047, \047virbr0\047], 
> [\047mac\047, \04700:16:3e:14:13:77\047], [\047type\047, \047ioemu\047]]]])
> [2008-08-05 16:38:08 5979] DEBUG (XendDomainInfo:1618) 
> XendDomainInfo.constructDomain
> [2008-08-05 16:38:08 5979] DEBUG (balloon:132) Balloon: 16010568 KiB 
> free; need 2048; done.
> [2008-08-05 16:38:08 5979] DEBUG (XendDomain:443) Adding Domain: 19
>
> [2008-08-05 16:38:08 5979] DEBUG (XendDomainInfo:1703) 
> XendDomainInfo.initDomain: 19 256
> [2008-08-05 16:38:08 5979] DEBUG (image:234) No VNC passwd configured 
> for vfb access
> [2008-08-05 16:38:08 5979] DEBUG (image:476) args: boot, val: d
>
> [2008-08-05 16:38:08 5979] DEBUG (image:476) args: fda, val: None
>
> [2008-08-05 16:38:08 5979] DEBUG (image:476) args: fdb, val: None
>
> [2008-08-05 16:38:08 5979] DEBUG (image:476) args: soundhw, val: None
>
> [2008-08-05 16:38:08 5979] DEBUG (image:476) args: localtime, val: 0
>
> [2008-08-05 16:38:08 5979] DEBUG (image:476) args: serial, val: pty
>
> [2008-08-05 16:38:08 5979] DEBUG (image:476) args: std-vga, val: 0
>
> [2008-08-05 16:38:08 5979] DEBUG (image:476) args: isa, val: 0
>
> [2008-08-05 16:38:08 5979] DEBUG (image:476) args: acpi, val: 1
>
> [2008-08-05 16:38:08 5979] DEBUG (image:476) args: usb, val: 0
>
> [2008-08-05 16:38:08 5979] DEBUG (image:476) args: usbdevice, val: None
>
> [2008-08-05 16:38:08 5979] DEBUG (image:476) args: pci, val: []
>
> [2008-08-05 16:38:08 5979] DEBUG (XendDomainInfo:1738) 
> _initDomain:shadow_memory=0x0, memory_static_max=0x80000000, 
> memory_static_min=0x0.
> [2008-08-05 16:38:08 5979] DEBUG (balloon:132) Balloon: 16009272 KiB 
> free; need 2123776; done.
> [2008-08-05 16:38:08 5979] INFO (image:139) buildDomain os=hvm dom=19 
> vcpus=2
> [2008-08-05 16:38:08 5979] DEBUG (image:523) domid          = 19
>
> [2008-08-05 16:38:08 5979] DEBUG (image:524) image          = 
> /usr/lib/xen/boot/hvmloader
> [2008-08-05 16:38:08 5979] DEBUG (image:525) store_evtchn   = 3
>
> [2008-08-05 16:38:08 5979] DEBUG (image:526) memsize        = 2048
>
> [2008-08-05 16:38:08 5979] DEBUG (image:527) vcpus          = 2
>
> [2008-08-05 16:38:08 5979] DEBUG (image:528) acpi           = 1
>
> [2008-08-05 16:38:08 5979] DEBUG (image:529) apic           = 1
>
> [2008-08-05 16:38:08 5979] INFO (XendDomainInfo:1514) createDevice: vfb 
> : {\047vncunused\047: 1, \047other_config\047: {\047vncunused\047: 1, 
> \047type\047: \047vnc\047}, \047type\047: \047vnc\047, \047uuid\047: 
> \0479acbc98f-794d-e5a7-ff61-82074bf72ea5\047}
> [2008-08-05 16:38:08 5979] DEBUG (DevController:118) DevController: 
> writing {\047state\047: \0471\047, \047backend-id\047: \0470\047, 
> \047backend\047: \047/local/domain/0/backend/vfb/19/0\047} to 
> /local/domain/19/device/vfb/0.
> [2008-08-05 16:38:08 5979] DEBUG (DevController:120) DevController: 
> writing {\047vncunused\047: \0471\047, \047domain\047: \047dns1\047, 
> \047frontend\047: \047/local/domain/19/device/vfb/0\047, \047uuid\047: 
> \0479acbc98f-794d-e5a7-ff61-82074bf72ea5\047, \047state\047: \0471\047, 
> \047online\047: \0471\047, \047frontend-id\047: \04719\047, 
> \047type\047: \047vnc\047} to /local/domain/0/backend/vfb/19/0.
> [2008-08-05 16:38:08 5979] INFO (XendDomainInfo:1514) createDevice: vbd 
> : {\047uuid\047: \047b9ed2608-b441-17fd-77dc-f1e535e2b994\047, 
> \047bootable\047: 1, \047driver\047: \047paravirtualised\047, 
> \047dev\047: \047hda\047, \047uname\047: \047drbd:drbd0\047, 
> \047mode\047: \047w\047}
> [2008-08-05 16:38:08 5979] DEBUG (DevController:118) DevController: 
> writing {\047backend-id\047: \0470\047, \047virtual-device\047: 
> \047768\047, \047device-type\047: \047disk\047, \047state\047: 
> \0471\047, \047backend\047: \047/local/domain/0/backend/vbd/19/768\047} 
> to /local/domain/19/device/vbd/768.
> [2008-08-05 16:38:08 5979] DEBUG (DevController:120) DevController: 
> writing {\047domain\047: \047dns1\047, \047frontend\047: 
> \047/local/domain/19/device/vbd/768\047, \047uuid\047: 
> \047b9ed2608-b441-17fd-77dc-f1e535e2b994\047, \047dev\047: \047hda\047, 
> \047state\047: \0471\047, \047params\047: \047drbd0\047, \047mode\047: 
> \047w\047, \047online\047: \0471\047, \047frontend-id\047: \04719\047, 
> \047type\047: \047drbd\047} to /local/domain/0/backend/vbd/19/768.
> [2008-08-05 16:38:08 5979] INFO (XendDomainInfo:1514) createDevice: vbd 
> : {\047uuid\047: \047cfacefb6-21c5-6594-728a-d97d10722455\047, 
> \047bootable\047: 0, \047driver\047: \047paravirtualised\047, 
> \047dev\047: \047hdc:cdrom\047, \047uname\047: 
> \047file:/root/centos52.iso\047, \047mode\047: \047r\047}
> [2008-08-05 16:38:08 5979] DEBUG (DevController:118) DevController: 
> writing {\047backend-id\047: \0470\047, \047virtual-device\047: 
> \0475632\047, \047device-type\047: \047cdrom\047, \047state\047: 
> \0471\047, \047backend\047: \047/local/domain/0/backend/vbd/19/5632\047} 
> to /local/domain/19/device/vbd/5632.
> [2008-08-05 16:38:08 5979] DEBUG (DevController:120) DevController: 
> writing {\047domain\047: \047dns1\047, \047frontend\047: 
> \047/local/domain/19/device/vbd/5632\047, \047uuid\047: 
> \047cfacefb6-21c5-6594-728a-d97d10722455\047, \047dev\047: \047hdc\047, 
> \047state\047: \0471\047, \047params\047: \047/root/centos52.iso\047, 
> \047mode\047: \047r\047, \047online\047: \0471\047, \047frontend-id\047: 
> \04719\047, \047type\047: \047file\047} to 
> /local/domain/0/backend/vbd/19/5632.
> [2008-08-05 16:38:08 5979] INFO (XendDomainInfo:1514) createDevice: vif 
> : {\047bridge\047: \047virbr0\047, \047mac\047: 
> \04700:16:3e:14:13:77\047, \047type\047: \047ioemu\047, \047uuid\047: 
> \04792afe459-2d39-4b8f-df58-afc90aa175e9\047}
> [2008-08-05 16:38:08 5979] DEBUG (DevController:118) DevController: 
> writing {\047state\047: \0471\047, \047backend-id\047: \0470\047, 
> \047backend\047: \047/local/domain/0/backend/vif/19/0\047} to 
> /local/domain/19/device/vif/0.
> [2008-08-05 16:38:08 5979] DEBUG (DevController:120) DevController: 
> writing {\047bridge\047: \047virbr0\047, \047domain\047: \047dns1\047, 
> \047handle\047: \0470\047, \047uuid\047: 
> \04792afe459-2d39-4b8f-df58-afc90aa175e9\047, \047script\047: 
> \047/etc/xen/scripts/vif-bridge\047, \047mac\047: 
> \04700:16:3e:14:13:77\047, \047frontend-id\047: \04719\047, 
> \047state\047: \0471\047, \047online\047: \0471\047, \047frontend\047: 
> \047/local/domain/19/device/vif/0\047, \047type\047: \047ioemu\047} to 
> /local/domain/0/backend/vif/19/0.
> [2008-08-05 16:38:08 5979] INFO (image:289) spawning device models: 
> /usr/lib64/xen/bin/qemu-dm [\047/usr/lib64/xen/bin/qemu-dm\047, 
> \047-d\047, \04719\047, \047-domain-name\047, \047dns1\047, 
> \047-vnc\047, \047127.0.0.1:0\047, \047-vncunused\047, \047-vcpus\047, 
> \0472\047, \047-boot\047, \047d\047, \047-serial\047, \047pty\047, 
> \047-acpi\047, \047-net\047, 
> \047nic,vlan=1,macaddr=00:16:3e:14:13:77,model=rtl8139\047, 
> \047-net\047, \047tap,vlan=1,bridge=virbr0\047, \047-M\047, \047xenfv\047]
> [2008-08-05 16:38:08 5979] INFO (image:293) device model pid: 13559
>
> [2008-08-05 16:38:08 5979] DEBUG (XendDomainInfo:2195) Storing VM 
> details: {\047on_xend_stop\047: \047ignore\047, \047shadow_memory\047: 
> \04718\047, \047uuid\047: \04753299e20-a828-a53a-53b8-88cfb9aa91f9\047, 
> \047on_reboot\047: \047restart\047, \047start_time\047: 
> \0471217950688.7\047, \047on_poweroff\047: \047destroy\047, 
> \047on_xend_start\047: \047ignore\047, \047on_crash\047: 
> \047restart\047, \047xend/restart_count\047: \0470\047, \047vcpus\047: 
> \0472\047, \047vcpu_avail\047: \0473\047, \047image\047: \047(hvm 
> (kernel /usr/lib/xen/boot/hvmloader) (acpi 1) (apic 1) (boot d) 
> (device_model /usr/lib64/xen/bin/qemu-dm) (isa 0) (localtime 0) (monitor 
> 0) (nographic 0) (pae 1) (rtc_timeoffset 0) (serial pty) (sdl 1) (stdvga 
> 0) (usb 0) (vnc 1) (timer_mode 0) (vncunused 1) (xauthority 
> /root/.Xauthority) (pci ()) (guest_os_type default) (notes 
> (SUSPEND_CANCEL 1)))\047, \047name\047: \047dns1\047}
> [2008-08-05 16:38:08 5979] DEBUG (XendDomainInfo:1008) Storing domain 
> details: {\047console/port\047: \0474\047, \047name\047: \047dns1\047, 
> \047console/limit\047: \0471048576\047, \047store/port\047: \0473\047, 
> \047vm\047: \047/vm/53299e20-a828-a53a-53b8-88cfb9aa91f9\047, 
> \047domid\047: \04719\047, \047image/suspend-cancel\047: \0471\047, 
> \047cpu/0/availability\047: \047online\047, \047memory/target\047: 
> \0472097152\047, 
> \047control/platform-feature-multiprocessor-suspend\047: \0471\047, 
> \047store/ring-ref\047: \047524286\047, \047cpu/1/availability\047: 
> \047online\047, \047console/type\047: \047ioemu\047}
> [2008-08-05 16:38:08 5979] DEBUG (DevController:118) DevController: 
> writing {\047state\047: \0471\047, \047backend-id\047: \0470\047, 
> \047backend\047: \047/local/domain/0/backend/console/19/0\047} to 
> /local/domain/19/device/console/0.
> [2008-08-05 16:38:08 5979] DEBUG (DevController:120) DevController: 
> writing {\047domain\047: \047dns1\047, \047frontend\047: 
> \047/local/domain/19/device/console/0\047, \047uuid\047: 
> \0476f515811-410e-6ebf-8f39-611bf496c88c\047, \047frontend-id\047: 
> \04719\047, \047state\047: \0471\047, \047location\047: \0474\047, 
> \047online\047: \0471\047, \047protocol\047: \047vt100\047} to 
> /local/domain/0/backend/console/19/0.
> [2008-08-05 16:38:08 5979] DEBUG (XendDomainInfo:1092) 
> XendDomainInfo.handleShutdownWatch
> [2008-08-05 16:38:08 5979] DEBUG (DevController:151) Waiting for devices 
> vif.
> [2008-08-05 16:38:08 5979] DEBUG (DevController:156) Waiting for 0.
>
> [2008-08-05 16:38:08 5979] DEBUG (DevController:595) 
> hotplugStatusCallback /local/domain/0/backend/vif/19/0/hotplug-status.
> [2008-08-05 16:38:09 5979] DEBUG (DevController:595) 
> hotplugStatusCallback /local/domain/0/backend/vif/19/0/hotplug-status.
> [2008-08-05 16:38:09 5979] DEBUG (DevController:609) 
> hotplugStatusCallback 1.
> [2008-08-05 16:38:09 5979] DEBUG (DevController:151) Waiting for devices 
> vbd.
> [2008-08-05 16:38:09 5979] DEBUG (DevController:156) Waiting for 768.
>
> [2008-08-05 16:38:09 5979] DEBUG (DevController:595) 
> hotplugStatusCallback /local/domain/0/backend/vbd/19/768/hotplug-status.
> [2008-08-05 16:38:09 5979] DEBUG (DevController:609) 
> hotplugStatusCallback 2.
> [2008-08-05 16:38:09 5979] DEBUG (XendDomainInfo:1897) 
> XendDomainInfo.destroy: domid=19
> [2008-08-05 16:38:09 5979] DEBUG (XendDomainInfo:1914) 
> XendDomainInfo.destroyDomain(19)
> [2008-08-05 16:38:09 5979] DEBUG (XendDomainInfo:1529) Destroying device 
> model
> [2008-08-05 16:38:10 5979] DEBUG (XendDomainInfo:1536) Releasing devices
>
> [2008-08-05 16:38:10 5979] DEBUG (XendDomainInfo:1542) Removing vif/0
>
> [2008-08-05 16:38:10 5979] DEBUG (XendDomainInfo:590) 
> XendDomainInfo.destroyDevice: deviceClass = vif, device = vif/0
> [2008-08-05 16:38:10 5979] DEBUG (XendDomainInfo:1542) Removing vbd/768
>
> [2008-08-05 16:38:10 5979] DEBUG (XendDomainInfo:590) 
> XendDomainInfo.destroyDevice: deviceClass = vbd, device = vbd/768
> [2008-08-05 16:38:10 5979] DEBUG (XendDomainInfo:1542) Removing vbd/5632
>
> [2008-08-05 16:38:10 5979] DEBUG (XendDomainInfo:590) 
> XendDomainInfo.destroyDevice: deviceClass = vbd, device = vbd/5632
> [2008-08-05 16:38:10 5979] DEBUG (XendDomainInfo:1542) Removing vfb/0
>
> [2008-08-05 16:38:10 5979] DEBUG (XendDomainInfo:590) 
> XendDomainInfo.destroyDevice: deviceClass = vfb, device = vfb/0
> [2008-08-05 16:38:10 5979] DEBUG (XendDomainInfo:1542) Removing console/0
>
> [2008-08-05 16:38:10 5979] DEBUG (XendDomainInfo:590) 
> XendDomainInfo.destroyDevice: deviceClass = console, device = console/0
> [2008-08-05 16:38:10 5979] DEBUG (XendDomainInfo:1534) No device model
>
> [2008-08-05 16:38:10 5979] DEBUG (XendDomainInfo:1536) Releasing devices
>
> [2008-08-05 16:38:10 5979] DEBUG (DevController:595) 
> hotplugStatusCallback /local/domain/0/backend/vbd/9/769/hotplug-status.
> [2008-08-05 16:38:10 5979] DEBUG (DevController:595) 
> hotplugStatusCallback /local/domain/0/backend/vbd/9/769/hotplug-status.
> **
>
> ** 
>
> *The SAQ Group*
>
> *Registered Office: 18 Chapel Street, Petersfield, Hampshire GU32 3DZ*
> SEMTEC Limited Trading as SAQ is Registered in England & Wales
> Company Number: 06481952
>
>  
>
> http://www.saqnet.co.uk <http://www.saqnet.co.uk/> AS29219
>
> SAQ Group Delivers high quality, honestly priced communication and I.T. 
> services to UK Business.
> DSL : Domains : Email : Hosting : CoLo : Servers : Racks : Transit : 
> Backups : Managed Networks : Remote Support.
>  
>
> Find us in http://www.thebestof.co.uk/petersfield
>
>  
>
> ------------------------------------------------------------------------
>
> _______________________________________________
> Xen-users mailing list
> Xen-users@xxxxxxxxxxxxxxxxxxx
> http://lists.xensource.com/xen-users
--
Denis Cardon
Tranquil IT Systems
44 bvd des pas enchantés
44230 Saint Sébastien sur Loire
tel : +33 (0) 2.40.97.57.56
http://www.tranquil-it-systems.fr



_______________________________________________
Xen-users mailing list
Xen-users@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-users