Error: Device 0 (vif) could not be connected. Hotplug scripts not working
Once it happens, no domU (Windows and Linux) can be started with showing same error message.
I have been googling very hard but I could not find the solution which could solve my problem.
---------------------------------------------------------------------------------------------------------------------
0-09-15 17:35:00 20392] DEBUG (XendDomainInfo:92) XendDomainInfo.create(['vm', ['name', 'covi3_000000d7'], ['memory', '4096'], ['on_poweroff', 'destroy'], ['on_reboot', 'restart'], ['on_crash', 'restart'], ['vcpus', 2], ['on_xend_start', 'ignore'], ['on_xend_stop', 'ignore'], ['image', ['hvm', ['kernel', '/usr/lib/xen/boot/hvmloader'], ['videoram', 4], ['device_model', '/usr/lib64/xen/bin/qemu-dm'], ['pae', 1], ['vcpus', 2], ['boot', 'dc'], ['fda', ''], ['fdb', ''], ['timer_mode', 1], ['localtime', 0], ['serial', 'pty'], ['stdvga', 0], ['isa', 0], ['nographic', 0], ['soundhw', ''], ['vnc', 1], ['vncunused', 1], ['vncconsole', 1], ['vnclisten', '0.0.0.0'], ['sdl', 0], ['xauthority', '/root/.Xauthority'], ['rtc_timeoffset', 0], ['monitor', 0], ['acpi', 1], ['apic', 1], ['usb', 0], ['usbdevice', ''], ['keymap', ''], ['pci', []], ['hpet', 0], ['guest_os_type', 'default'], ['hap', 1], ['cpuid', []], ['cpuid_check', []], ['viridian', 0], ['pci_msitranslate', 1], ['vpt_align', 1], ['pci_power_mgmt', 0], ['xen_platform_pci', 1]]], ['s3_integrity', 1], ['device', ['vbd', ['uname', 'file:/home1/xen/vm_images/covi3_000000d7_d0'], ['dev', 'xvda'], ['mode', 'w']]], ['device', ['vbd', ['uname', 'file:/home1/xen/home1_images/covi3_000000d7_d1'], ['dev', 'xvdb'], ['mode', 'w']]], ['device', ['vif', ['bridge', 'eth1'], ['mac', '00:16:3e:00:03:51']]]])
[2010-09-15 17:35:00 20392] DEBUG (XendDomainInfo:2296) XendDomainInfo.constructDomain
[2010-09-15 17:35:00 20392] DEBUG (balloon:166) Balloon: 43419120 KiB free; need 4096; done.
[2010-09-15 17:35:01 20392] DEBUG (XendDomain:452) Adding Domain: 12
[2010-09-15 17:35:01 20392] DEBUG (XendDomainInfo:2497) XendDomainInfo.initDomain: 12 256
[2010-09-15 17:35:01 20392] DEBUG (image:322) No VNC passwd configured for vfb access
[2010-09-15 17:35:01 20392] DEBUG (image:809) args: boot, val: dc
[2010-09-15 17:35:01 20392] DEBUG (image:809) args: fda, val: None
[2010-09-15 17:35:01 20392] DEBUG (image:809) args: fdb, val: None
[2010-09-15 17:35:01 20392] DEBUG (image:809) args: soundhw, val: None
[2010-09-15 17:35:01 20392] DEBUG (image:809) args: localtime, val: 0
[2010-09-15 17:35:01 20392] DEBUG (image:809) args: serial, val: ['pty']
[2010-09-15 17:35:01 20392] DEBUG (image:809) args: std-vga, val: 0
[2010-09-15 17:35:01 20392] DEBUG (image:809) args: isa, val: 0
[2010-09-15 17:35:01 20392] DEBUG (image:809) args: acpi, val: 1
[2010-09-15 17:35:01 20392] DEBUG (image:809) args: usb, val: 0
[2010-09-15 17:35:01 20392] DEBUG (image:809) args: usbdevice, val: None
[2010-09-15 17:35:01 20392] INFO (image:745) Need to create platform device.[domid:12]
[2010-09-15 17:35:01 20392] DEBUG (XendDomainInfo:2521) _initDomain:shadow_memory=0x0, memory_static_max=0x100000000, memory_static_min=0x0.
[2010-09-15 17:35:01 20392] DEBUG (balloon:166) Balloon: 43417692 KiB free; need 4249600; done.
[2010-09-15 17:35:01 20392] INFO (image:173) buildDomain os=hvm dom=12 vcpus=2
[2010-09-15 17:35:01 20392] DEBUG (image:862) domid = 12
[2010-09-15 17:35:01 20392] DEBUG (image:863) image = /usr/lib/xen/boot/hvmloader
[2010-09-15 17:35:01 20392] DEBUG (image:864) store_evtchn = 3
[2010-09-15 17:35:01 20392] DEBUG (image:865) memsize = 4096
[2010-09-15 17:35:01 20392] DEBUG (image:866) target = 4096
[2010-09-15 17:35:01 20392] DEBUG (image:867) vcpus = 2
[2010-09-15 17:35:01 20392] DEBUG (image:868) acpi = 1
[2010-09-15 17:35:01 20392] DEBUG (image:869) apic = 1
[2010-09-15 17:35:01 20392] INFO (XendDomainInfo:2160) createDevice: vfb : {'vncunused': 1, 'vnclisten': '0.0.0.0', 'vnc': '1', 'uuid': '7caea52d-aeba-e2ae-aa47-24e7c1707c66', 'other_config': {'vncunused': 1, 'vnclisten': '0.0.0.0', 'vnc': '1'}}
[2010-09-15 17:35:01 20392] DEBUG (DevController:95) DevController: writing {'state': '1', 'backend-id': '0', 'backend': '/local/domain/0/backend/vfb/12/0'} to /local/domain/12/device/vfb/0.
[2010-09-15 17:35:01 20392] DEBUG (DevController:97) DevController: writing {'vncunused': '1', 'domain': 'covi3_000000d7', 'frontend': '/local/domain/12/device/vfb/0', 'uuid': '7caea52d-aeba-e2ae-aa47-24e7c1707c66', 'frontend-id': '12', 'vnclisten': '0.0.0.0', 'state': '1', 'online': '1', 'vnc': '1'} to /local/domain/0/backend/vfb/12/0.
[2010-09-15 17:35:01 20392] INFO (XendDomainInfo:2160) createDevice: vbd : {'uuid': '27ea9314-9d00-6d0a-ecdd-c6dfd6bde851', 'bootable': 1, 'driver': 'paravirtualised', 'dev': 'xvda', 'uname': 'file:/home1/xen/vm_images/covi3_000000d7_d0', 'mode': 'w'}
[2010-09-15 17:35:01 20392] DEBUG (DevController:95) DevController: writing {'backend-id': '0', 'virtual-device': '51712', 'device-type': 'disk', 'state': '1', 'backend': '/local/domain/0/backend/vbd/12/51712'} to /local/domain/12/device/vbd/51712.
[2010-09-15 17:35:01 20392] DEBUG (DevController:97) DevController: writing {'domain': 'covi3_000000d7', 'frontend': '/local/domain/12/device/vbd/51712', 'uuid': '27ea9314-9d00-6d0a-ecdd-c6dfd6bde851', 'bootable': '1', 'dev': 'xvda', 'state': '1', 'params': '/home1/xen/vm_images/covi3_000000d7_d0', 'mode': 'w', 'online': '1', 'frontend-id': '12', 'type': 'file'} to /local/domain/0/backend/vbd/12/51712.
[2010-09-15 17:35:01 20392] INFO (XendDomainInfo:2160) createDevice: vbd : {'uuid': '240a3c36-c5cb-ee59-cfc5-92aed814e613', 'bootable': 0, 'driver': 'paravirtualised', 'dev': 'xvdb', 'uname': 'file:/home1/xen/home1_images/covi3_000000d7_d1', 'mode': 'w'}
[2010-09-15 17:35:01 20392] DEBUG (DevController:95) DevController: writing {'backend-id': '0', 'virtual-device': '51728', 'device-type': 'disk', 'state': '1', 'backend': '/local/domain/0/backend/vbd/12/51728'} to /local/domain/12/device/vbd/51728.
[2010-09-15 17:35:01 20392] DEBUG (DevController:97) DevController: writing {'domain': 'covi3_000000d7', 'frontend': '/local/domain/12/device/vbd/51728', 'uuid': '240a3c36-c5cb-ee59-cfc5-92aed814e613', 'bootable': '0', 'dev': 'xvdb', 'state': '1', 'params': '/home1/xen/home1_images/covi3_000000d7_d1', 'mode': 'w', 'online': '1', 'frontend-id': '12', 'type': 'file'} to /local/domain/0/backend/vbd/12/51728.
[2010-09-15 17:35:01 20392] INFO (XendDomainInfo:2160) createDevice: vif : {'bridge': 'eth1', 'mac': '00:16:3e:00:03:51', 'uuid': '6e73d97a-33b5-14c3-f0d6-366f9dc64a2b'}
[2010-09-15 17:35:01 20392] DEBUG (DevController:95) DevController: writing {'backend-id': '0', 'mac': '00:16:3e:00:03:51', 'handle': '0', 'state': '1', 'backend': '/local/domain/0/backend/vif/12/0'} to /local/domain/12/device/vif/0.
[2010-09-15 17:35:01 20392] DEBUG (DevController:97) DevController: writing {'bridge': 'eth1', 'domain': 'covi3_000000d7', 'handle': '0', 'uuid': '6e73d97a-33b5-14c3-f0d6-366f9dc64a2b', 'script': '/etc/xen/scripts/vif-bridge', 'mac': '00:16:3e:00:03:51', 'frontend-id': '12', 'state': '1', 'online': '1', 'frontend': '/local/domain/12/device/vif/0'} to /local/domain/0/backend/vif/12/0.
[2010-09-15 17:35:01 20392] INFO (image:394) spawning device models: /usr/lib64/xen/bin/qemu-dm ['/usr/lib64/xen/bin/qemu-dm', '-d', '12', '-domain-name', 'covi3_000000d7', '-videoram', '4', '-vnc', '
0.0.0.0:0', '-vncunused', '-vcpus', '2', '-boot', 'dc', '-serial', 'pty', '-acpi', '-net', 'nic,vlan=1,macaddr=00:16:3e:00:03:51,model=rtl8139', '-net', 'tap,vlan=1,ifname=tap12.0,bridge=eth1', '-M', 'xenfv']
[2010-09-15 17:35:01 20392] INFO (image:443) device model pid: 12109
[2010-09-15 17:35:01 20392] DEBUG (XendDomainInfo:3052) Storing VM details: {'on_xend_stop': 'ignore', 'shadow_memory': '34', 'uuid': '8c4aa941-7284-761e-a8bd-587f3780defb', 'on_reboot': 'restart', 'start_time': '1284539701.23', 'on_poweroff': 'destroy', 'bootloader_args': '', 'on_xend_start': 'ignore', 'on_crash': 'restart', 'xend/restart_count': '0', 'vcpus': '2', 'vcpu_avail': '3', 'bootloader': '', 'image': '(hvm (kernel ) (videoram 4) (hpet 0) (stdvga 0) (vnclisten 0.0.0.0) (loader /usr/lib/xen/boot/hvmloader) (vncconsole 1) (serial pty) (vncunused 1) (xen_platform_pci 1) (boot dc) (rtc_timeoffset 0) (pci ()) (pae 1) (vpt_align 1) (hap 1) (viridian 0) (acpi 1) (localtime 0) (timer_mode 1) (vnc 1) (nographic 0) (guest_os_type default) (pci_msitranslate 1) (apic 1) (sdl 0) (monitor 0) (device_model /usr/lib64/xen/bin/qemu-dm) (pci_power_mgmt 0) (usb 0) (xauthority /root/.Xauthority) (isa 0) (notes (SUSPEND_CANCEL 1)))', 'name': 'covi3_000000d7'}
[2010-09-15 17:35:01 20392] INFO (image:531) waiting for sentinel_fifo
[2010-09-15 17:35:01 20392] DEBUG (XendDomainInfo:1622) Storing domain details: {'console/port': '4', 'name': 'covi3_000000d7', 'console/limit': '1048576', 'store/port': '3', 'vm': '/vm/8c4aa941-7284-761e-a8bd-587f3780defb', 'domid': '12', 'image/suspend-cancel': '1', 'cpu/0/availability': 'online', 'memory/target': '4194304', 'control/platform-feature-multiprocessor-suspend': '1', 'store/ring-ref': '1044476', 'cpu/1/availability': 'online', 'console/type': 'ioemu'}
[2010-09-15 17:35:01 20392] DEBUG (DevController:95) DevController: writing {'state': '1', 'backend-id': '0', 'backend': '/local/domain/0/backend/console/12/0'} to /local/domain/12/device/console/0.
[2010-09-15 17:35:01 20392] DEBUG (DevController:97) DevController: writing {'domain': 'covi3_000000d7', 'frontend': '/local/domain/12/device/console/0', 'uuid': 'fa15a7e2-e43c-0382-a03e-ff39fb59f9bf', 'frontend-id': '12', 'state': '1', 'location': '4', 'online': '1', 'protocol': 'vt100'} to /local/domain/0/backend/console/12/0.
[2010-09-15 17:35:01 20392] DEBUG (XendDomainInfo:1709) XendDomainInfo.handleShutdownWatch
[2010-09-15 17:35:01 20392] DEBUG (DevController:139) Waiting for devices vif.
[2010-09-15 17:35:01 20392] DEBUG (DevController:144) Waiting for 0.
[2010-09-15 17:35:01 20392] DEBUG (DevController:629) hotplugStatusCallback /local/domain/0/backend/vif/12/0/hotplug-status.
[2010-09-15 17:36:41 20392] DEBUG (XendDomainInfo:2724) XendDomainInfo.destroy: domid=12
[2010-09-15 17:36:42 20392] DEBUG (XendDomainInfo:2199) Destroying device model
[2010-09-15 17:36:42 20392] INFO (image:556) covi3_000000d7 device model terminated
[2010-09-15 17:36:42 20392] DEBUG (XendDomainInfo:2206) Releasing devices
[2010-09-15 17:36:42 20392] DEBUG (XendDomainInfo:2219) Removing vif/0
[2010-09-15 17:36:42 20392] DEBUG (XendDomainInfo:1134) XendDomainInfo.destroyDevice: deviceClass = vif, device = vif/0
[2010-09-15 17:36:42 20392] DEBUG (XendDomainInfo:2219) Removing vbd/51712
[2010-09-15 17:36:42 20392] DEBUG (XendDomainInfo:1134) XendDomainInfo.destroyDevice: deviceClass = vbd, device = vbd/51712
[2010-09-15 17:36:42 20392] DEBUG (XendDomainInfo:2219) Removing vbd/51728
[2010-09-15 17:36:42 20392] DEBUG (XendDomainInfo:1134) XendDomainInfo.destroyDevice: deviceClass = vbd, device = vbd/51728
[2010-09-15 17:36:42 20392] DEBUG (XendDomainInfo:2219) Removing vfb/0
[2010-09-15 17:36:42 20392] DEBUG (XendDomainInfo:1134) XendDomainInfo.destroyDevice: deviceClass = vfb, device = vfb/0
[2010-09-15 17:36:42 20392] DEBUG (XendDomainInfo:2219) Removing console/0
[2010-09-15 17:36:42 20392] DEBUG (XendDomainInfo:1134) XendDomainInfo.destroyDevice: deviceClass = console, device = console/0
[2010-09-15 17:36:42 20392] DEBUG (XendDomainInfo:2204) No device model
[2010-09-15 17:36:42 20392] DEBUG (XendDomainInfo:2206) Releasing devices
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------