ok, i retested all 8 machines with 'file' instead of 'tap:aio'. all 8 booted
fine... :-(
so, the issue appears to be tap... i had already tried killing blktapctrl en
restarting it, so what could be the problem here? CAN the problem be kernel
config? or not?
Sincerely,
Maarten
Op Friday 23 October 2009 12:02:18 schreef Maarten Vanraes:
> i booted 8 machines:
>
> test1: hung after "XENBUS: Device with no driver: device/console/0"
> test2: hung after "XENBUS: Device with no driver: device/console/0"
> test3: "Unable to mount root fs" list partitions: "sda1 sdb1" and shut down
> test4: hung after "XENBUS: Device with no driver: device/console/0"
> test5: booted completely, SSH works, can write files, ...
> test6: booted completely, SSH works, can write files, ...
> test7: "Unable to mount root fs" list partitions: "sda1 sdb1" and shut down
> test8: hung after "XENBUS: Device with no driver: device/console/0"
>
> - all 8 xm's are defunct on the host.
>
> - i have about 15 "/var/run/tap/tapctrlwrite35 /var/run/tap/tapctrlread35"
> processes and 2 "/var/run/tap/tapctrlwrite34 /var/run/tap/tapctrlread34"
>
> - all 6 up machines have 2 blktap processes (sda1 and sdb1)
>
> is there ANYTHING i can try?
>
> does anyone have any idea???
>
> i'm completely stuck here...
>
> i've already rebooted the host, to see if it would help.
>
> Op Friday 23 October 2009 11:32:57 schreef Maarten Vanraes:
> > Hello,
> >
> > i used xen 3.2 before on 2.6.21, now i'm trying 3.4.0 on 2.6.31-4.
> >
> > my domU's hang at booting time...
> >
> > I've been reading and looking around for about a week now.
> >
> > I've identified 3 different places to hang (tested with the same domUs):
> > * right after kernel booted, before init
> > * after "mounting swap..."
> > * after "starting crond"
> > * sometimes it boots until login and i can login fine.
> >
> > i'm alway starting with "xm create -c <domname>"
> >
> > in the host: i see that the "xm" command is always defunct.
> >
> > if it's after starting crond. then SSH is also started, and i can ssh
> > fine. if it's before, i cannot SSH. (this also happens if i manually
> > start with "xm create ", and do xm console later; the only difference is
> > that there is no defunct xm process).
> >
> > I'm using the ebuild from the gentoo-patches and google code with kernel
> > 2.6.31-r4 .
> >
> > both dom0 and domU kernels are that kernel, allthough they have different
> > configs. (see below)
> >
> > my domUs are debootstrapped debian4, with udev and syslog-ng installed.
> >
> > I tried booting also with extra='console=xvc0' and xencons=tty1 in
> > different combinations, but that was not it.
> >
> > I thought it was something console-related, because of the error (see
> > below): "XENBUS: Device with no driver: device/console/0"
> >
> > the xen log files show no error, i can figure out.
> >
> > also something i see, i also tried different things here, but cant find
> > it: PCI: Fatal: No config space access function found
> > PCI: setting up Xen PCI frontend stub
> >
> >
> > xend-debug log does have errors, but i don't think they are serious:
> > -------------------------------------------------------------------------
> >-- ------------- cat: /sys/bus/scsi/devices/host0/vendor: No such file or
> > directory cat: /sys/bus/scsi/devices/host0/model: No such file or
> > directory cat: /sys/bus/scsi/devices/host0/type: No such file or
> > directory cat: /sys/bus/scsi/devices/host0/rev: No such file or directory
> > cat: /sys/bus/scsi/devices/host0/scsi_level: No such file or directory
> > cat: /sys/bus/scsi/devices/host1/vendor: No such file or directory
> > cat: /sys/bus/scsi/devices/host1/model: No such file or directory
> > cat: /sys/bus/scsi/devices/host1/type: No such file or directory
> > cat: /sys/bus/scsi/devices/host1/rev: No such file or directory
> > cat: /sys/bus/scsi/devices/host1/scsi_level: No such file or directory
> > cat: /sys/bus/scsi/devices/host2/vendor: No such file or directory
> > cat: /sys/bus/scsi/devices/host2/model: No such file or directory
> > cat: /sys/bus/scsi/devices/host2/type: No such file or directory
> > cat: /sys/bus/scsi/devices/host2/rev: No such file or directory
> > cat: /sys/bus/scsi/devices/host2/scsi_level: No such file or directory
> > cat: /sys/bus/scsi/devices/host3/vendor: No such file or directory
> > cat: /sys/bus/scsi/devices/host3/model: No such file or directory
> > cat: /sys/bus/scsi/devices/host3/type: No such file or directory
> > cat: /sys/bus/scsi/devices/host3/rev: No such file or directory
> > cat: /sys/bus/scsi/devices/host3/scsi_level: No such file or directory
> > cat: /sys/bus/scsi/devices/host4/vendor: No such file or directory
> > cat: /sys/bus/scsi/devices/host4/model: No such file or directory
> > cat: /sys/bus/scsi/devices/host4/type: No such file or directory
> > cat: /sys/bus/scsi/devices/host4/rev: No such file or directory
> > cat: /sys/bus/scsi/devices/host4/scsi_level: No such file or directory
> > cat: /sys/bus/scsi/devices/host5/vendor: No such file or directory
> > cat: /sys/bus/scsi/devices/host5/model: No such file or directory
> > cat: /sys/bus/scsi/devices/host5/type: No such file or directory
> > cat: /sys/bus/scsi/devices/host5/rev: No such file or directory
> > cat: /sys/bus/scsi/devices/host5/scsi_level: No such file or directory
> > cat: /sys/bus/scsi/devices/host6/vendor: No such file or directory
> > cat: /sys/bus/scsi/devices/host6/model: No such file or directory
> > cat: /sys/bus/scsi/devices/host6/type: No such file or directory
> > cat: /sys/bus/scsi/devices/host6/rev: No such file or directory
> > cat: /sys/bus/scsi/devices/host6/scsi_level: No such file or directory
> > cat: /sys/bus/scsi/devices/host7/vendor: No such file or directory
> > cat: /sys/bus/scsi/devices/host7/model: No such file or directory
> > cat: /sys/bus/scsi/devices/host7/type: No such file or directory
> > cat: /sys/bus/scsi/devices/host7/rev: No such file or directory
> > cat: /sys/bus/scsi/devices/host7/scsi_level: No such file or directory
> > cat: /sys/bus/scsi/devices/host8/vendor: No such file or directory
> > cat: /sys/bus/scsi/devices/host8/model: No such file or directory
> > cat: /sys/bus/scsi/devices/host8/type: No such file or directory
> > cat: /sys/bus/scsi/devices/host8/rev: No such file or directory
> > cat: /sys/bus/scsi/devices/host8/scsi_level: No such file or directory
> > cat: /sys/bus/scsi/devices/target8:0:0/vendor: No such file or directory
> > cat: /sys/bus/scsi/devices/target8:0:0/model: No such file or directory
> > cat: /sys/bus/scsi/devices/target8:0:0/type: No such file or directory
> > cat: /sys/bus/scsi/devices/target8:0:0/rev: No such file or directory
> > cat: /sys/bus/scsi/devices/target8:0:0/scsi_level: No such file or
> > directory cat: /sys/bus/scsi/devices/target8:0:1/vendor: No such file or
> > directory cat: /sys/bus/scsi/devices/target8:0:1/model: No such file or
> > directory cat: /sys/bus/scsi/devices/target8:0:1/type: No such file or
> > directory cat: /sys/bus/scsi/devices/target8:0:1/rev: No such file or
> > directory cat: /sys/bus/scsi/devices/target8:0:1/scsi_level: No such file
> > or directory cat: /sys/bus/scsi/devices/target8:1:0/vendor: No such file
> > or directory cat: /sys/bus/scsi/devices/target8:1:0/model: No such file
> > or directory cat: /sys/bus/scsi/devices/target8:1:0/type: No such file or
> > directory cat: /sys/bus/scsi/devices/target8:1:0/rev: No such file or
> > directory cat: /sys/bus/scsi/devices/target8:1:0/scsi_level: No such file
> > or directory
> >
> >
> >
> >
> > xm console output:
> > -------------------------
> > Using config file "/etc/xen/vm-test6".
> > Started domain vm-test6 (id=15)
> > [ 0.000000] Linux version 2.6.31
> > (root@sparco01) (gcc version 4.3.2 (Gentoo 4.3.2-r3 p1.6, pie-10.1.5) )
> > #15 SMP Thu Oct 22 16:44:31 CEST 2009
> > [ 0.000000] Command line: root=/dev/sda1 ro console=xvc0 xencons=tty1
> > [ 0.000000] KERNEL supported cpus:
> > [ 0.000000] Intel GenuineIntel
> > [ 0.000000] AMD AuthenticAMD
> > [ 0.000000] Centaur CentaurHauls
> > [ 0.000000] maxmem of 4104M is invalid for an initial allocation of
> > 128M, using 4096M
> > [ 0.000000] Xen-provided physical RAM map:
> > [ 0.000000] Xen: 0000000000000000 - 0000000100000000 (usable)
> > [ 0.000000] last_pfn = 0x100000 max_arch_pfn = 0x80000000
> > [ 0.000000] init_memory_mapping: 0000000000000000-0000000100000000
> > [ 0.000000] (3 early reservations) ==> bootmem [0000000000 -
> > 0008000000] [ 0.000000] #0 [0001485000 - 00014d7000] Xen
> > provided ==> [0001485000 - 00014d7000]
> > [ 0.000000] #1 [0001000000 - 0001464cb8] TEXT DATA BSS ==>
> > [0001000000 - 0001464cb8]
> > [ 0.000000] #2 [00014d7000 - 0001cdc000] PGTABLE ==>
> > [00014d7000 - 0001cdc000]
> > [ 0.000000] Zone PFN ranges:
> > [ 0.000000] DMA 0x00000000 -> 0x00001000
> > [ 0.000000] DMA32 0x00001000 -> 0x00100000
> > [ 0.000000] Normal 0x00100000 -> 0x00100000
> > [ 0.000000] Movable zone start PFN for each node
> > [ 0.000000] early_node_map[2] active PFN ranges
> > [ 0.000000] 0: 0x00000000 -> 0x00008000
> > [ 0.000000] 0: 0x00100000 -> 0x00100000
> > [ 0.000000] NR_CPUS:64 nr_cpumask_bits:64 nr_cpu_ids:1 nr_node_ids:1
> > [ 0.000000] PERCPU: Allocated 11 4k pages, static data 41120 bytes
> > [ 0.000000] Swapping MFNs for PFN 13a6 and 1493 (MFN 2606cc and
> > 2605df) [ 0.000000] Built 1 zonelists in Zone order, mobility grouping
> > on. Total pages: 18432
> > [ 0.000000] Kernel command line: root=/dev/sda1 ro console=xvc0
> > xencons=tty1
> > [ 0.000000] PID hash table entries: 512 (order: 9, 4096 bytes)
> > [ 0.000000] Dentry cache hash table entries: 16384 (order: 5, 131072
> > bytes) [ 0.000000] Inode-cache hash table entries: 8192 (order: 4,
> > 65536 bytes) [ 0.000000] Initializing CPU#0
> > [ 0.000000] Software IO TLB disabled
> > [ 0.000000] Memory: 52288k/4194304k available (2511k kernel code,
> > 4063232k absent, 78716k reserved, 1190k data, 220k init)
> > [ 0.000000] SLUB: Genslabs=13, HWalign=64, Order=0-3, MinObjects=0,
> > CPUs=1, Nodes=1
> > [ 0.000000] NR_IRQS:336
> > [ 0.000000] Xen reported: 2493.748 MHz processor.
> > [ 0.000999] Console: colour dummy device 80x25
> > [ 0.000999] console [tty-1] enabled
> > [ 0.862897] Calibrating delay using timer specific routine.. 4990.76
> > BogoMIPS (lpj=2495382)
> > [ 0.862945] Mount-cache hash table entries: 256
> > [ 0.863126] CPU: L1 I cache: 32K, L1 D cache: 32K
> > [ 0.863131] CPU: L2 cache: 6144K
> > [ 0.863142] SMP alternatives: switching to UP code
> > [ 0.878077] Freeing SMP alternatives: 22k freed
> > [ 0.878172] Brought up 1 CPUs
> > [ 0.879684] NET: Registered protocol family 16
> > [ 0.880701] Brought up 1 CPUs
> > [ 0.880910] PCI: Fatal: No config space access function found
> > [ 0.880919] PCI: setting up Xen PCI frontend stub
> > [ 0.883166] bio: create slab <bio-0> at 0
> > [ 0.883483] suspend: event channel 9
> > [ 0.883782] xen_mem: Initialising balloon driver.
> > [ 1.018676] SCSI subsystem initialized
> > [ 1.018815] usbcore: registered new interface driver usbfs
> > [ 1.018853] usbcore: registered new interface driver hub
> > [ 1.018893] usbcore: registered new device driver usb
> > [ 1.019198] PCI: System does not support PCI
> > [ 1.019202] PCI: System does not support PCI
> > [ 1.019616] NET: Registered protocol family 2
> > [ 1.019675] IP route cache hash table entries: 4096 (order: 3, 32768
> > bytes) [ 1.019865] TCP established hash table entries: 16384 (order:
> > 6, 262144 bytes)
> > [ 1.020169] TCP bind hash table entries: 16384 (order: 6, 262144
> > bytes) [ 1.020426] TCP: Hash tables configured (established 16384 bind
> > 16384) [ 1.020431] TCP reno registered
> > [ 1.020489] NET: Registered protocol family 1
> > [ 1.020628] platform rtc_cmos: registered platform RTC device (no PNP
> > device found)
> > [ 1.022852] VFS: Disk quotas dquot_6.5.2
> > [ 1.022929] Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
> > [ 1.023370] msgmni has been set to 256
> > [ 1.023648] alg: No test for stdrng (krng)
> > [ 1.023659] io scheduler noop registered
> > [ 1.023661] io scheduler anticipatory registered
> > [ 1.023664] io scheduler deadline registered
> > [ 1.023672] io scheduler cfq registered (default)
> > [ 1.023722] pci_hotplug: PCI Hot Plug PCI Core version: 0.5
> > [ 1.023745] pciehp: PCI Express Hot Plug Controller Driver version:
> > 0.4 [ 1.023895] Linux agpgart interface v0.103
> > [ 1.024949] brd: module loaded
> > [ 1.025551] loop: module loaded
> > [ 1.025696] nbd: registered device at major 43
> > [ 1.028481] Xen virtual console successfully installed as tty1
> > [ 1.028525] Event-channel device installed.
> > [ 1.050852] netfront: Initialising virtual ethernet driver.
> > [ 1.067106] xen-vbd: registered block device major 8
> > [ 1.067122] blkfront: sda1: barriers enabled
> > [ 1.067997] blkfront: sdb1: barriers enabled
> > [ 1.076451] usbmon: debugfs is not available
> > [ 1.076454] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
> > [ 1.076493] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
> > [ 1.076527] uhci_hcd: USB Universal Host Controller Interface driver
> > [ 1.076601] Initializing USB Mass Storage driver...
> > [ 1.076625] usbcore: registered new interface driver usb-storage
> > [ 1.076629] USB Mass Storage support registered.
> > [ 1.076653] usbcore: registered new interface driver libusual
> > [ 1.077546] i8042.c: No controller found.
> > [ 1.077574] mice: PS/2 mouse device common for all mice
> > [ 1.077802] TCP cubic registered
> > [ 1.077804] Initializing XFRM netlink socket
> > [ 1.077809] NET: Registered protocol family 17
> > [ 1.077906] XENBUS: Device with no driver: device/console/0
> > [ 1.152249] kjournald starting. Commit interval 5 seconds
> > [ 1.152264] EXT3-fs: mounted filesystem with writeback data mode.
> > [ 1.152273] VFS: Mounted root (ext3 filesystem) readonly on device
> > 8:1. [ 1.152351] Freeing unused kernel memory: 220k freed
> > INIT: version 2.86 booting
> > Activating swap...[ 13.319535] Adding 262136k swap on /dev/sdb1.
> > Priority:-1 extents:1 across:262136k SS
> > done.
> > Checking root file system...fsck 1.40-WIP (14-Nov-2006)
> > /dev/sda1: clean, 15166/65808 files, 73647/263168 blocks
> > done.
> > [ 14.432238] EXT3 FS on sda1, internal journal
> > Setting the system clock..
> > Cannot access the Hardware Clock via any known method.
> > Use the --debug option to see the details of our search for an access
> > method. Cleaning up ifupdown....
> > Loading kernel modules...done.
> > Loading device-mapper support.
> > Checking file systems...fsck 1.40-WIP (14-Nov-2006)
> > done.
> > Setting kernel variables...done.
> > Mounting local filesystems...done.
> > Activating swapfile swap...done.
> > Setting up networking....
> > Configuring network interfaces...done.
> > INIT: Entering runlevel: 2
> > Starting system logging: syslog-ng.
> > Starting nagios-nrpe: nagios-nrpe.
> > * Not starting internet superserver: no services enabled.
> > Starting OpenBSD Secure Shell server: sshd[ 22.389110] NET: Registered
> > protocol family 10
> > .
> > Starting periodic command scheduler: crond.
> >
> > Debian GNU/Linux 4.0 test6.colo.ba.be tty1
> >
> > test6.colo.ba.be login: root
> > Password:
> > Linux test6.colo.ba.be 2.6.31 #15 SMP Thu Oct 22 16:44:31 CEST 2009
> > x86_64
> >
> > The programs included with the Debian GNU/Linux system are free software;
> > the exact distribution terms for each program are described in the
> > individual files in /usr/share/doc/*/copyright.
> >
> > Debian GNU/Linux comes with ABSOLUTELY NO WARRANTY, to the extent
> > permitted by applicable law.
> >
> >
> > dom0 kernel .config file
> > -------------------------------
> >
> > sparco01 xen # zcat /proc/config.gz | grep XEN
> > CONFIG_X86_64_XEN=y
> > # CONFIG_XEN_PCIDEV_FRONTEND is not set
> > CONFIG_XEN=y
> > CONFIG_XEN_INTERFACE_VERSION=0x00030207
> > # XEN
> > CONFIG_XEN_PRIVILEGED_GUEST=y
> > # CONFIG_XEN_UNPRIVILEGED_GUEST is not set
> > CONFIG_XEN_PRIVCMD=y
> > CONFIG_XEN_XENBUS_DEV=y
> > CONFIG_XEN_BACKEND=y
> > CONFIG_XEN_BLKDEV_BACKEND=y
> > CONFIG_XEN_BLKDEV_TAP=y
> > CONFIG_XEN_BLKDEV_TAP2=y
> > CONFIG_XEN_BLKBACK_PAGEMAP=y
> > CONFIG_XEN_NETDEV_BACKEND=y
> > CONFIG_XEN_NETDEV_TX_SHIFT=8
> > # CONFIG_XEN_NETDEV_PIPELINED_TRANSMITTER is not set
> > CONFIG_XEN_NETDEV_LOOPBACK=m
> > CONFIG_XEN_PCIDEV_BACKEND=y
> > CONFIG_XEN_PCIDEV_BACKEND_VPCI=y
> > # CONFIG_XEN_PCIDEV_BACKEND_PASS is not set
> > # CONFIG_XEN_PCIDEV_BACKEND_SLOT is not set
> > # CONFIG_XEN_PCIDEV_BACKEND_CONTROLLER is not set
> > # CONFIG_XEN_PCIDEV_BE_DEBUG is not set
> > # CONFIG_XEN_TPMDEV_BACKEND is not set
> > CONFIG_XEN_SCSI_BACKEND=y
> > CONFIG_XEN_USB_BACKEND=y
> > # CONFIG_XEN_BLKDEV_FRONTEND is not set
> > # CONFIG_XEN_NETDEV_FRONTEND is not set
> > # CONFIG_XEN_SCSI_FRONTEND is not set
> > # CONFIG_XEN_USB_FRONTEND is not set
> > # CONFIG_XEN_GRANT_DEV is not set
> > # CONFIG_XEN_FRAMEBUFFER is not set
> > CONFIG_XEN_DISABLE_SERIAL=y
> > CONFIG_XEN_SYSFS=y
> > CONFIG_XEN_NR_GUEST_DEVICES=256
> > # CONFIG_XEN_COMPAT_030002_AND_LATER is not set
> > # CONFIG_XEN_COMPAT_030004_AND_LATER is not set
> > # CONFIG_XEN_COMPAT_030100_AND_LATER is not set
> > CONFIG_XEN_COMPAT_030200_AND_LATER=y
> > # CONFIG_XEN_COMPAT_030300_AND_LATER is not set
> > # CONFIG_XEN_COMPAT_LATEST_ONLY is not set
> > CONFIG_XEN_COMPAT=0x030200
> > CONFIG_XEN_VCPU_INFO_PLACEMENT=y
> > CONFIG_XEN_SMPBOOT=y
> > CONFIG_XEN_DEVMEM=y
> > CONFIG_XEN_BALLOON=y
> > CONFIG_XEN_SCRUB_PAGES=y
> >
> >
> >
> > domU kernel .config file:
> > --------------------------------
> > test6:~# zcat /proc/config.gz | grep XEN
> > CONFIG_X86_64_XEN=y
> > CONFIG_XEN_PCIDEV_FRONTEND=y
> > # CONFIG_XEN_PCIDEV_FE_DEBUG is not set
> > CONFIG_XEN=y
> > CONFIG_XEN_INTERFACE_VERSION=0x00030207
> > # XEN
> > # CONFIG_XEN_PRIVILEGED_GUEST is not set
> > CONFIG_XEN_UNPRIVILEGED_GUEST=y
> > CONFIG_XEN_PRIVCMD=y
> > CONFIG_XEN_XENBUS_DEV=y
> > # CONFIG_XEN_BACKEND is not set
> > CONFIG_XEN_BLKDEV_FRONTEND=y
> > CONFIG_XEN_NETDEV_FRONTEND=y
> > # CONFIG_XEN_NETDEV_ACCEL_SFC_FRONTEND is not set
> > CONFIG_XEN_SCSI_FRONTEND=y
> > CONFIG_XEN_USB_FRONTEND=y
> > # CONFIG_XEN_USB_FRONTEND_HCD_STATS is not set
> > # CONFIG_XEN_GRANT_DEV is not set
> > CONFIG_XEN_FRAMEBUFFER=y
> > CONFIG_XEN_KEYBOARD=y
> > CONFIG_XEN_DISABLE_SERIAL=y
> > CONFIG_XEN_SYSFS=y
> > CONFIG_XEN_NR_GUEST_DEVICES=256
> > # CONFIG_XEN_COMPAT_030002_AND_LATER is not set
> > # CONFIG_XEN_COMPAT_030004_AND_LATER is not set
> > # CONFIG_XEN_COMPAT_030100_AND_LATER is not set
> > # CONFIG_XEN_COMPAT_030200_AND_LATER is not set
> > # CONFIG_XEN_COMPAT_030300_AND_LATER is not set
> > CONFIG_XEN_COMPAT_LATEST_ONLY=y
> > CONFIG_XEN_COMPAT=0xffffff
> > CONFIG_XEN_VCPU_INFO_PLACEMENT=y
> > CONFIG_XEN_SMPBOOT=y
> > CONFIG_XEN_DEVMEM=y
> > CONFIG_XEN_BALLOON=y
> > CONFIG_XEN_SCRUB_PAGES=y
--
BA N.V. - http://www.ba.be
_______________________________________________
Xen-users mailing list
Xen-users@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-users
|
Home