[Xen-users] XEN 4.0.1 + pv_ops kernel DomU issues

[David Gonzalez Herrera <dgonzalezh@xxxxxxxxx>]

Hey xen-users,

I'm a XEN 3.4.3 User and have some DomUs running under my Server but I want to test XEN 4.0.1 + pv_ops kernel 2.6.3x.x and I followed these tutorials to upgrade:

http://ppadala.net/blog/2010/09/how-to-setup-xen4-pvops-2-6-32-x-on-centos-5-5/

I'm a little lost after I upgraded my Dom0 kernel to pv_ops 2.6.32.24 GIT and XEN 4.0.1 using GIOTCO repos I'm a newbie to XEN, I'm using CentOS 5.5 X86_64 and I've custom built my kernel, after that I created an initrd image with this command:

mkinitrd -v -f --omit-raid-modules --omit-lvm-modules --omit-scsi-modules --without-multipath --without-dmraid --builtin=xen-netfront --builtin=xen-blkfront --preload=xen-blkfront /boot/initrd-2.6.18domU.img  2.6.32.24xen

when I tun xm create -c dev

I get:

[root@vm ~]# xm create -c dev
Using config file "/etc/xen/dev".
Started domain dev (id=4)
(early) Linux version 2.6.32.24xen (root@xxxxxxxxxxxxxx) (gcc version 4.1.2 20080704 (Red Hat 4.1.2-48)) #1 SMP Mon Oct 25 05:59:22 COT 2010

(early) Command line: root=/dev/sda1 ro ip=192.168.254.10:127.0.255.255:192.168.254.1:255.255.255.0::eth0:off earlyprintk=xen console=hvc0
(early) KERNEL supported cpus:
(early)   Intel GenuineIntel
(early)   AMD AuthenticAMD

(early)   Centaur CentaurHauls
(early) ACPI in unprivileged domain disabled
(early) released 0 pages of unused memory
(early) BIOS-provided physical RAM map:
(early)  Xen: 0000000000000000 - 00000000000a0000 (usable)

(early)  Xen: 00000000000a0000 - 0000000000100000 (reserved)
(early)  Xen: 0000000000100000 - 0000000030800000 (usable)
(early) bootconsole [xenboot0] enabled
(early) DMI not present or invalid.
(early) last_pfn = 0x30800 max_arch_pfn = 0x400000000

(early) Scanning 1 areas for low memory corruption
(early) modified physical RAM map:
(early)  modified: 0000000000000000 - 0000000000001000 (early) (usable)(early)
(early)  modified: 0000000000001000 - 0000000000006000 (early) (reserved)(early)

(early)  modified: 0000000000006000 - 00000000000a0000 (early) (usable)(early)
(early)  modified: 00000000000a0000 - 0000000000100000 (early) (reserved)(early)
(early)  modified: 0000000000100000 - 0000000030800000 (early) (usable)(early)

(early) init_memory_mapping: 0000000000000000-0000000030800000
(early) RAMDISK: 0172f000 - 01cc6000
(early) No NUMA configuration found
(early) Faking a node at 0000000000000000-0000000030800000
(early) Bootmem setup node 0 0000000000000000-0000000030800000

(early)   NODE_DATA [0000000000008000 - 000000000000bfff]
(early)   bootmap [000000000000c000 -  00000000000120ff] pages 7
(early) (9 early reservations) ==> bootmem [0000000000 - 0030800000]
(early)   #0 [0000000000 - 0000001000]   BIOS data page(early)  ==> [0000000000 - 0000001000]

(early)   #1 [0001e49000 - 0001e5c000]   XEN PAGETABLES(early)  ==> [0001e49000 - 0001e5c000]
(early)   #2 [0000006000 - 0000008000]       TRAMPOLINE(early)  ==> [0000006000 - 0000008000]
(early)   #3 [0001000000 - 00016041d0]    TEXT DATA BSS(early)  ==> [0001000000 - 00016041d0]

(early)   #4 [000172f000 - 0001cc6000]          RAMDISK(early)  ==> [000172f000 - 0001cc6000]
(early)   #5 [0001cc6000 - 0001e49000]   XEN START INFO(early)  ==> [0001cc6000 - 0001e49000]
(early)   #6 [0030000000 - 0030800000]        XEN EXTRA(early)  ==> [0030000000 - 0030800000]

(early)   #7 [0001605000 - 0001611000]              BRK(early)  ==> [0001605000 - 0001611000]
(early)   #8 [0000100000 - 0000270000]          PGTABLE(early)  ==> [0000100000 - 0000270000]
(early) Zone PFN ranges:

(early)   DMA      0x00000000 -> 0x00001000
(early)   DMA32    0x00001000 -> 0x00100000
(early)   Normal   0x00100000 -> 0x00100000
(early) Movable zone start PFN for each node
(early) early_node_map[3] active PFN ranges

(early)     0: 0x00000000 -> 0x00000001
(early)     0: 0x00000006 -> 0x000000a0
(early)     0: 0x00000100 -> 0x00030800
(early) SMP: Allowing 4 CPUs, 0 hotplug CPUs
(early) No local APIC present
(early) APIC: disable apic facility

(early) PM: Registered nosave memory: 0000000000001000 - 0000000000006000
(early) PM: Registered nosave memory: 00000000000a0000 - 0000000000100000
(early) Allocating PCI resources starting at 30800000 (gap: 30800000:cf800000)

(early) Booting paravirtualized kernel on Xen
(early) Xen version: 4.0.1 (preserve-AD)
(early) NR_CPUS:8 nr_cpumask_bits:8 nr_cpu_ids:4 nr_node_ids:1
(early) PERCPU: Embedded 28 pages/cpu @ffff880001e69000 s84504 r8192 d21992 u114688

(early) pcpu-alloc: s84504 r8192 d21992 u114688 alloc=28*4096(early)
(early) pcpu-alloc: (early) [0] (early) 0 (early) [0] (early) 1 (early) [0] (early) 2 (early) [0] (early) 3 (early)
(early) Built 1 zonelists in Node order, mobility grouping on.  Total pages: 195468

(early) Policy zone: DMA32
(early) Kernel command line: root=/dev/sda1 ro ip=192.168.254.10:127.0.255.255:192.168.254.1:255.255.255.0::eth0:off earlyprintk=xen console=hvc0
(early) PID hash table entries: 4096 (order: 3, 32768 bytes)

(early) Initializing CPU#0
(early) Checking aperture...
(early) No AGP bridge found
(early) Memory: 757828k/794624k available (3064k kernel code, 404k absent, 36392k reserved, 1789k data, 596k init)
(early) Hierarchical RCU implementation.

(early) NR_IRQS:768
(early) Console: colour dummy device 80x25
(early) Linux version 2.6.32.24xen (root@xxxxxxxxxxxxxx) (gcc version 4.1.2 20080704 (Red Hat 4.1.2-48)) #1 SMP Mon Oct 25 05:59:22 COT 2010

(early) Command line: root=/dev/sda1 ro ip=192.168.254.10:127.0.255.255:192.168.254.1:255.255.255.0::eth0:off earlyprintk=xen console=hvc0
(early) KERNEL supported cpus:
(early)   Intel GenuineIntel
(early)   AMD AuthenticAMD

(early)   Centaur CentaurHauls
(early) ACPI in unprivileged domain disabled
(early) released 0 pages of unused memory
(early) BIOS-provided physical RAM map:
(early)  Xen: 0000000000000000 - 00000000000a0000 (usable)

(early)  Xen: 00000000000a0000 - 0000000000100000 (reserved)
(early)  Xen: 0000000000100000 - 0000000030800000 (usable)
(early) bootconsole [xenboot0] enabled
(early) DMI not present or invalid.
(early) last_pfn = 0x30800 max_arch_pfn = 0x400000000

(early) Scanning 1 areas for low memory corruption
(early) modified physical RAM map:
(early)  modified: 0000000000000000 - 0000000000001000 (usable)
(early)  modified: 0000000000001000 - 0000000000006000 (reserved)

(early)  modified: 0000000000006000 - 00000000000a0000 (usable)
(early)  modified: 00000000000a0000 - 0000000000100000 (reserved)
(early)  modified: 0000000000100000 - 0000000030800000 (usable)
(early) init_memory_mapping: 0000000000000000-0000000030800000

(early) RAMDISK: 0172f000 - 01cc6000
(early) No NUMA configuration found
(early) Faking a node at 0000000000000000-0000000030800000
(early) Bootmem setup node 0 0000000000000000-0000000030800000
(early)   NODE_DATA [0000000000008000 - 000000000000bfff]

(early)   bootmap [000000000000c000 -  00000000000120ff] pages 7
(early) (9 early reservations) ==> bootmem [0000000000 - 0030800000]
(early)   #0 [0000000000 - 0000001000]   BIOS data page ==> [0000000000 - 0000001000]

(early)   #1 [0001e49000 - 0001e5c000]   XEN PAGETABLES ==> [0001e49000 - 0001e5c000]
(early)   #2 [0000006000 - 0000008000]       TRAMPOLINE ==> [0000006000 - 0000008000]
(early)   #3 [0001000000 - 00016041d0]    TEXT DATA BSS ==> [0001000000 - 00016041d0]

(early)   #4 [000172f000 - 0001cc6000]          RAMDISK ==> [000172f000 - 0001cc6000]
(early)   #5 [0001cc6000 - 0001e49000]   XEN START INFO ==> [0001cc6000 - 0001e49000]
(early)   #6 [0030000000 - 0030800000]        XEN EXTRA ==> [0030000000 - 0030800000]

(early)   #7 [0001605000 - 0001611000]              BRK ==> [0001605000 - 0001611000]
(early)   #8 [0000100000 - 0000270000]          PGTABLE ==> [0000100000 - 0000270000]
(early) Zone PFN ranges:
(early)   DMA      0x00000000 -> 0x00001000

(early)   DMA32    0x00001000 -> 0x00100000
(early)   Normal   0x00100000 -> 0x00100000
(early) Movable zone start PFN for each node
(early) early_node_map[3] active PFN ranges
(early)     0: 0x00000000 -> 0x00000001

(early)     0: 0x00000006 -> 0x000000a0
(early)     0: 0x00000100 -> 0x00030800
(early) SMP: Allowing 4 CPUs, 0 hotplug CPUs
(early) No local APIC present
(early) APIC: disable apic facility
(early) PM: Registered nosave memory: 0000000000001000 - 0000000000006000

(early) PM: Registered nosave memory: 00000000000a0000 - 0000000000100000
(early) Allocating PCI resources starting at 30800000 (gap: 30800000:cf800000)
(early) Booting paravirtualized kernel on Xen
(early) Xen version: 4.0.1 (preserve-AD)

(early) NR_CPUS:8 nr_cpumask_bits:8 nr_cpu_ids:4 nr_node_ids:1
(early) PERCPU: Embedded 28 pages/cpu @ffff880001e69000 s84504 r8192 d21992 u114688
(early) pcpu-alloc: s84504 r8192 d21992 u114688 alloc=28*4096
(early) pcpu-alloc: [0] 0 [0] 1 [0] 2 [0] 3

(early) Built 1 zonelists in Node order, mobility grouping on.  Total pages: 195468
(early) Policy zone: DMA32
(early) Kernel command line: root=/dev/sda1 ro ip=192.168.254.10:127.0.255.255:192.168.254.1:255.255.255.0::eth0:off earlyprintk=xen console=hvc0

(early) PID hash table entries: 4096 (order: 3, 32768 bytes)
(early) Initializing CPU#0
(early) Checking aperture...
(early) No AGP bridge found
(early) Memory: 757828k/794624k available (3064k kernel code, 404k absent, 36392k reserved, 1789k data, 596k init)

(early) Hierarchical RCU implementation.
(early) NR_IRQS:768
(early) Console: colour dummy device 80x25
(early) console [tty0] enabled
console [hvc0] enabled, bootconsole disabled
(early) console [hvc0] enabled, bootconsole disabled

installing Xen timer for CPU 0
Detected 2300.066 MHz processor.
Calibrating delay loop (skipped), value calculated using timer frequency.. 4600.13 BogoMIPS (lpj=2300066)
Security Framework initialized
SELinux:  Initializing.

Dentry cache hash table entries: 131072 (order: 8, 1048576 bytes)
Inode-cache hash table entries: 65536 (order: 7, 524288 bytes)
Mount-cache hash table entries: 256
CPU: L1 I Cache: 64K (64 bytes/line), D cache 64K (64 bytes/line)

CPU: L2 Cache: 512K (64 bytes/line)
CPU 0/0x0 -> Node 0
CPU: Physical Processor ID: 0
CPU: Processor Core ID: 0
Performance Events: AMD PMU driver.
... version:                0
... bit width:              48

... generic registers:      4
... value mask:             0000ffffffffffff
... max period:             00007fffffffffff
... fixed-purpose events:   0
... event mask:             000000000000000f
SMP alternatives: switching to UP code

installing Xen timer for CPU 1
SMP alternatives: switching to SMP code
Initializing CPU#1
CPU: L1 I Cache: 64K (64 bytes/line), D cache 64K (64 bytes/line)
CPU: L2 Cache: 512K (64 bytes/line)
CPU 1/0x0 -> Node 0

CPU: Physical Processor ID: 0
CPU: Processor Core ID: 0
installing Xen timer for CPU 2
Initializing CPU#2
CPU: L1 I Cache: 64K (64 bytes/line), D cache 64K (64 bytes/line)
CPU: L2 Cache: 512K (64 bytes/line)

CPU 2/0x0 -> Node 0
CPU: Physical Processor ID: 0
CPU: Processor Core ID: 0
installing Xen timer for CPU 3
Initializing CPU#3
CPU: L1 I Cache: 64K (64 bytes/line), D cache 64K (64 bytes/line)
CPU: L2 Cache: 512K (64 bytes/line)

CPU 3/0x0 -> Node 0
CPU: Physical Processor ID: 0
CPU: Processor Core ID: 0
Brought up 4 CPUs
Grant table initialized
NET: Registered protocol family 16
PCI: setting up Xen PCI frontend stub
bio: create slab <bio-0> at 0

ACPI: Interpreter disabled.
xen_balloon: Initialising balloon driver with page order 0.
last_pfn = 0x30800 max_arch_pfn = 0x400000000
vgaarb: loaded
usbcore: registered new interface driver usbfs
usbcore: registered new interface driver hub

usbcore: registered new device driver usb
PCI: System does not support PCI
PCI: System does not support PCI
NetLabel: Initializing
NetLabel:  domain hash size = 128
NetLabel:  protocols = UNLABELED CIPSOv4

NetLabel:  unlabeled traffic allowed by default
Switching to clocksource xen
pnp: PnP ACPI: disabled
NET: Registered protocol family 2
IP route cache hash table entries: 32768 (order: 6, 262144 bytes)
TCP established hash table entries: 131072 (order: 9, 2097152 bytes)

TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
TCP: Hash tables configured (established 131072 bind 65536)
TCP reno registered
NET: Registered protocol family 1
Trying to unpack rootfs image as initramfs...

Freeing initrd memory: 5724k freed
platform rtc_cmos: registered platform RTC device (no PNP device found)
Scanning for low memory corruption every 60 seconds
audit: initializing netlink socket (disabled)
type=2000 audit(1288030177.184:1): initialized

VFS: Disk quotas dquot_6.5.2
Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
msgmni has been set to 1491
alg: No test for stdrng (krng)
Block layer SCSI generic (bsg) driver version 0.4 loaded (major 254)

io scheduler noop registered
io scheduler anticipatory registered
io scheduler deadline registered
io scheduler cfq registered (default)
pci_hotplug: PCI Hot Plug PCI Core version: 0.5
Non-volatile memory driver v1.3

Linux agpgart interface v0.103
brd: module loaded
Uniform Multi-Platform E-IDE driver
ide_generic: please use "probe_mask=0x3f" module parameter for probing all legacy ISA IDE ports
ide0: no devices on the port

ide0 at 0x1f0-0x1f7,0x3f6 on irq 14
ide1: no devices on the port
ide1 at 0x170-0x177,0x376 on irq 15
ide-gd driver 1.18
PNP: No PS/2 controller found. Probing ports directly.
i8042.c: No controller found.

mice: PS/2 mouse device common for all mice
sc520_wdt: WDT driver for SC520 initialised. timeout=30 sec (nowayout=0)
cpuidle: using governor ladder
usbcore: registered new interface driver hiddev
usbcore: registered new interface driver usbhid

usbhid: v2.6:USB HID core driver
TCP bic registered
Initializing XFRM netlink socket
NET: Registered protocol family 17
registered taskstats version 1
XENBUS: Device with no driver: device/vbd/2049
XENBUS: Device with no driver: device/console/0

Initalizing network drop monitor service
Freeing unused kernel memory: 596k freed
Red Hat nash version 5.1.19.6 starting
Mounting proc filesystem
Mounting sysfs filesystem
Creating /dev
Creating initial device nodes

Setting up hotplug.
Creating block device nodes.
Loading ehci-hcd.ko module
ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
Loading ohci-hcd.ko module
ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver

Loading uhci-hcd.ko module
uhci_hcd: USB Universal Host Controller Interface driver
Loading jbd.ko module
Loading ext3.ko module
Loading scsi_mod.ko module
SCSI subsystem initialized
Loading sd_mod.ko module

Loading libata.ko module
Loading sata_nv.ko module
Loading dm-mod.ko module
device-mapper: uevent: version 1.0.3
device-mapper: ioctl: 4.15.0-ioctl (2009-04-01) initialised: dm-devel@xxxxxxxxxx

Loading dm-log.ko module
Loading dm-region-hash.ko module
Loading dm-mirror.ko module
Loading dm-zero.ko module
Loading dm-snapshot.ko module
Waiting for driver initialization.
Scanning logical volumes

  Reading all physical volumes.  This may take a while...
Activating logical volumes
  Volume group "vg0" not found
Trying to resume from /dev/vg0/swap
Unable to access resume device (/dev/vg0/swap)

Creating root device.
Mounting root filesystem.
mount: could not find filesystem '/dev/root'
Setting up other filesystems.
Setting up new root fs
setuproot: moving /dev failed: No such file or directory

no fstab.sys, mounting internal defaults
setuproot: error mounting /proc: No such file or directory
setuproot: error mounting /sys: No such file or directory
Switching to new root and running init.
unmounting old /dev

unmounting old /proc
unmounting old /sys
switchroot: mount failed: No such file or directory
Kernel panic - not syncing: Attempted to kill init!
Pid: 1, comm: init Not tainted 2.6.32.24xen #1
Call Trace:

 [<ffffffff8104666e>] ? panic+0x86/0x13c
 [<ffffffff81143908>] ? selinux_file_free_security+0x0/0x1a
 [<ffffffff8100ed29>] ? xen_force_evtchn_callback+0x9/0xa
 [<ffffffff8100f3c2>] ? check_events+0x12/0x20

 [<ffffffff81143908>] ? selinux_file_free_security+0x0/0x1a
 [<ffffffff8100f3af>] ? xen_restore_fl_direct_end+0x0/0x1
 [<ffffffff812fba5d>] ? _write_lock_irq+0x7/0x16
 [<ffffffff8104efcc>] ? exit_ptrace+0x96/0x101

 [<ffffffff81049039>] ? do_exit+0x6a/0x63d
 [<ffffffff8104967f>] ? do_group_exit+0x73/0x9d
 [<ffffffff810496bb>] ? sys_exit_group+0x12/0x16
 [<ffffffff812fc03a>] ? error_exit+0x2a/0x60

 [<ffffffff810119c2>] ? system_call_fastpath+0x16/0x1b

My config file looks like this

[root@vm ~]# cat /etc/xen/dev
kernel = "/boot/vmlinuz-2.6.32.24xen"
ramdisk = "/boot/initrd-2.6.18domU.img"

extra = "earlyprintk=xen console=hvc0" # linuxrc=trace"
memory = 768
vcpus = 4
name = "dev"
vif = [ ]
dhcp    = "off"
netmask = "255.255.255.0"
gateway = "192.168.254.1"

ip      = "192.168.254.10"
disk = ['tap:aio:/var/lib/xen/images/vpnserver.img,xvda1,w', ]
root = "/dev/sda1 ro"

>>

>localtime=0
builder="linux"
veridian=1
serial="pty"

I checked here http://wiki.xensource.com/xenwiki/XenCommonProblems and followed the changes necessary to make 3.x DomUs 4.0 compatible, and no luck.

I've googled for these errors:

XENBUS: Device with no driver: device/vbd/2049
XENBUS: Device with no driver: device/console/0

And was overwhelmed by the amount of questions like mine but no answers, although those I found I tried with no luck. I'm guessing it's some issue with the block device not appearing on the DomU, so if you please help me I'd thank you very much.

Thanks for any input which will be greatly appreciated.

---
David Gonzalez H.
DGHVoIP - Linux Server Administration - OpenVPN - Virtualization Solutions
Phone: +1 (347) 414-8499

MSN: david@xxxxxxxxxxxxxxxx
Skype: davidgonzalezh
WEB: http://www.dghvoip.com/
Proud Linux User #294661


_______________________________________________
Xen-users mailing list
Xen-users@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-users