[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [Xen-devel] Xen 4.2.0, xl toolstack cant launch older domUs



Hi,

I dont have the kernel sources for that 2.6.16.33 any more, this is a very old domU but it still in use since we run some applications there which require old glibc and wont run on newer machines. The domU works perfectly with xend, and has always worked (since xen 3.0.0 every xen upgrade). But now when I decided to move from xend to xl the problems started. Here are the info that you asked, its going to be a long post and hopefully I remembered everything that you asked for:

config:

kernel = "/boot/vmlinuz-2.6.16.33-xen-domU-oldgame"
builder = "linux"
memory = "2048"
name = "lightning"
vcpus = "8"
cpus = [ "0", "1", "2", "3", "4", "5", "6", "7" ]
vif = [ "mac=00:16:3e:1d:0d:91, bridge=xenbr0" ]
disk = [ "phy:/dev/virtuals/lightning,xvda1,w" ]
root = "/dev/xvda1 ro"
extra = "xencons=tty1 earlyprintk=xen"
> >>
xenstore-ls -fp when started with xend and working:

/vm/54fd0bf5-0cc8-802a-880e-f5f9dc0e4ec2 = ""   (n0)
/vm/54fd0bf5-0cc8-802a-880e-f5f9dc0e4ec2/image = "(linux (kernel /boot/bzImage-domU-oldgame) (args 'root=/dev/xvda1 ro console=xvc0 earlyprintk=xen') (superpages 0) (videoram 4) (pci ()) (nomigrate 0) (tsc_mode 0) (notes (HV_START_LOW 411880652\..."  (n0)
/vm/54fd0bf5-0cc8-802a-880e-f5f9dc0e4ec2/image/ostype = "linux"   (n0)
/vm/54fd0bf5-0cc8-802a-880e-f5f9dc0e4ec2/image/kernel = "/boot/bzImage-domU-oldgame"   (n0)
/vm/54fd0bf5-0cc8-802a-880e-f5f9dc0e4ec2/image/cmdline = "root=/dev/xvda1 ro console=xvc0 earlyprintk=xen"   (n0,r11)
/vm/54fd0bf5-0cc8-802a-880e-f5f9dc0e4ec2/image/ramdisk = ""   (n0)
/vm/54fd0bf5-0cc8-802a-880e-f5f9dc0e4ec2/device = ""   (n0)
/vm/54fd0bf5-0cc8-802a-880e-f5f9dc0e4ec2/device/vbd = ""   (n0)
/vm/54fd0bf5-0cc8-802a-880e-f5f9dc0e4ec2/device/vbd/51713 = ""   (n0)
/vm/54fd0bf5-0cc8-802a-880e-f5f9dc0e4ec2/device/vbd/51713/frontend = "/local/domain/11/device/vbd/51713"   (n0)
/vm/54fd0bf5-0cc8-802a-880e-f5f9dc0e4ec2/device/vbd/51713/frontend-id = "11"   (n0)
/vm/54fd0bf5-0cc8-802a-880e-f5f9dc0e4ec2/device/vbd/51713/backend-id = "0"   (n0)
/vm/54fd0bf5-0cc8-802a-880e-f5f9dc0e4ec2/device/vbd/51713/backend = "/local/domain/0/backend/vbd/11/51713"   (n0)
/vm/54fd0bf5-0cc8-802a-880e-f5f9dc0e4ec2/device/vif = ""   (n0)
/vm/54fd0bf5-0cc8-802a-880e-f5f9dc0e4ec2/device/vif/0 = ""   (n0)
/vm/54fd0bf5-0cc8-802a-880e-f5f9dc0e4ec2/device/vif/0/frontend = "/local/domain/11/device/vif/0"   (n0)
/vm/54fd0bf5-0cc8-802a-880e-f5f9dc0e4ec2/device/vif/0/frontend-id = "11"   (n0)
/vm/54fd0bf5-0cc8-802a-880e-f5f9dc0e4ec2/device/vif/0/backend-id = "0"   (n0)
/vm/54fd0bf5-0cc8-802a-880e-f5f9dc0e4ec2/device/vif/0/backend = "/local/domain/0/backend/vif/11/0"   (n0)
/vm/54fd0bf5-0cc8-802a-880e-f5f9dc0e4ec2/device/console = ""   (n0)
/vm/54fd0bf5-0cc8-802a-880e-f5f9dc0e4ec2/device/console/0 = ""   (n0)
/vm/54fd0bf5-0cc8-802a-880e-f5f9dc0e4ec2/device/console/0/frontend = "/local/domain/11/device/console/0"   (n0)
/vm/54fd0bf5-0cc8-802a-880e-f5f9dc0e4ec2/device/console/0/frontend-id = "11"   (n0)
/vm/54fd0bf5-0cc8-802a-880e-f5f9dc0e4ec2/device/console/0/backend-id = "0"   (n0)
/vm/54fd0bf5-0cc8-802a-880e-f5f9dc0e4ec2/device/console/0/backend = "/local/domain/0/backend/console/11/0"   (n0)
/vm/54fd0bf5-0cc8-802a-880e-f5f9dc0e4ec2/ (n0)
/vm/54fd0bf5-0cc8-802a-880e-f5f9dc0e4ec2/pool_name = "Pool-0"   (n0)
/vm/54fd0bf5-0cc8-802a-880e-f5f9dc0e4ec2/shadow_memory = "0"   (n0)
/vm/54fd0bf5-0cc8-802a-880e-f5f9dc0e4ec2/uuid = "54fd0bf5-0cc8-802a-880e-f5f9dc0e4ec2"   (n0,r11)
/vm/54fd0bf5-0cc8-802a-880e-f5f9dc0e4ec2/ (n0)
/vm/54fd0bf5-0cc8-802a-880e-f5f9dc0e4ec2/start_time = "1349262041.78"   (n0)
/vm/54fd0bf5-0cc8-802a-880e-f5f9dc0e4ec2/ (n0)
/vm/54fd0bf5-0cc8-802a-880e-f5f9dc0e4ec2/bootloader_args = ""   (n0)
/vm/54fd0bf5-0cc8-802a-880e-f5f9dc0e4ec2/ (n0)
/vm/54fd0bf5-0cc8-802a-880e-f5f9dc0e4ec2/ (n0)
/vm/54fd0bf5-0cc8-802a-880e-f5f9dc0e4ec2/xend = ""   (n0)
/vm/54fd0bf5-0cc8-802a-880e-f5f9dc0e4ec2/xend/restart_count = "0"   (n0)
/vm/54fd0bf5-0cc8-802a-880e-f5f9dc0e4ec2/vcpus = "1"   (n0)
/vm/54fd0bf5-0cc8-802a-880e-f5f9dc0e4ec2/vcpu_avail = "1"   (n0)
/vm/54fd0bf5-0cc8-802a-880e-f5f9dc0e4ec2/bootloader = ""   (n0)
/vm/54fd0bf5-0cc8-802a-880e-f5f9dc0e4ec2/name = "lightning"   (n0)

xenstore-ls -fp when started with xl and crashed (preserved):

/vm = ""   (n0)
/vm/e2261517-a75b-4c02-b9db-da9c21a05130 = ""   (n0,r1)
/vm/e2261517-a75b-4c02-b9db-da9c21a05130/uuid = "e2261517-a75b-4c02-b9db-da9c21a05130"   (n0,r1)
/vm/e2261517-a75b-4c02-b9db-da9c21a05130/name = "lightning"   (n0,r1)
/vm/e2261517-a75b-4c02-b9db-da9c21a05130/image = ""   (n0,r1)
/vm/e2261517-a75b-4c02-b9db-da9c21a05130/image/ostype = "linux"   (n0,r1)
/vm/e2261517-a75b-4c02-b9db-da9c21a05130/image/kernel = "/boot/bzImage-domU-oldgame"   (n0,r1)
/vm/e2261517-a75b-4c02-b9db-da9c21a05130/image/cmdline = "root=/dev/xvda1 ro console=xvc0 earlyprintk=xen"   (n0,r1)
/vm/e2261517-a75b-4c02-b9db-da9c21a05130/start_time = "1349262365.43"   (n0,r1)
/libxl = ""   (n0)
/libxl/1 = ""   (n0)
/libxl/1/dm-version = "qemu_xen"   (n0)

domU starter with xl -vvv create:

root@xen-2:~# xl -vvv create /etc/xen/lightning.cfg -c
Parsing config from /etc/xen/lightning.cfg
libxl: debug: libxl_create.c:1173:do_domain_create: ao 0x6243d0: create: how=(nil) callback=(nil) poller=0x623b80
libxl: debug: libxl_device.c:229:libxl__device_disk_set_backend: Disk vdev=xvda1 spec.backend=unknown
libxl: debug: libxl_device.c:265:libxl__device_disk_set_backend: Disk vdev=xvda1, using backend phy
libxl: debug: libxl_create.c:677:initiate_domain_create: running bootloader
libxl: debug: libxl_bootloader.c:327:libxl__bootloader_run: no bootloader configured, using user supplied kernel
libxl: debug: libxl_event.c:561:libxl__ev_xswatch_deregister: watch w=0x624750: deregister unregistered
libxl: debug: libxl_numa.c:435:libxl__get_numa_candidate: New best NUMA placement candidate found: nr_nodes=1, nr_cpus=8, nr_vcpus=9, free_memkb=31043
libxl: detail: libxl_dom.c:192:numa_place_domain: NUMA placement candidate with 1 nodes, 8 cpus and 31043 KB free selected
domainbuilder: detail: xc_dom_allocate: cmdline="root=/dev/xvda1 ro console=xvc0 earlyprintk=xen", features="(null)"
libxl: debug: libxl_dom.c:380:libxl__build_pv: pv kernel mapped 0 path /boot/bzImage-domU-oldgame

domainbuilder: detail: xc_dom_kernel_file: filename="/boot/bzImage-domU-oldgame"
domainbuilder: detail: xc_dom_malloc_filemap    : 1237 kB
domainbuilder: detail: xc_dom_malloc            : 2653 kB
domainbuilder: detail: xc_dom_do_gunzip: unzip ok, 0x135462 -> 0x297540
domainbuilder: detail: xc_dom_boot_xen_init: ver 4.2, caps xen-3.0-x86_64 xen-3.0-x86_32p hvm-3.0-x86_32 hvm-3.0-x86_32p hvm-3.0-x86_64
domainbuilder: detail: xc_dom_parse_image: called
domainbuilder: detail: xc_dom_find_loader: trying multiboot-binary loader ...
domainbuilder: detail: loader probe failed
domainbuilder: detail: xc_dom_find_loader: trying Linux bzImage loader ...
domainbuilder: detail: xc_dom_probe_bzimage_kernel: kernel is not a bzImage
domainbuilder: detail: loader probe failed
domainbuilder: detail: xc_dom_find_loader: trying ELF-generic loader ...
domainbuilder: detail: loader probe OK
xc: detail: elf_parse_binary: phdr: paddr=0xc0100000 memsz=0x20d500
xc: detail: elf_parse_binary: phdr: paddr=0xc030d500 memsz=0xb3308
xc: detail: elf_parse_binary: memory: 0xc0100000 -> 0xc03c0808
xc: detail: elf_xen_parse_note: GUEST_OS = "linux"
xc: detail: elf_xen_parse_note: GUEST_VERSION = "2.6"
xc: detail: elf_xen_parse_note: XEN_VERSION = "xen-3.0"
xc: detail: elf_xen_parse_note: VIRT_BASE = 0xc0000000
xc: detail: elf_xen_parse_note: PADDR_OFFSET = 0xc0000000
xc: detail: elf_xen_parse_note: ENTRY = 0xc0100000
xc: detail: elf_xen_parse_note: HYPERCALL_PAGE = 0xc0101000
xc: detail: elf_xen_parse_note: HV_START_LOW = 0xf5800000
xc: detail: elf_xen_parse_note: FEATURES = "writable_page_tables|writable_descriptor_tables|auto_translated_physmap|pae_pgdir_above_4gb|supervisor_mode_kernel"
xc: detail: elf_xen_parse_note: PAE_MODE = "yes"
xc: detail: elf_xen_parse_note: LOADER = "generic"
xc: detail: elf_xen_parse: using notes from SHT_NOTE section
xc: detail: elf_xen_addr_calc_check: addresses:
xc: detail:     virt_base        = 0xc0000000
xc: detail:     elf_paddr_offset = 0xc0000000
xc: detail:     virt_offset      = 0x0
xc: detail:     virt_kstart      = 0xc0100000
xc: detail:     virt_kend        = 0xc03c0808
xc: detail:     virt_entry       = 0xc0100000
xc: detail:     p2m_base         = 0xffffffffffffffff
domainbuilder: detail: xc_dom_parse_elf_kernel: xen-3.0-x86_32p: 0xc0100000 -> 0xc03c0808
domainbuilder: detail: xc_dom_mem_init: mem 2048 MB, pages 0x80000 pages, 4k each
domainbuilder: detail: xc_dom_mem_init: 0x80000 pages
domainbuilder: detail: xc_dom_boot_mem_init: called
domainbuilder: detail: x86_compat: guest xen-3.0-x86_32p, address size 32
domainbuilder: detail: xc_dom_malloc            : 4096 kB
domainbuilder: detail: xc_dom_build_image: called
domainbuilder: detail: xc_dom_alloc_segment:   kernel       : 0xc0100000 -> 0xc03c1000  (pfn 0x100 + 0x2c1 pages)
domainbuilder: detail: xc_dom_pfn_to_ptr: domU mapping: pfn 0x100+0x2c1 at 0x7fcba1b83000
xc: detail: elf_load_binary: phdr 0 at 0x0x7fcba1b83000 -> 0x0x7fcba1d90500
xc: detail: elf_load_binary: phdr 1 at 0x0x7fcba1d90500 -> 0x0x7fcba1e0f93c
domainbuilder: detail: xc_dom_alloc_segment:   phys2mach    : 0xc03c1000 -> 0xc05c1000  (pfn 0x3c1 + 0x200 pages)
domainbuilder: detail: xc_dom_pfn_to_ptr: domU mapping: pfn 0x3c1+0x200 at 0x7fcba1983000
domainbuilder: detail: xc_dom_alloc_page   :   start info   : 0xc05c1000 (pfn 0x5c1)
domainbuilder: detail: xc_dom_alloc_page   :   xenstore     : 0xc05c2000 (pfn 0x5c2)
domainbuilder: detail: xc_dom_alloc_page   :   console      : 0xc05c3000 (pfn 0x5c3)
domainbuilder: detail: nr_page_tables: 0x00000000ffffffff/32: 0x0000000000000000 -> 0x00000000ffffffff, 1 table(s)
domainbuilder: detail: nr_page_tables: 0x000000003fffffff/30: 0x00000000c0000000 -> 0x00000000ffffffff, 1 table(s)
domainbuilder: detail: nr_page_tables: 0x00000000001fffff/21: 0x00000000c0000000 -> 0x00000000c07fffff, 4 table(s)
domainbuilder: detail: xc_dom_alloc_segment:   page tables  : 0xc05c4000 -> 0xc05ca000  (pfn 0x5c4 + 0x6 pages)
domainbuilder: detail: xc_dom_pfn_to_ptr: domU mapping: pfn 0x5c4+0x6 at 0x7fcba197d000
domainbuilder: detail: xc_dom_alloc_page   :   boot stack   : 0xc05ca000 (pfn 0x5ca)
domainbuilder: detail: xc_dom_build_image  : virt_alloc_end : 0xc05cb000
domainbuilder: detail: xc_dom_build_image  : virt_pgtab_end : 0xc0800000
domainbuilder: detail: xc_dom_boot_image: called
domainbuilder: detail: arch_setup_bootearly: doing nothing
domainbuilder: detail: xc_dom_compat_check: supported guest type: xen-3.0-x86_64
domainbuilder: detail: xc_dom_compat_check: supported guest type: xen-3.0-x86_32p <= matches
domainbuilder: detail: xc_dom_compat_check: supported guest type: hvm-3.0-x86_32
domainbuilder: detail: xc_dom_compat_check: supported guest type: hvm-3.0-x86_32p
domainbuilder: detail: xc_dom_compat_check: supported guest type: hvm-3.0-x86_64
domainbuilder: detail: xc_dom_update_guest_p2m: dst 32bit, pages 0x80000
domainbuilder: detail: clear_page: pfn 0x5c3, mfn 0x649f86
domainbuilder: detail: clear_page: pfn 0x5c2, mfn 0x649f87
domainbuilder: detail: xc_dom_pfn_to_ptr: domU mapping: pfn 0x5c1+0x1 at 0x7fcba4599000
domainbuilder: detail: start_info_x86_32: called
domainbuilder: detail: setup_hypercall_page: vaddr=0xc0101000 pfn=0x101
domainbuilder: detail: domain builder memory footprint
domainbuilder: detail:    allocated
domainbuilder: detail:       malloc             : 6780 kB
domainbuilder: detail:       anon mmap          : 0 bytes
domainbuilder: detail:    mapped
domainbuilder: detail:       file mmap          : 1237 kB
domainbuilder: detail:       domU mmap          : 4896 kB
domainbuilder: detail: arch_setup_bootlate: shared_info: pfn 0x0, mfn 0xdbdf8
domainbuilder: detail: shared_info_x86_32: called
domainbuilder: detail: vcpu_x86_32: called
domainbuilder: detail: vcpu_x86_32: cr3: pfn 0x5c4 mfn 0x649f85
domainbuilder: detail: launch_vm: called, ctxt=0x7fff96435b40
domainbuilder: detail: xc_dom_release: called
libxl: debug: libxl_device.c:229:libxl__device_disk_set_backend: Disk vdev=xvda1 spec.backend=phy
libxl: debug: libxl_event.c:512:libxl__ev_xswatch_register: watch w=0x625598 wpath=/local/domain/0/backend/vbd/2/51713/state token=3/0: register slotnum=3
libxl: debug: libxl_create.c:1186:do_domain_create: ao 0x6243d0: inprogress: poller=0x623b80, flags=i
libxl: debug: libxl_event.c:457:watchfd_callback: watch w=0x625598 wpath=/local/domain/0/backend/vbd/2/51713/state token=3/0: event epath=/local/domain/0/backend/vbd/2/51713/state
libxl: debug: libxl_event.c:596:devstate_watch_callback: backend /local/domain/0/backend/vbd/2/51713/state wanted state 2 ok
libxl: debug: libxl_event.c:549:libxl__ev_xswatch_deregister: watch w=0x625598 wpath=/local/domain/0/backend/vbd/2/51713/state token=3/0: deregister slotnum=3
libxl: debug: libxl_event.c:561:libxl__ev_xswatch_deregister: watch w=0x625598: deregister unregistered
libxl: debug: libxl_device.c:916:device_hotplug: calling hotplug script: /etc/xen/scripts/block add
libxl: debug: libxl_event.c:426:watchfd_callback: watch epath=/local/domain/0/backend/vbd/2/51713/state token=3/0: empty slot
libxl: debug: libxl_event.c:512:libxl__ev_xswatch_register: watch w=0x626f38 wpath=/local/domain/0/backend/vif/2/0/state token=3/1: register slotnum=3
libxl: debug: libxl_event.c:457:watchfd_callback: watch w=0x626f38 wpath=/local/domain/0/backend/vif/2/0/state token=3/1: event epath=/local/domain/0/backend/vif/2/0/state
libxl: debug: libxl_event.c:596:devstate_watch_callback: backend /local/domain/0/backend/vif/2/0/state wanted state 2 ok
libxl: debug: libxl_event.c:549:libxl__ev_xswatch_deregister: watch w=0x626f38 wpath=/local/domain/0/backend/vif/2/0/state token=3/1: deregister slotnum=3
libxl: debug: libxl_event.c:561:libxl__ev_xswatch_deregister: watch w=0x626f38: deregister unregistered
libxl: debug: libxl_device.c:916:device_hotplug: calling hotplug script: /etc/xen/scripts/vif-bridge online
libxl: debug: libxl_event.c:1677:libxl__ao_progress_report: ao 0x6243d0: progress report: callback queued aop=0x627700
libxl: debug: libxl_event.c:1497:libxl__ao_complete: ao 0x6243d0: complete, rc=0
libxl: debug: libxl_event.c:1090:egc_run_callbacks: ao 0x6243d0: progress report: callback aop=0x627700
libxl: debug: libxl_event.c:1469:libxl__ao__destroy: ao 0x6243d0: destroy
Daemon running with PID 4881
Linux version 2.6.16.33-xen-domU-oldgame (root@lightning) (gcc version 4.1.2 20061115 (prerelease) (Debian 4.1.1-21)) #1 SMP Fri Sep 28 14:56:14 EEST 2012
BIOS-provided physical RAM map:
 Xen: 0000000000000000 - 0000000080000000 (usable)
1320MB HIGHMEM available.
727MB LOWMEM available.
NX (Execute Disable) protection: active
early console enabled
Built 1 zonelists
Kernel command line: root=/dev/xvda1 ro console=xvc0 earlyprintk=xen
Enabling fast FPU save and restore... done.
Enabling unmasked SIMD FPU exception support... done.
Initializing CPU#0
PID hash table entries: 4096 (order: 12, 65536 bytes)
Xen reported: 3392.372 MHz processor.
disabling early console
Console: colour dummy device 80x25
Dentry cache hash table entries: 131072 (order: 7, 524288 bytes)
Inode-cache hash table entries: 65536 (order: 6, 262144 bytes)
Software IO TLB disabled
vmalloc area: ee000000-f51fe000, maxmem 2d7fe000
Memory: 2072132k/2097152k available (1917k kernel code, 23952k reserved, 537k data, 148k init, 1351688k highmem)
Checking if this processor honours the WP bit even in supervisor mode... Ok.
Calibrating delay using timer specific routine.. 6820.46 BogoMIPS (lpj=3410231)
Mount-cache hash table entries: 512
CPU: L1 I cache: 32K, L1 D cache: 32K
CPU: L2 cache: 256K
CPU: L3 cache: 8192K
Checking 'hlt' instruction... OK.
Brought up 1 CPUs
migration_cost=0
Grant table initialized
NET: Registered protocol family 16
xen_mem: Initialising balloon driver.
SCSI subsystem initialized
highmem bounce pool size: 64 pages
Installing knfsd (copyright (C) 1996 okir@xxxxxxxxxxxx).
Initializing Cryptographic API
io scheduler noop registered
io scheduler cfq registered (default)
rtc: IRQ 8 is not free.
i8042.c: No controller found.
loop: loaded (max 8 devices)
Xen virtual console successfully installed as tty1
Event-channel device installed.
netfront: Initialising virtual ethernet driver.
mice: PS/2 mouse device common for all mice
Netfilter messages via NETLINK v0.30.
NET: Registered protocol family 2
netfront: device eth0 has copying receive path.
Registering block device major 202
blkfront: xvda1: barriers enabled
IP route cache hash table entries: 32768 (order: 5, 131072 bytes)
TCP established hash table entries: 131072 (order: 8, 1048576 bytes)
TCP bind hash table entries: 65536 (order: 7, 524288 bytes)
TCP: Hash tables configured (established 131072 bind 65536)
TCP reno registered
ip_conntrack version 2.4 (8192 buckets, 65536 max) - 232 bytes per conntrack
ip_conntrack_pptp version 3.1 loaded
ip_nat_pptp version 3.0 loaded
ip_tables: (C) 2000-2006 Netfilter Core Team
ipt_recent v0.3.1: Stephen Frost <sfrost@xxxxxxxxxxx>.  http://snowman.net/projects/ipt_recent/
TCP bic registered
NET: Registered protocol family 1
NET: Registered protocol family 17
NET: Registered protocol family 15
Bridge firewalling registered
802.1Q VLAN Support v1.8 Ben Greear <greearb@xxxxxxxxxxxxxxx>
All bugs added by David S. Miller <davem@xxxxxxxxxx>
Using IPI Shortcut mode
end_request: I/O error, dev xvda1, sector 2
EXT3-fs: unable to read superblock
Unable to handle kernel NULL pointer dereference at virtual address 00000024
 printing eip:
c0232139
005c4000 -> *pde = 00000000:00000000
Oops: 0000 [#1]
SMP
CPU:    0
EIP:    0061:[<c0232139>]    Not tainted VLI
EFLAGS: 00010097   (2.6.16.33-xen-domU-oldgame #1)
EIP is at blkif_int+0x1dc/0x228
eax: 00000000   ebx: 00000001   ecx: c090e000   edx: 00000000
esi: d92d7c7c   edi: ca010100   ebp: ed6ea0ac   esp: c0367ec0
ds: 007b   es: 007b   ss: e021
Process swapper (pid: 0, threadinfo=c0366000 task=c030d7c0)
Stack: <0>c200ce24 109c6373 00000000 00000000 00000001 00000002 00000000 00000001
       ed6ab7a0 00000000 00000000 c0367f6c c0133197 00000105 c090e000 c0367f6c
       00000105 00008280 c035b680 00000105 ed6ab7a0 c013328f 00000105 0000000a
Call Trace:
 [<c0133197>] handle_IRQ_event+0x38/0xa9
 [<c013328f>] __do_IRQ+0x87/0xf8
 [<c0106782>] do_IRQ+0x1a/0x25
 [<c0228d85>] evtchn_do_upcall+0x95/0xa9
 [<c010504d>] hypervisor_callback+0x3d/0x48
 [<c0107ecf>] safe_halt+0x7a/0xb2
 [<c0102efd>] xen_idle+0x2b/0x4e
 [<c0103014>] cpu_idle+0x52/0x67
 [<c036871c>] start_kernel+0x2b8/0x33c
 [<c03681ea>] unknown_bootoption+0x0/0x27a
Code: c7 04 24 e0 17 30 c0 e8 39 8b ee ff 8b 44 24 38 c7 80 00 14 00 00 00 00 00 00 89 04 24 e8 75 03 00 00 bb a1 ff ff ff 8b 54 24 0c <8b> 42 24 89 44 24 08 89 5c 24 04 89 14 24 e8 3b eb fb ff 85 c0
 <0>Kernel panic - not syncing: Fatal exception in interrupt

And finally the domain-builder-ng.log when started with xend and working:

2012-10-03 14:00:41 EEST [3773] domainbuilder: detail: xc_dom_allocate: cmdline="root=/dev/xvda1 ro console=xvc0 earlyprintk=xen", features=""
2012-10-03 14:00:41 EEST [3773] domainbuilder: detail: xc_dom_kernel_file: filename="/boot/bzImage-domU-oldgame"
2012-10-03 14:00:41 EEST [3773] domainbuilder: detail: xc_dom_malloc_filemap    : 1237 kB
2012-10-03 14:00:41 EEST [3773] domainbuilder: detail: xc_dom_malloc            : 2653 kB
2012-10-03 14:00:41 EEST [3773] domainbuilder: detail: xc_dom_do_gunzip: unzip ok, 0x135462 -> 0x297540
2012-10-03 14:00:41 EEST [3773] domainbuilder: detail: xc_dom_parse_image: called
2012-10-03 14:00:41 EEST [3773] domainbuilder: detail: xc_dom_find_loader: trying multiboot-binary loader ...
2012-10-03 14:00:41 EEST [3773] domainbuilder: detail: loader probe failed
2012-10-03 14:00:41 EEST [3773] domainbuilder: detail: xc_dom_find_loader: trying Linux bzImage loader ...
2012-10-03 14:00:41 EEST [3773] domainbuilder: detail: xc_dom_probe_bzimage_kernel: kernel is not a bzImage
2012-10-03 14:00:41 EEST [3773] domainbuilder: detail: loader probe failed
2012-10-03 14:00:41 EEST [3773] domainbuilder: detail: xc_dom_find_loader: trying ELF-generic loader ...
2012-10-03 14:00:41 EEST [3773] domainbuilder: detail: loader probe OK
2012-10-03 14:00:41 EEST [3773] xc: detail: elf_parse_binary: phdr: paddr=0xc0100000 memsz=0x20d500
2012-10-03 14:00:41 EEST [3773] xc: detail: elf_parse_binary: phdr: paddr=0xc030d500 memsz=0xb3308
2012-10-03 14:00:41 EEST [3773] xc: detail: elf_parse_binary: memory: 0xc0100000 -> 0xc03c0808
2012-10-03 14:00:41 EEST [3773] xc: detail: elf_xen_parse_note: GUEST_OS = "linux"
2012-10-03 14:00:41 EEST [3773] xc: detail: elf_xen_parse_note: GUEST_VERSION = "2.6"
2012-10-03 14:00:41 EEST [3773] xc: detail: elf_xen_parse_note: XEN_VERSION = "xen-3.0"
2012-10-03 14:00:41 EEST [3773] xc: detail: elf_xen_parse_note: VIRT_BASE = 0xc0000000
2012-10-03 14:00:41 EEST [3773] xc: detail: elf_xen_parse_note: PADDR_OFFSET = 0xc0000000
2012-10-03 14:00:41 EEST [3773] xc: detail: elf_xen_parse_note: ENTRY = 0xc0100000
2012-10-03 14:00:41 EEST [3773] xc: detail: elf_xen_parse_note: HYPERCALL_PAGE = 0xc0101000
2012-10-03 14:00:41 EEST [3773] xc: detail: elf_xen_parse_note: HV_START_LOW = 0xf5800000
2012-10-03 14:00:41 EEST [3773] xc: detail: elf_xen_parse_note: FEATURES = "writable_page_tables|writable_descriptor_tables|auto_translated_physmap|pae_pgdir_above_4gb|supervisor_mode_kernel"
2012-10-03 14:00:41 EEST [3773] xc: detail: elf_xen_parse_note: PAE_MODE = "yes"
2012-10-03 14:00:41 EEST [3773] xc: detail: elf_xen_parse_note: LOADER = "generic"
2012-10-03 14:00:41 EEST [3773] xc: detail: elf_xen_parse: using notes from SHT_NOTE section
2012-10-03 14:00:41 EEST [3773] xc: detail: elf_xen_addr_calc_check: addresses:
2012-10-03 14:00:41 EEST [3773] xc: detail:     virt_base        = 0xc0000000
2012-10-03 14:00:41 EEST [3773] xc: detail:     elf_paddr_offset = 0xc0000000
2012-10-03 14:00:41 EEST [3773] xc: detail:     virt_offset      = 0x0
2012-10-03 14:00:41 EEST [3773] xc: detail:     virt_kstart      = 0xc0100000
2012-10-03 14:00:41 EEST [3773] xc: detail:     virt_kend        = 0xc03c0808
2012-10-03 14:00:41 EEST [3773] xc: detail:     virt_entry       = 0xc0100000
2012-10-03 14:00:41 EEST [3773] xc: detail:     p2m_base         = 0xffffffffffffffff
2012-10-03 14:00:41 EEST [3773] domainbuilder: detail: xc_dom_parse_elf_kernel: xen-3.0-x86_32p: 0xc0100000 -> 0xc03c0808
2012-10-03 14:00:41 EEST [3773] domainbuilder: detail: xc_dom_release: called
2012-10-03 14:00:41 EEST [3773] domainbuilder: detail: xc_dom_allocate: cmdline="root=/dev/xvda1 ro console=xvc0 earlyprintk=xen", features=""
2012-10-03 14:00:41 EEST [3773] domainbuilder: detail: xc_dom_kernel_file: filename="/boot/bzImage-domU-oldgame"
2012-10-03 14:00:41 EEST [3773] domainbuilder: detail: xc_dom_malloc_filemap    : 1237 kB
2012-10-03 14:00:41 EEST [3773] domainbuilder: detail: xc_dom_malloc            : 2653 kB
2012-10-03 14:00:41 EEST [3773] domainbuilder: detail: xc_dom_do_gunzip: unzip ok, 0x135462 -> 0x297540
2012-10-03 14:00:41 EEST [3773] domainbuilder: detail: xc_dom_boot_xen_init: ver 4.2, caps xen-3.0-x86_64 xen-3.0-x86_32p hvm-3.0-x86_32 hvm-3.0-x86_32p hvm-3.0-x86_64
2012-10-03 14:00:41 EEST [3773] domainbuilder: detail: xc_dom_parse_image: called
2012-10-03 14:00:41 EEST [3773] domainbuilder: detail: xc_dom_find_loader: trying multiboot-binary loader ...
2012-10-03 14:00:41 EEST [3773] domainbuilder: detail: loader probe failed
2012-10-03 14:00:41 EEST [3773] domainbuilder: detail: xc_dom_find_loader: trying Linux bzImage loader ...
2012-10-03 14:00:41 EEST [3773] domainbuilder: detail: xc_dom_probe_bzimage_kernel: kernel is not a bzImage
2012-10-03 14:00:41 EEST [3773] domainbuilder: detail: loader probe failed
2012-10-03 14:00:41 EEST [3773] domainbuilder: detail: xc_dom_find_loader: trying ELF-generic loader ...
2012-10-03 14:00:41 EEST [3773] domainbuilder: detail: loader probe OK
2012-10-03 14:00:41 EEST [3773] xc: detail: elf_parse_binary: phdr: paddr=0xc0100000 memsz=0x20d500
2012-10-03 14:00:41 EEST [3773] xc: detail: elf_parse_binary: phdr: paddr=0xc030d500 memsz=0xb3308
2012-10-03 14:00:41 EEST [3773] xc: detail: elf_parse_binary: memory: 0xc0100000 -> 0xc03c0808
2012-10-03 14:00:41 EEST [3773] xc: detail: elf_xen_parse_note: GUEST_OS = "linux"
2012-10-03 14:00:41 EEST [3773] xc: detail: elf_xen_parse_note: GUEST_VERSION = "2.6"
2012-10-03 14:00:41 EEST [3773] xc: detail: elf_xen_parse_note: XEN_VERSION = "xen-3.0"
2012-10-03 14:00:41 EEST [3773] xc: detail: elf_xen_parse_note: VIRT_BASE = 0xc0000000
2012-10-03 14:00:41 EEST [3773] xc: detail: elf_xen_parse_note: PADDR_OFFSET = 0xc0000000
2012-10-03 14:00:41 EEST [3773] xc: detail: elf_xen_parse_note: ENTRY = 0xc0100000
2012-10-03 14:00:41 EEST [3773] xc: detail: elf_xen_parse_note: HYPERCALL_PAGE = 0xc0101000
2012-10-03 14:00:41 EEST [3773] xc: detail: elf_xen_parse_note: HV_START_LOW = 0xf5800000
2012-10-03 14:00:41 EEST [3773] xc: detail: elf_xen_parse_note: FEATURES = "writable_page_tables|writable_descriptor_tables|auto_translated_physmap|pae_pgdir_above_4gb|supervisor_mode_kernel"
2012-10-03 14:00:41 EEST [3773] xc: detail: elf_xen_parse_note: PAE_MODE = "yes"
2012-10-03 14:00:41 EEST [3773] xc: detail: elf_xen_parse_note: LOADER = "generic"
2012-10-03 14:00:41 EEST [3773] xc: detail: elf_xen_parse: using notes from SHT_NOTE section
2012-10-03 14:00:41 EEST [3773] xc: detail: elf_xen_addr_calc_check: addresses:
2012-10-03 14:00:41 EEST [3773] xc: detail:     virt_base        = 0xc0000000
2012-10-03 14:00:41 EEST [3773] xc: detail:     elf_paddr_offset = 0xc0000000
2012-10-03 14:00:41 EEST [3773] xc: detail:     virt_offset      = 0x0
2012-10-03 14:00:41 EEST [3773] xc: detail:     virt_kstart      = 0xc0100000
2012-10-03 14:00:41 EEST [3773] xc: detail:     virt_kend        = 0xc03c0808
2012-10-03 14:00:41 EEST [3773] xc: detail:     virt_entry       = 0xc0100000
2012-10-03 14:00:41 EEST [3773] xc: detail:     p2m_base         = 0xffffffffffffffff
2012-10-03 14:00:41 EEST [3773] domainbuilder: detail: xc_dom_parse_elf_kernel: xen-3.0-x86_32p: 0xc0100000 -> 0xc03c0808
2012-10-03 14:00:41 EEST [3773] domainbuilder: detail: xc_dom_mem_init: mem 2048 MB, pages 0x80000 pages, 4k each
2012-10-03 14:00:41 EEST [3773] domainbuilder: detail: xc_dom_mem_init: 0x80000 pages
2012-10-03 14:00:41 EEST [3773] domainbuilder: detail: xc_dom_boot_mem_init: called
2012-10-03 14:00:41 EEST [3773] domainbuilder: detail: x86_compat: guest xen-3.0-x86_32p, address size 32
2012-10-03 14:00:41 EEST [3773] domainbuilder: detail: xc_dom_malloc            : 4096 kB
2012-10-03 14:00:41 EEST [3773] domainbuilder: detail: xc_dom_build_image: called
2012-10-03 14:00:41 EEST [3773] domainbuilder: detail: xc_dom_alloc_segment:   kernel       : 0xc0100000 -> 0xc03c1000  (pfn 0x100 + 0x2c1 pages)
2012-10-03 14:00:41 EEST [3773] domainbuilder: detail: xc_dom_pfn_to_ptr: domU mapping: pfn 0x100+0x2c1 at 0x7fdebe53c000
2012-10-03 14:00:41 EEST [3773] xc: detail: elf_load_binary: phdr 0 at 0x0x7fdebe53c000 -> 0x0x7fdebe749500
2012-10-03 14:00:41 EEST [3773] xc: detail: elf_load_binary: phdr 1 at 0x0x7fdebe749500 -> 0x0x7fdebe7c893c
2012-10-03 14:00:41 EEST [3773] domainbuilder: detail: xc_dom_alloc_segment:   phys2mach    : 0xc03c1000 -> 0xc05c1000  (pfn 0x3c1 + 0x200 pages)
2012-10-03 14:00:41 EEST [3773] domainbuilder: detail: xc_dom_pfn_to_ptr: domU mapping: pfn 0x3c1+0x200 at 0x7fdebe33c000
2012-10-03 14:00:41 EEST [3773] domainbuilder: detail: xc_dom_alloc_page   :   start info   : 0xc05c1000 (pfn 0x5c1)
2012-10-03 14:00:41 EEST [3773] domainbuilder: detail: xc_dom_alloc_page   :   xenstore     : 0xc05c2000 (pfn 0x5c2)
2012-10-03 14:00:41 EEST [3773] domainbuilder: detail: xc_dom_alloc_page   :   console      : 0xc05c3000 (pfn 0x5c3)
2012-10-03 14:00:41 EEST [3773] domainbuilder: detail: nr_page_tables: 0x00000000ffffffff/32: 0x0000000000000000 -> 0x00000000ffffffff, 1 table(s)
2012-10-03 14:00:41 EEST [3773] domainbuilder: detail: nr_page_tables: 0x000000003fffffff/30: 0x00000000c0000000 -> 0x00000000ffffffff, 1 table(s)
2012-10-03 14:00:41 EEST [3773] domainbuilder: detail: nr_page_tables: 0x00000000001fffff/21: 0x00000000c0000000 -> 0x00000000c07fffff, 4 table(s)
2012-10-03 14:00:41 EEST [3773] domainbuilder: detail: xc_dom_alloc_segment:   page tables  : 0xc05c4000 -> 0xc05ca000  (pfn 0x5c4 + 0x6 pages)
2012-10-03 14:00:41 EEST [3773] domainbuilder: detail: xc_dom_pfn_to_ptr: domU mapping: pfn 0x5c4+0x6 at 0x7fdeca12d000
2012-10-03 14:00:41 EEST [3773] domainbuilder: detail: xc_dom_alloc_page   :   boot stack   : 0xc05ca000 (pfn 0x5ca)
2012-10-03 14:00:41 EEST [3773] domainbuilder: detail: xc_dom_build_image  : virt_alloc_end : 0xc05cb000
2012-10-03 14:00:41 EEST [3773] domainbuilder: detail: xc_dom_build_image  : virt_pgtab_end : 0xc0800000
2012-10-03 14:00:41 EEST [3773] domainbuilder: detail: xc_dom_boot_image: called
2012-10-03 14:00:41 EEST [3773] domainbuilder: detail: arch_setup_bootearly: doing nothing
2012-10-03 14:00:41 EEST [3773] domainbuilder: detail: xc_dom_compat_check: supported guest type: xen-3.0-x86_64
2012-10-03 14:00:41 EEST [3773] domainbuilder: detail: xc_dom_compat_check: supported guest type: xen-3.0-x86_32p <= matches
2012-10-03 14:00:41 EEST [3773] domainbuilder: detail: xc_dom_compat_check: supported guest type: hvm-3.0-x86_32
2012-10-03 14:00:41 EEST [3773] domainbuilder: detail: xc_dom_compat_check: supported guest type: hvm-3.0-x86_32p
2012-10-03 14:00:41 EEST [3773] domainbuilder: detail: xc_dom_compat_check: supported guest type: hvm-3.0-x86_64
2012-10-03 14:00:41 EEST [3773] domainbuilder: detail: xc_dom_update_guest_p2m: dst 32bit, pages 0x80000
2012-10-03 14:00:41 EEST [3773] domainbuilder: detail: clear_page: pfn 0x5c3, mfn 0x697ee5
2012-10-03 14:00:41 EEST [3773] domainbuilder: detail: clear_page: pfn 0x5c2, mfn 0x697ee6
2012-10-03 14:00:41 EEST [3773] domainbuilder: detail: xc_dom_pfn_to_ptr: domU mapping: pfn 0x5c1+0x1 at 0x7fdeca12a000
2012-10-03 14:00:41 EEST [3773] domainbuilder: detail: start_info_x86_32: called
2012-10-03 14:00:41 EEST [3773] domainbuilder: detail: setup_hypercall_page: vaddr=0xc0101000 pfn=0x101
2012-10-03 14:00:41 EEST [3773] domainbuilder: detail: domain builder memory footprint
2012-10-03 14:00:41 EEST [3773] domainbuilder: detail:    allocated
2012-10-03 14:00:41 EEST [3773] domainbuilder: detail:       malloc             : 6780 kB
2012-10-03 14:00:41 EEST [3773] domainbuilder: detail:       anon mmap          : 0 bytes
2012-10-03 14:00:41 EEST [3773] domainbuilder: detail:    mapped
2012-10-03 14:00:41 EEST [3773] domainbuilder: detail:       file mmap          : 1237 kB
2012-10-03 14:00:41 EEST [3773] domainbuilder: detail:       domU mmap          : 4896 kB
2012-10-03 14:00:41 EEST [3773] domainbuilder: detail: arch_setup_bootlate: shared_info: pfn 0x0, mfn 0xdbdf8
2012-10-03 14:00:41 EEST [3773] domainbuilder: detail: shared_info_x86_32: called
2012-10-03 14:00:41 EEST [3773] domainbuilder: detail: vcpu_x86_32: called
2012-10-03 14:00:41 EEST [3773] domainbuilder: detail: vcpu_x86_32: cr3: pfn 0x5c4 mfn 0x697ee4
2012-10-03 14:00:41 EEST [3773] domainbuilder: detail: launch_vm: called, ctxt=0x7fdebf7fa650
2012-10-03 14:00:41 EEST [3773] domainbuilder: detail: xc_dom_release: called

- Valtteri

2012/10/3 Ian Campbell <Ian.Campbell@xxxxxxxxxx>
On Wed, 2012-10-03 at 11:42 +0100, Valtteri Kiviniemi wrote:
> Hi,
>
> I tried to lower vcpus to 1, and now it produces a different crash:
>
> Unable to handle kernel NULL pointer dereference at virtual address
> 00000024
>  printing eip:
> c0232139
> 005c4000 -> *pde = 00000000:00000000
> Oops: 0000 [#1]
> SMP
> CPU:    0
> EIP:    0061:[<c0232139>]    Not tainted VLI
> EFLAGS: 00010097   (2.6.16.33-xen-domU-oldgame #1)
> EIP is at blkif_int+0x1dc/0x228

I don't suppose you have source / debug info for this kernel to resolve
this into a location?

You say this exact same config works with xend?

If so then, since this appears to relate to the devices, one thing which
might be worth trying is to set in your config and
run under both xend and xl. You can then collect the content of xenstore
(xenstore-ls -fp) in both cases (xend booted ok, xl preserved in the
crashed state), and compare.

There will be a bunch of differences relating to the xend one finishing
its boot but something might stand out in the diff. Just posting both
sets of output might be useful.

If you run "xl -vvv create" you should also get a bunch of stuff
relating to the domain builder and where it is placing things. Running
under xend I think something similar is dumped under /var/log/xen
(domain-build-ng.log?)

What does your config file look like?

Ian.



_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxx
http://lists.xen.org/xen-devel

 


Rackspace

Lists.xenproject.org is hosted with RackSpace, monitoring our
servers 24x7x365 and backed by RackSpace's Fanatical Support®.