RE: [Xen-devel] Using xen-unstable, dom0 hangs during boot

["Nadolski, Ed" <Ed.Nadolski@xxxxxxx>]

> -----Original Message-----
> From: Pasi Kärkkäinen [mailto:pasik@xxxxxx]
> Sent: Friday, February 26, 2010 7:46 AM
> To: Nadolski, Ed
> Cc: Jeremy Fitzhardinge; Xen-devel@xxxxxxxxxxxxxxxxxxx
> Subject: Re: [Xen-devel] Using xen-unstable, dom0 hangs during boot
> 
> On Fri, Feb 26, 2010 at 06:33:27AM -0700, Nadolski, Ed wrote:
> > > -----Original Message-----
> > > From: Jeremy Fitzhardinge [mailto:jeremy@xxxxxxxx]
> > > Sent: Thursday, February 25, 2010 4:12 PM
> > > To: Nadolski, Ed
> > > Cc: Xen-devel@xxxxxxxxxxxxxxxxxxx
> > > Subject: Re: [Xen-devel] Using xen-unstable, dom0 hangs during boot
> > >
> > > On 02/25/2010 02:18 PM, Nadolski, Ed wrote:
> > > > I'm running Fedora 12 (kernel 2.6.31.5-127.fc12.x86_64) on a Dell
> > > T7500 Xeon with VT-x and VT-d. After building xen-unstable and
> > > rebooting, the dom0 Linux hangs a few seconds after it gets control
> > > from Xen, and I have to power-cycle to recover.   Here are the last
> > > messages before it hangs:
> > > >
> > > > [    2.766882] loop: module loaded
> > > > [    2.767736] input: Macintosh mouse button emulation as
> > > /devices/virtual/input/input2
> > > > [    2.769396] xen_set_ioapic_routing: irq 20 gsi 20 vector 20
> ioapic
> > > 0 pin 20 triggering 1 polarity 1
> > > > [    2.770342] achi 0000:00:1f.2: PCI INT C ->  GSI 20 (level,
> low) -
> > > >  IRQ 20
> > > > [    2.771158] ahci 0000:00:1f.2: AHCI 0001.0200 32 slots 6 ports
> 3
> > > Gbps 0x27 impl SATA mode
> > > > [    2.772078] ahci 0000:00:1f.2: flags: 64bit ncq sntf led clo
> pio
> > > ems
> > > > <<hangs at this point>>
> > > >
> > > > Thoughts?  Any grub parameters I should try for Linux and/or Xen?
> > > Any further info I can provide?
> > > >
> > >
> > > What kernel is this?  What's the boot command line?
> >
> > The build downloaded the kernel from:
> >
> > + git clone
> git://git.kernel.org/pub/scm/linux/kernel/git/jeremy/xen.git linux-2.6-
> pvops.git.tmp
> >
> > The serial console output stops before the Linux kernel messages show
> up, but here is what I have in grub.conf:
> >
> > title Fedora12-Xen (2.6.31.6) Xen and dom0 serial console
> >         root (hd0,0)
> >         kernel /xen-4.0.0-rc4.gz com1=115200,8n1 console=com1
> >         module /vmlinuz-2.6.31.6 ro root=UUID=d9c5bf5d-23d1-445e-
> 9210-e6ad0798a0ba nomodeset LANG=en_US.UTF-8 SYSFONT=latarcyrheb-sun16
> KEYBOARDTYPE=pc KEYTABLE=us console=tty0 console=ttyS0,115200
> >         module /initramfs-2.6.31.6.img
> >
> > but it still fails the same way regardless of the vmlinuz parameters.
> With the serial port enabled, the hang happens a bit sooner, at the
> serial driver init.  Also, no change if I disable VTx/VTd in the BIOS.
> >
> 
> You should use grub configuration like this:
> 
> title        pv_ops dom0 with a serial console
> root         (hd0,0)
> kernel       /xen-4.0.0-rc4.gz dom0_mem=1024M loglvl=all
> guest_loglvl=all sync_console console_to_ring com1=115200,8n1
> console=com1
> module       /vmlinuz-2.6.31.6 ro root=/dev/vg00/lv01 console=hvc0
> earlyprintk=xen nomodeset
> module       /initrd-2.6.31.6.img
> 
> Modify the root parameter etc for your environment.
> 
> Note that vmlinuz (dom0 kernel) needs to have "console=hvc0
> earlyprintk=xen"
> to log to a serial console through Xen.
> 
> -- Pasi

Thanks Pasi. I've attached the full trace, and a few select lines are below.  
Any further thoughts? I'm not familiar with the interrupt mapping code, but 
I'll see if there are some parameters I can change.

Ed

(XEN) Xen version 4.0.0-rc4 (root@) (gcc version 4.4.2 20091027 (Red Hat 
4.4.2-7) (GCC) ) Thu Feb 25 22:09:19 MST 2010
(XEN) Latest ChangeSet: Thu Feb 25 21:03:26 2010 +0000 20983:94535cc63835
(XEN) Console output is synchronous.
(XEN) Command line: loglvl=all guest_loglvl=all sync_console console_to_ring 
com1=115200,8n1 console=com1
...
Xen: setup ISA identity maps
about to get started...
[    0.000000] Initializing cgroup subsys cpuset
[    0.000000] Initializing cgroup subsys cpu
[    0.000000] Linux version 2.6.31.6 (root@truckee) (gcc version 4.4.2 
20091027 (Red Hat 4.4.2-7) (GCC) ) #1 SMP Thu Feb 25 22:00:24 MST 2010
[    0.000000] Command line: ro root=UUID=d9c5bf5d-23d1-445e-9210-e6ad0798a0ba 
nomodeset LANG=en_US.UTF-8 SYSFONT=latarcyrheb-sun16 KEYBOARDTYPE=pc 
KEYTABLE=us console=hvc0 earlyprintk=xen
...
(XEN) CPU 3 initialization completed
[    5.888385] Event-channel device installed.
[    5.896414] blktap_device_init: blktap device major 253
[    5.901550] blktap_ring_init: blktap ring major: 251
[    5.907640] registering netback
[    5.918012] hpet_acpi_add: no address or irqs in _CRS
[    5.923249] Non-volatile memory driver v1.3
[    5.927418] Linux agpgart interface v0.103
[    5.931762] [drm] Initialized drm 1.1.0 20060810
[    5.936338] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
(XEN) irq.c:1182:d0 Cannot bind IRQ 0 to guest. Will not share with others.
<< output stops here >>

Attachment: serialtrace1.txt
Description: serialtrace1.txt

_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-devel