[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [Filtered!] [Xen-devel] Networking problems with xen3



On Sun, Nov 06, 2005 at 10:57:25PM -0000, Ian Pratt wrote:
> > Ok, adding either noapic or acpi=noirq, both of which appear 
> > to result in the ioapic being ignored, results in everything 
> > working fine. So i guess there's been drift between 2.6.12 
> > native and the xen3/2.6.12-xen combo in this area.
> 
> OK, that's actually quite interesting. 
> 
> Please could you post a diff of the log meesages from a native boot
> (with a similar config) vs on xen. Also, having the xen boot messages
> woul be goo too.

After figuring out that I was losing the start of my boot messages and
rebuilding with a bigger dmesg buffer i got the following, all booted
with lapic and apic=debug:


native-vs-xen-fail.diff - 2.6.12.6 native against 2.6.12.6 xen
xen-fail-vs-xen-work.diff - 2.6.12.6 xen against 2.6.12.6 xen with acpi=noirq

dmesg.working-linux.gz - dmesg of 2.6.12.6 native

dmesg.not-working-xen.gz - dmesg of xen3
dmesg.not-working-linux.gz - dmesg of 2.6.12.6 xen

dmesg.working-noirq-xen.gz - dmesg of xen3 with acpi=noirq
dmesg.working-noirq-linux.gz - dmesg of 2.6.12.6 xen with acpi=noirq



J
-- 
Jody Belka
knew (at) pimb (dot) org
--- dmesg.working-linux 2005-11-06 23:57:31.000000000 +0000
+++ dmesg.not-working-linux     2005-11-06 23:57:07.000000000 +0000
@@ -1,21 +1,10 @@
-Linux version 2.6.12 (jmb@artemis) (gcc version 3.3.5 (Debian 
1:3.3.5-8ubuntu2)) #3 Sun Nov 6 23:33:16 GMT 2005
+Linux version 2.6.12.6-xen.priv-evms (jmb@artemis) (gcc version 3.3.5 (Debian 
1:3.3.5-8ubuntu2)) #2 Sun Nov 6 23:38:46 GMT 2005
 BIOS-provided physical RAM map:
- BIOS-e820: 0000000000000000 - 000000000009fc00 (usable)
- BIOS-e820: 000000000009fc00 - 00000000000a0000 (reserved)
- BIOS-e820: 00000000000c8000 - 00000000000ce000 (reserved)
- BIOS-e820: 00000000000f0000 - 0000000000100000 (reserved)
- BIOS-e820: 0000000000100000 - 000000003fff0000 (usable)
- BIOS-e820: 000000003fff0000 - 000000003fff8000 (ACPI data)
- BIOS-e820: 000000003fff8000 - 0000000040000000 (ACPI NVS)
- BIOS-e820: 00000000fec00000 - 00000000fec01000 (reserved)
- BIOS-e820: 00000000fee00000 - 00000000fee01000 (reserved)
- BIOS-e820: 00000000fff80000 - 0000000100000000 (reserved)
-Warning only 896MB will be used.
-Use a HIGHMEM enabled kernel.
-896MB LOWMEM available.
-On node 0 totalpages: 229376
-  DMA zone: 4096 pages, LIFO batch:1
-  Normal zone: 225280 pages, LIFO batch:31
+ Xen: 0000000000000000 - 0000000010000000 (usable)
+256MB LOWMEM available.
+On node 0 totalpages: 65536
+  DMA zone: 65536 pages, LIFO batch:31
+  Normal zone: 0 pages, LIFO batch:1
   HighMem zone: 0 pages, LIFO batch:1
 DMI 2.3 present.
 ACPI: RSDP (v000 AMI                                   ) @ 0x000fa910
@@ -23,70 +12,41 @@
 ACPI: FADT (v001 AMIINT VIA_K7   0x00000011 MSFT 0x00000097) @ 0x3fff0030
 ACPI: MADT (v001 AMIINT VIA_K7   0x00000009 MSFT 0x00000097) @ 0x3fff00c0
 ACPI: DSDT (v001    VIA    K7VT4 0x00001000 MSFT 0x0100000d) @ 0x00000000
-ACPI: PM-Timer IO Port: 0x808
-ACPI: Local APIC address 0xfee00000
-ACPI: LAPIC (acpi_id[0x01] lapic_id[0x00] enabled)
-Processor #0 6:8 APIC version 16
-ACPI: IOAPIC (id[0x02] address[0xfec00000] gsi_base[0])
-IOAPIC[0]: apic_id 2, version 3, address 0xfec00000, GSI 0-23
-ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
-ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 low level)
-ACPI: IRQ0 used by override.
-ACPI: IRQ2 used by override.
-ACPI: IRQ9 used by override.
-Enabling APIC mode:  Flat.  Using 1 I/O APICs
-Using ACPI (MADT) for SMP configuration information
+IRQ lockup detection disabled
 Allocating PCI resources starting at 40000000 (gap: 40000000:bec00000)
 Built 1 zonelists
 Kernel command line: root=/dev/evms/dom0-new/root ramdisk=16384 mem=49152 
apic=debug lapic
-mapped APIC to ffffd000 (fee00000)
-mapped IOAPIC to ffffc000 (fec00000)
 Initializing CPU#0
-CPU 0 irqstacks, hard=c04c0000 soft=c04bf000
-PID hash table entries: 4096 (order: 12, 65536 bytes)
-Detected 1499.861 MHz processor.
-Using pmtmr for high-res timesource
+CPU 0 irqstacks, hard=c04f0000 soft=c04ef000
+PID hash table entries: 2048 (order: 11, 32768 bytes)
+Xen reported: 1673.756 MHz processor.
 Console: colour VGA+ 80x25
-Dentry cache hash table entries: 131072 (order: 7, 524288 bytes)
-Inode-cache hash table entries: 65536 (order: 6, 262144 bytes)
-Memory: 899296k/917504k available (2122k kernel code, 17620k reserved, 1518k 
data, 168k init, 0k highmem)
+Dentry cache hash table entries: 65536 (order: 6, 262144 bytes)
+Inode-cache hash table entries: 32768 (order: 5, 131072 bytes)
+Software IO TLB disabled
+vmalloc area: d0800000-fbeef000, maxmem 34000000
+Memory: 238080k/262144k available (2239k kernel code, 23852k reserved, 1614k 
data, 144k init, 0k highmem)
 Checking if this processor honours the WP bit even in supervisor mode... Ok.
-Calibrating delay loop... 2965.50 BogoMIPS (lpj=1482752)
+Calibrating delay loop... 3342.33 BogoMIPS (lpj=16711680)
 Mount-cache hash table entries: 512
 CPU: After generic identify, caps: 0383fbff c1cbfbff 00000000 00000000 
00000000 00000000 00000000
 CPU: After vendor identify, caps: 0383fbff c1cbfbff 00000000 00000000 00000000 
00000000 00000000
 CPU: L1 I Cache: 64K (64 bytes/line), D cache 64K (64 bytes/line)
 CPU: L2 Cache: 256K (64 bytes/line)
-CPU: After all inits, caps: 0383fbff c1cbfbff 00000000 00000020 00000000 
00000000 00000000
+CPU: After all inits, caps: 0383d3f1 c1cbfbff 00000000 00000020 00000000 
00000000 00000000
 CPU: AMD Sempron(tm) 2200+ stepping 01
 Enabling fast FPU save and restore... done.
 Enabling unmasked SIMD FPU exception support... done.
-Checking 'hlt' instruction... OK.
-Getting VERSION: 40010
-Getting VERSION: 40010
-Getting ID: 0
-Getting LVT0: 700
-Getting LVT1: 400
-enabled ExtINT on CPU#0
-ESR value before enabling vector: 0x00000080  after: 0x00000000
-ENABLING IO-APIC IRQs
-Synchronizing Arb IDs.
-init IO_APIC IRQs
- IO-APIC (apicid-pin) 2-0, 2-16, 2-17, 2-18, 2-19, 2-20, 2-21, 2-22, 2-23 not 
connected.
-..TIMER: vector=0x31 pin1=2 pin2=-1
-Using local APIC timer interrupts.
-calibrating APIC timer ...
-..... CPU clock speed is 1499.0324 MHz.
-..... host bus clock speed is 333.0183 MHz.
-checking if image is initramfs...it isn't (no cpio magic); looks like an initrd
-Freeing initrd memory: 5371k freed
+Checking 'hlt' instruction... disabled
+ACPI: setting ELCR to 0200 (from 0c28)
+checking if image is initramfs...it isn't (bad gzip magic numbers); looks like 
an initrd
+Freeing initrd memory: 16384k freed
 NET: Registered protocol family 16
-PCI: PCI BIOS revision 2.10 entry at 0xfdae1, last bus=1
+xenbus_probe_init
 PCI: Using configuration type 1
-mtrr: v2.0 (20020519)
 ACPI: Subsystem revision 20050309
 ACPI: Interpreter enabled
-ACPI: Using IOAPIC for interrupt routing
+ACPI: Using PIC for interrupt routing
 ACPI: PCI Root Bridge [PCI0] (0000:00)
 PCI: Probing PCI hardware (bus 00)
 Boot video device is 0000:00:0d.0
@@ -101,69 +61,11 @@
 ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 7 *10 11 12 14 15)
 Linux Plug and Play Support v0.97 (c) Adam Belay
 pnp: PnP ACPI init
-IOAPIC[0]: Set PCI routing entry (2-4 -> 0x49 -> IRQ 4 Mode:0 Active:0)
-IOAPIC[0]: Set PCI routing entry (2-7 -> 0x61 -> IRQ 7 Mode:0 Active:0)
-IOAPIC[0]: Set PCI routing entry (2-8 -> 0x69 -> IRQ 8 Mode:0 Active:0)
-IOAPIC[0]: Set PCI routing entry (2-13 -> 0x91 -> IRQ 13 Mode:0 Active:0)
-IOAPIC[0]: Set PCI routing entry (2-1 -> 0x39 -> IRQ 1 Mode:0 Active:0)
 pnp: PnP ACPI: found 9 devices
+xen_mem: Initialising balloon driver.
 PCI: Using ACPI for IRQ routing
 PCI: If a device doesn't work, try "pci=routeirq".  If it helps, post a report
-number of MP IRQ sources: 15.
-number of IO-APIC #2 registers: 24.
-testing the IO APIC.......................
-IO APIC #2......
-.... register #00: 02000000
-.......    : physical APIC id: 02
-.......    : Delivery Type: 0
-.......    : LTS          : 0
-.... register #01: 00178003
-.......     : max redirection entries: 0017
-.......     : PRQ implemented: 1
-.......     : IO APIC version: 0003
-.... IRQ redirection table:
- NR Log Phy Mask Trig IRR Pol Stat Dest Deli Vect:   
- 00 000 00  1    0    0   0   0    0    0    00
- 01 001 01  1    0    0   0   0    1    1    39
- 02 001 01  0    0    0   0   0    1    1    31
- 03 001 01  0    0    0   0   0    1    1    41
- 04 001 01  1    0    0   0   0    1    1    49
- 05 001 01  0    0    0   0   0    1    1    51
- 06 001 01  0    0    0   0   0    1    1    59
- 07 001 01  1    0    0   0   0    1    1    61
- 08 001 01  1    0    0   0   0    1    1    69
- 09 001 01  0    1    0   1   0    1    1    71
- 0a 001 01  0    0    0   0   0    1    1    79
- 0b 001 01  0    0    0   0   0    1    1    81
- 0c 001 01  0    0    0   0   0    1    1    89
- 0d 001 01  1    0    0   0   0    1    1    91
- 0e 001 01  0    0    0   0   0    1    1    99
- 0f 001 01  0    0    0   0   0    1    1    A1
- 10 000 00  1    0    0   0   0    0    0    00
- 11 000 00  1    0    0   0   0    0    0    00
- 12 04E 0E  1    0    0   0   0    0    2    21
- 13 0B4 04  1    0    0   0   0    0    2    A2
- 14 000 00  1    0    0   0   0    0    0    00
- 15 000 00  1    0    0   0   0    0    0    00
- 16 000 00  1    0    0   0   0    0    0    00
- 17 000 00  1    0    0   0   0    0    0    00
-IRQ to pin mappings:
-IRQ0 -> 0:2
-IRQ1 -> 0:1
-IRQ3 -> 0:3
-IRQ4 -> 0:4
-IRQ5 -> 0:5
-IRQ6 -> 0:6
-IRQ7 -> 0:7
-IRQ8 -> 0:8
-IRQ9 -> 0:9
-IRQ10 -> 0:10
-IRQ11 -> 0:11
-IRQ12 -> 0:12
-IRQ13 -> 0:13
-IRQ14 -> 0:14
-IRQ15 -> 0:15
-.................................... done.
+Grant table initialized
 NTFS driver 2.1.22 [Flags: R/O].
 Initializing Cryptographic API
 ACPI: Power Button (FF) [PWRF]
@@ -174,8 +76,6 @@
 serio: i8042 AUX port at 0x60,0x64 irq 12
 serio: i8042 KBD port at 0x60,0x64 irq 1
 Serial: 8250/16550 driver $Revision: 1.90 $ 8 ports, IRQ sharing disabled
-ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
-ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
 parport: PnPBIOS parport detected.
 parport0: PC-style at 0x378 (0x778), irq 7, dma 3 
[PCSPP,TRISTATE,COMPAT,EPP,ECP,DMA]
 io scheduler noop registered
@@ -187,13 +87,15 @@
 Ethernet Channel Bonding Driver: v2.6.1 (October 29, 2004)
 bonding: Warning: either miimon or arp_interval and arp_ip_target module 
parameters must be specified, otherwise bonding will not detect link failures! 
see bonding.txt for details.
 via-rhine.c:v1.10-LK1.2.0-2.6 June-10-2004 Written by Donald Becker
-IOAPIC[0]: Set PCI routing entry (2-23 -> 0xa9 -> IRQ 23 Mode:1 Active:1)
-ACPI: PCI Interrupt 0000:00:12.0[A] -> GSI 23 (level, low) -> IRQ 23
-PCI: Via IRQ fixup for 0000:00:12.0, from 3 to 7
-eth0: VIA Rhine II at 0xdffdfe00, 00:0b:6a:a9:aa:4d, IRQ 23.
+ACPI: PCI Interrupt Link [LNKA] enabled at IRQ 3
+PCI: setting IRQ 3 as level-triggered
+ACPI: PCI Interrupt 0000:00:12.0[A] -> Link [LNKA] -> GSI 3 (level, low) -> 
IRQ 3
+eth0: VIA Rhine II at 0xdffdfe00, 00:0b:6a:a9:aa:4d, IRQ 3.
 eth0: MII PHY found at address 1, status 0x786d advertising 05e1 Link 45e1.
 tun: Universal TUN/TAP device driver, 1.6
 tun: (C) 1999-2004 Max Krasnyansky <maxk@xxxxxxxxxxxx>
+WARNING: Failed to register Xen virtual console driver as 'ttyS0'
+Event-channel device installed.
 Uniform Multi-Platform E-IDE driver Revision: 7.00alpha2
 ide: Assuming 33MHz system bus speed for PIO modes; override with idebus=xx
 VP_IDE: IDE controller at PCI slot 0000:00:11.1
@@ -227,21 +129,22 @@
 Uniform CD-ROM driver Revision: 3.20
 device-mapper: 4.4.0-ioctl (2005-01-12) initialised: dm-devel@xxxxxxxxxx
 NET: Registered protocol family 2
-IP: routing cache hash table of 8192 buckets, 64Kbytes
-TCP established hash table entries: 131072 (order: 8, 1048576 bytes)
-TCP bind hash table entries: 65536 (order: 6, 262144 bytes)
-TCP: Hash tables configured (established 131072 bind 65536)
-ip_conntrack version 2.1 (7168 buckets, 57344 max) - 172 bytes per conntrack
-ip_tables: (C) 2000-2002 Netfilter core team
 input: AT Translated Set 2 keyboard on isa0060/serio0
+IP: routing cache hash table of 2048 buckets, 16Kbytes
+TCP established hash table entries: 16384 (order: 5, 131072 bytes)
+TCP bind hash table entries: 16384 (order: 4, 65536 bytes)
+TCP: Hash tables configured (established 16384 bind 16384)
+ip_conntrack version 2.1 (2048 buckets, 16384 max) - 172 bytes per conntrack
+ip_tables: (C) 2000-2002 Netfilter core team
 NET: Registered protocol family 1
 NET: Registered protocol family 17
-RAMDISK: Compressed image found at block 0
+RAMDISK: ext2 filesystem found at block 0
+RAMDISK: Loading 16384KiB [1 disk] into ram disk... done.
 EXT2-fs warning: checktime reached, running e2fsck is recommended
 VFS: Mounted root (ext2 filesystem).
 kjournald starting.  Commit interval 5 seconds
 EXT3-fs: mounted filesystem with ordered data mode.
-Freeing unused kernel memory: 168k freed
+Freeing unused kernel memory: 144k freed
 EXT3 FS on dm-6, internal journal
 Adding 131060k swap on /dev/evms/dom0-new/swap/0.  Priority:-1 extents:1
 eth0: link up, 100Mbps, full-duplex, lpa 0x45E1
--- dmesg.not-working-linux     2005-11-06 23:57:07.000000000 +0000
+++ dmesg.working-noirq-linux   2005-11-07 00:03:04.000000000 +0000
@@ -15,11 +15,11 @@
 IRQ lockup detection disabled
 Allocating PCI resources starting at 40000000 (gap: 40000000:bec00000)
 Built 1 zonelists
-Kernel command line: root=/dev/evms/dom0-new/root ramdisk=16384 mem=49152 
apic=debug lapic
+Kernel command line: root=/dev/evms/dom0-new/root ramdisk=16384 mem=49152 
apic=debug lapic acpi=noirq
 Initializing CPU#0
 CPU 0 irqstacks, hard=c04f0000 soft=c04ef000
 PID hash table entries: 2048 (order: 11, 32768 bytes)
-Xen reported: 1673.756 MHz processor.
+Xen reported: 1673.761 MHz processor.
 Console: colour VGA+ 80x25
 Dentry cache hash table entries: 65536 (order: 6, 262144 bytes)
 Inode-cache hash table entries: 32768 (order: 5, 131072 bytes)
@@ -38,7 +38,7 @@
 Enabling fast FPU save and restore... done.
 Enabling unmasked SIMD FPU exception support... done.
 Checking 'hlt' instruction... disabled
-ACPI: setting ELCR to 0200 (from 0c28)
+ACPI: setting ELCR to 0e28 (from 0c28)
 checking if image is initramfs...it isn't (bad gzip magic numbers); looks like 
an initrd
 Freeing initrd memory: 16384k freed
 NET: Registered protocol family 16
@@ -55,16 +55,14 @@
 ACPI: Power Resource [URP2] (off)
 ACPI: Power Resource [FDDP] (off)
 ACPI: Power Resource [LPTP] (off)
-ACPI: PCI Interrupt Link [LNKA] (IRQs *3 4 5 7 10 11 12 14 15)
-ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 7 10 *11 12 14 15)
-ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 *5 7 10 11 12 14 15)
-ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 7 *10 11 12 14 15)
 Linux Plug and Play Support v0.97 (c) Adam Belay
 pnp: PnP ACPI init
 pnp: PnP ACPI: found 9 devices
 xen_mem: Initialising balloon driver.
-PCI: Using ACPI for IRQ routing
-PCI: If a device doesn't work, try "pci=routeirq".  If it helps, post a report
+PCI: Probing PCI hardware
+PCI: Using IRQ router default [1106/3177] at 0000:00:11.0
+PCI: IRQ 0 for device 0000:00:11.1 doesn't match PIRQ mask - try 
pci=usepirqmask
+PCI: Hardcoded IRQ 14 for device 0000:00:11.1
 Grant table initialized
 NTFS driver 2.1.22 [Flags: R/O].
 Initializing Cryptographic API
@@ -87,9 +85,6 @@
 Ethernet Channel Bonding Driver: v2.6.1 (October 29, 2004)
 bonding: Warning: either miimon or arp_interval and arp_ip_target module 
parameters must be specified, otherwise bonding will not detect link failures! 
see bonding.txt for details.
 via-rhine.c:v1.10-LK1.2.0-2.6 June-10-2004 Written by Donald Becker
-ACPI: PCI Interrupt Link [LNKA] enabled at IRQ 3
-PCI: setting IRQ 3 as level-triggered
-ACPI: PCI Interrupt 0000:00:12.0[A] -> Link [LNKA] -> GSI 3 (level, low) -> 
IRQ 3
 eth0: VIA Rhine II at 0xdffdfe00, 00:0b:6a:a9:aa:4d, IRQ 3.
 eth0: MII PHY found at address 1, status 0x786d advertising 05e1 Link 45e1.
 tun: Universal TUN/TAP device driver, 1.6
@@ -99,8 +94,8 @@
 Uniform Multi-Platform E-IDE driver Revision: 7.00alpha2
 ide: Assuming 33MHz system bus speed for PIO modes; override with idebus=xx
 VP_IDE: IDE controller at PCI slot 0000:00:11.1
-ACPI: PCI Interrupt 0000:00:11.1[A]: no GSI
-PCI: Via IRQ fixup for 0000:00:11.1, from 255 to 15
+PCI: Hardcoded IRQ 14 for device 0000:00:11.1
+PCI: Via IRQ fixup for 0000:00:11.1, from 255 to 14
 VP_IDE: chipset revision 6
 VP_IDE: not 100% native mode: will probe irqs later
 VP_IDE: VIA vt8235 (rev 00) IDE UDMA133 controller on pci0000:00:11.1

Attachment: dmesg.working-linux.gz
Description: Binary data

Attachment: dmesg.not-working-xen.gz
Description: Binary data

Attachment: dmesg.not-working-linux.gz
Description: Binary data

Attachment: dmesg.working-noirq-xen.gz
Description: Binary data

Attachment: dmesg.working-noirq-linux.gz
Description: Binary data

_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-devel

 


Rackspace

Lists.xenproject.org is hosted with RackSpace, monitoring our
servers 24x7x365 and backed by RackSpace's Fanatical Support®.