[Xen-users] domU, Failed to obtain physical IRQ, e1000 Intel NIC

[Ron King <rking@xxxxxxxxxxx>]

Hello all.
I've upgraded my drives, and in doing so loaded FC8.  Latest kernel-xen.x86_64 (2.6.21.7-5) and xen.x86_64 (3.1.2-5) available, using 2 Intel NICs with e1000 driver.  All worked fine on FC5 with custom domU FC5 with pcifront and NIC drivers in kernel.

Now, I'm unable to get the NICs to function inside my domU.  The are visible in lspci, and ipconfig.  DomU dmesg reports "Failed to obtain physical IRQ 72/73" whenever I attempt to "up" the interfaces with ipconfig.  IP link shows no-carrier regardless of whether the cable is installed (yes, I've tried other known-goods).  The IRQs are in /proc/interrupts.  Dom0 shows pciback as the drivers for the e1000 NICs

Anyone know why this is happening?  And, how to fix it, of course?


***********************************************************
domU files

#dmesg
Linux version 2.6.21.7-5.fc8xen (mockbuild@x86-4) (gcc version 4.1.2 20070925 (Red Hat 4.1.2-33)) #1 SMP Thu Aug 7 12:44:22 EDT 2008
Command line: ro root=LABEL=/
BIOS-provided physical RAM map:
 Xen: 0000000000000000 - 0000000020800000 (usable)
Entering add_active_range(0, 0, 133120) 0 entries of 256 used
end_pfn_map = 133120
Entering add_active_range(0, 0, 133120) 0 entries of 256 used
Zone PFN ranges:
  DMA             0 ->   133120
  DMA32      133120 ->   133120
  Normal     133120 ->   133120
early_node_map[1] active PFN ranges
    0:        0 ->   133120
On node 0 totalpages: 133120
  DMA zone: 1820 pages used for memmap
  DMA zone: 3543 pages reserved
  DMA zone: 127757 pages, LIFO batch:31
  DMA32 zone: 0 pages used for memmap
  Normal zone: 0 pages used for memmap
No mptable found.
PERCPU: Allocating 26496 bytes of per cpu data
Built 1 zonelists.  Total pages: 127757
Kernel command line: ro root=LABEL=/
Initializing CPU#0
PID hash table entries: 2048 (order: 11, 16384 bytes)
Xen reported: 3000.108 MHz processor.
Console: colour dummy device 80x25
Dentry cache hash table entries: 65536 (order: 7, 524288 bytes)
Inode-cache hash table entries: 32768 (order: 6, 262144 bytes)
Calgary: detecting Calgary via BIOS EBDA area
Calgary: Unable to locate Rio Grande table in EBDA - bailing!
Software IO TLB disabled
Memory: 501248k/532480k available (2265k kernel code, 22340k reserved, 1351k data, 200k init)
Calibrating delay using timer specific routine.. 6007.16 BogoMIPS (lpj=3003580)
Security Framework v1.0.0 initialized
SELinux:  Initializing.
SELinux:  Starting in permissive mode
selinux_register_security:  Registering secondary module capability
Capability LSM initialized as secondary
Mount-cache hash table entries: 256
CPU: Trace cache: 12K uops, L1 D cache: 16K
CPU: L2 cache: 2048K
CPU: Physical Processor ID: 0
CPU: Processor Core ID: 0
SMP alternatives: switching to UP code
Freeing SMP alternatives: 28k freed
Brought up 1 CPUs
sizeof(vma)=168 bytes
sizeof(page)=56 bytes
sizeof(inode)=560 bytes
sizeof(dentry)=208 bytes
sizeof(ext3inode)=760 bytes
sizeof(buffer_head)=104 bytes
sizeof(skbuff)=248 bytes
sizeof(task_struct)=1888 bytes
NET: Registered protocol family 16
Brought up 1 CPUs
PCI: Fatal: No config space access function found
PCI: setting up Xen PCI frontend stub
ACPI: Interpreter disabled.
Linux Plug and Play Support v0.97 (c) Adam Belay
pnp: PnP ACPI: disabled
xen_mem: Initialising balloon driver.
usbcore: registered new interface driver usbfs
usbcore: registered new interface driver hub
usbcore: registered new device driver usb
PCI: System does not support PCI
PCI: System does not support PCI
NetLabel: Initializing
NetLabel:  domain hash size = 128
NetLabel:  protocols = UNLABELED CIPSOv4
NetLabel:  unlabeled traffic allowed by default
NET: Registered protocol family 2
pcifront pci-0: Installing PCI frontend
pcifront pci-0: Creating PCI Frontend Bus 0000:00
IP route cache hash table entries: 16384 (order: 5, 131072 bytes)
TCP established hash table entries: 65536 (order: 8, 1572864 bytes)
TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
TCP: Hash tables configured (established 65536 bind 65536)
TCP reno registered
checking if image is initramfs... it is
Freeing initrd memory: 7484k freed
audit: initializing netlink socket (disabled)
audit(1228931987.558:1): initialized
VFS: Disk quotas dquot_6.5.1
Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
SELinux:  Registering netfilter hooks
ksign: Installing public key data
Loading keyring
io scheduler noop registered
io scheduler anticipatory registered
io scheduler deadline registered
io scheduler cfq registered (default)
pci_hotplug: PCI Hot Plug PCI Core version: 0.5
rtc: IRQ 8 is not free.
Non-volatile memory driver v1.2
Linux agpgart interface v0.102 (c) Dave Jones
RAMDISK driver initialized: 16 RAM disks of 16384K size 4096 blocksize
input: Macintosh mouse button emulation as /class/input/input0
Xen virtual console successfully installed as xvc0
Event-channel device installed.
usbcore: registered new interface driver hiddev
usbcore: registered new interface driver usbhid
drivers/usb/input/hid-core.c: v2.6:USB HID core driver
PNP: No PS/2 controller found. Probing ports directly.
i8042.c: No controller found.
mice: PS/2 mouse device common for all mice
TCP bic registered
Initializing XFRM netlink socket
NET: Registered protocol family 1
NET: Registered protocol family 17
XENBUS: Device with no driver: device/vbd/51712
XENBUS: Device with no driver: device/console/0
drivers/rtc/hctosys.c: unable to open rtc device (rtc0)
Freeing unused kernel memory: 200k freed
Write protecting the kernel read-only data: 981k
ohci_hcd: 2006 August 04 USB 1.1 'Open' Host Controller (OHCI) Driver
USB Universal Host Controller Interface driver v3.0
xen-vbd: registered block device major 202
blkfront: xvda: barriers enabled
 xvda: xvda1 xvda2 xvda3
kjournald starting.  Commit interval 5 seconds
EXT3-fs: mounted filesystem with ordered data mode.
SELinux:  Disabled at runtime.
SELinux:  Unregistering netfilter hooks
audit(1228931989.175:2): selinux=0 auid=4294967295
input: PC Speaker as /class/input/input1
Intel(R) PRO/1000 Network Driver - version 7.3.20-k2-NAPI
Copyright (c) 1999-2006 Intel Corporation.
PCI: Enabling device 0000:00:00.0 (0000 -> 0003)
e1000: 0000:00:00.0: e1000_probe: (PCI-X:133MHz:64-bit) 00:11:xx:xx:xx:xx
e1000: eth0: e1000_probe: Intel(R) PRO/1000 Network Connection
PCI: Enabling device 0000:00:00.1 (0000 -> 0003)
e1000: 0000:00:00.1: e1000_probe: (PCI-X:133MHz:64-bit) 00:11:xx:xx:xx:xy
e1000: eth1: e1000_probe: Intel(R) PRO/1000 Network Connection
device-mapper: ioctl: 4.11.0-ioctl (2006-10-12) initialised: dm-devel@xxxxxxxxxx
device-mapper: multipath: version 1.0.5 loaded
EXT3 FS on xvda3, internal journal
kjournald starting.  Commit interval 5 seconds
EXT3 FS on xvda1, internal journal
EXT3-fs: mounted filesystem with ordered data mode.
Adding 1020116k swap on /dev/xvda2.  Priority:-1 extents:1 across:1020116k
NET: Registered protocol family 10
lo: Disabled Privacy Extensions
Mobile IPv6
ip6_tables: (C) 2000-2006 Netfilter Core Team
Netfilter messages via NETLINK v0.30.
nf_conntrack version 0.5.0 (2080 buckets, 16640 max)
ip_tables: (C) 2000-2006 Netfilter Core Team
Failed to obtain physical IRQ 72
ADDRCONF(NETDEV_UP): eth0: link is not ready
Failed to obtain physical IRQ 73
ADDRCONF(NETDEV_UP): eth1: link is not ready

#iptables -a
    eth0      Link encap:Ethernet  HWaddr 00:11:xx:xx:xx:xx 
              inet addr:10.10.0.252  Bcast:10.10.0.255  Mask:255.255.255.0
              UP BROADCAST MULTICAST  MTU:1500  Metric:1
              RX packets:0 errors:0 dropped:0 overruns:0 frame:0
              TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
              collisions:0 txqueuelen:1000 
              RX bytes:0 (0.0 b)  TX bytes:0 (0.0 b)
              Base address:0x5000 Memory:fdfe0000-fe000000 
    
    eth1      Link encap:Ethernet  HWaddr 00:11:xx:xx:xx:xy  
              inet addr:129.138.240.117  Bcast:129.138.240.127  Mask:255.255.240.0
              UP BROADCAST MULTICAST  MTU:1500  Metric:1
              RX packets:0 errors:0 dropped:0 overruns:0 frame:0
              TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
              collisions:0 txqueuelen:1000 
              RX bytes:0 (0.0 b)  TX bytes:0 (0.0 b)
              Base address:0x5040 Memory:fdf60000-fdf80000 

#lspci -nv
    00:00.0 0200: 8086:1010 (rev 01)
            Subsystem: 0e11:00db
            Flags: bus master, 66MHz, medium devsel, latency 64, IRQ 72
            Memory at fdfe0000 (64-bit, non-prefetchable) [size=128K]
            Memory at fdf80000 (64-bit, non-prefetchable) [size=256K]
            I/O ports at 5000 [size=64]
            Capabilities: [dc] Power Management version 2
            Capabilities: [e4] PCI-X non-bridge device
            Capabilities: [f0] Message Signalled Interrupts: Mask- 64bit+ Queue=0/0 Enable-
            Kernel driver in use: e1000
            Kernel modules: e1000

    00:00.1 0200: 8086:1010 (rev 01)
            Subsystem: 0e11:00db
            Flags: bus master, 66MHz, medium devsel, latency 64, IRQ 73
            Memory at fdf60000 (64-bit, non-prefetchable) [size=128K]
            I/O ports at 5040 [size=64]
            Capabilities: [dc] Power Management version 2
            Capabilities: [e4] PCI-X non-bridge device
            Capabilities: [f0] Message Signalled Interrupts: Mask- 64bit+ Queue=0/0 Enable-
            Kernel driver in use: e1000
            Kernel modules: e1000

#cat /proc/interrupts 
               CPU0       
     72:          0  Phys-irq-level     eth0
     73:          0  Phys-irq-level     eth1
    256:      14247  Dynamic-irq-level     timer0
    257:          0  Dynamic-irq-level     resched0
    258:          0  Dynamic-irq-level     callfunc0
    259:        281  Dynamic-irq-level     xenbus
    260:        752  Dynamic-irq-level     xencons
    261:       2284  Dynamic-irq-level     blkif
    NMI:          0 
    LOC:          0 
    ERERR:          0

************************************************************************************
Dom0 files:

#cat /etc/xen/blob 
    name = 'blob'
    memory = '512'
    disk = [ 'phy:/dev/cluster/blob,xvda,w' ]
    pci = [ '0a:01.0', '0a:01.1' ]
    
    
    

#cat /etc/modprobe.conf
    options pciback hide=(0a:01.0)(0a:01.1)
    install e1000 /sbin/modprobe pciback ; /sbin/modprobe --first-time --ignore-install e1000
    alias eth0 tg3
    alias eth1 tg3
    #removed for DOMU use
    #alias eth2 e1000
    #alias eth3 e1000

#lspci -nv
    0a:01.0 0200: 8086:1010 (rev 01)
            Subsystem: 0e11:00db
            Flags: 66MHz, medium devsel, IRQ 72
            Memory at fdfe0000 (64-bit, non-prefetchable) [disabled] [size=128K]
            Memory at fdf80000 (64-bit, non-prefetchable) [disabled] [size=256K]
            I/O ports at 5000 [disabled] [size=64]
            [virtual] Expansion ROM at f0000000 [disabled] [size=256K]
            Capabilities: [dc] Power Management version 2
            Capabilities: [e4] PCI-X non-bridge device
            Capabilities: [f0] Message Signalled Interrupts: Mask- 64bit+ Queue=0/0 Enable-
            Kernel driver in use: pciback
            Kernel modules: e1000

    0a:01.1 0200: 8086:1010 (rev 01)
            Subsystem: 0e11:00db
            Flags: 66MHz, medium devsel, IRQ 73
            Memory at fdf60000 (64-bit, non-prefetchable) [disabled] [size=128K]
            I/O ports at 5040 [disabled] [size=64]
            Capabilities: [dc] Power Management version 2
            Capabilities: [e4] PCI-X non-bridge device
            Capabilities: [f0] Message Signalled Interrupts: Mask- 64bit+ Queue=0/0 Enable-
            Kernel driver in use: pciback
            Kernel modules: e1000





_______________________________________________
Xen-users mailing list
Xen-users@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-users