WARNING - OLD ARCHIVES

This is an archived copy of the Xen.org mailing list, which we have preserved to ensure that existing links to archives are not broken. The live archive, which contains the latest emails, can be found at http://lists.xen.org/
   
 
 
Xen 
 
Home Products Support Community News
 
   
 

xen-devel

[Xen-devel] VF passthrough problems

To: Jan Beulich <JBeulich@xxxxxxxxxx>
Subject: [Xen-devel] VF passthrough problems
From: Stefano Stabellini <stefano.stabellini@xxxxxxxxxxxxx>
Date: Fri, 18 Feb 2011 13:36:03 +0000
Cc: xen-devel@xxxxxxxxxxxxxxxxxxx
Delivery-date: Fri, 18 Feb 2011 05:38:07 -0800
Envelope-to: www-data@xxxxxxxxxxxxxxxxxxx
List-help: <mailto:xen-devel-request@lists.xensource.com?subject=help>
List-id: Xen developer discussion <xen-devel.lists.xensource.com>
List-post: <mailto:xen-devel@lists.xensource.com>
List-subscribe: <http://lists.xensource.com/mailman/listinfo/xen-devel>, <mailto:xen-devel-request@lists.xensource.com?subject=subscribe>
List-unsubscribe: <http://lists.xensource.com/mailman/listinfo/xen-devel>, <mailto:xen-devel-request@lists.xensource.com?subject=unsubscribe>
Sender: xen-devel-bounces@xxxxxxxxxxxxxxxxxxx
User-agent: Alpine 2.00 (DEB 1167 2008-08-23)
I am having reports of PCI passthrough problems with SR-IOV, in
particular it looks like we are hitting the warning at msi:635 and
msi:648 in xen; see the following log:

(XEN) [VT-D]iommu.c:1785: VT-d page table not sharing with EPT table
xenbus dev backend/vbd/1/5696 error 6 opening device
(XEN) PCI add Virtual Function 04:1a.0
(XEN) HVM1: HVM Loader
(XEN) HVM1: Detected Xen v4.1.0.rc2.pre
(XEN) HVM1: CPU speed is 2660 MHz
(XEN) HVM1: Xenbus rings @0xfeffc000, event channel 2
(XEN) irq.c:258: Dom1 PCI link 0 changed 0 -> 5
(XEN) HVM1: PCI-ISA link 0 routed to IRQ5
(XEN) irq.c:258: Dom1 PCI link 1 changed 0 -> 10
(XEN) HVM1: PCI-ISA link 1 routed to IRQ10
(XEN) irq.c:258: Dom1 PCI link 2 changed 0 -> 11
(XEN) HVM1: PCI-ISA link 2 routed to IRQ11
(XEN) irq.c:258: Dom1 PCI link 3 changed 0 -> 5
(XEN) HVM1: PCI-ISA link 3 routed to IRQ5
(XEN) HVM1: pci dev 01:2 INTD->IRQ5
(XEN) HVM1: pci dev 01:3 INTA->IRQ10
(XEN) HVM1: pci dev 02:0 INTA->IRQ11
(XEN) HVM1: pci dev 03:0 INTC->IRQ10
(XEN) HVM1: pci dev 04:0 INTA->IRQ5
(XEN) HVM1: pci dev 02:0 bar 10 size 02000000: f0000008
(XEN) HVM1: pci dev 03:0 bar 14 size 01000000: f2000008
(XEN) HVM1: pci dev 05:0 bar 10 size 00004000: f3000004
(XEN) domctl.c:982:d0 memory_map:add: gfn=f3000 mfn=dd5a0 nr_mfns=4
(XEN) domctl.c:982:d0 memory_map:add: gfn=f3004 mfn=dd6a0 nr_mfns=4
(XEN) domctl.c:992:d0 memory_map:remove: gfn=f3004 mfn=dd6a0 nr_mfns=1
(XEN) HVM1: pci dev 05:0 bar 1c size 00004000: f3004004
(XEN) HVM1: pci dev 02:0 bar 14 size 00001000: f3008000
(XEN) HVM1: pci dev 03:0 bar 10 size 00000100: 0000c001
(XEN) HVM1: pci dev 04:0 bar 10 size 00000100: 0000c101
(XEN) HVM1: pci dev 04:0 bar 14 size 00000100: f3009000
(XEN) HVM1: pci dev 01:2 bar 20 size 00000020: 0000c201
(XEN) HVM1: pci dev 01:1 bar 20 size 00000010: 0000c221
(XEN) HVM1: Multiprocessor initialisation:
(XEN) HVM1:  - CPU0 ... 40-bit phys ... fixed MTRRs ... var MTRRs [2/8] ...
done.
(XEN) HVM1: Testing HVM environment:
(XEN) HVM1:  - REP INSB across page boundaries ... passed
(XEN) HVM1:  - GS base MSRs and SWAPGS ... passed
(XEN) HVM1: Passed 2 of 2 tests
(XEN) HVM1: Writing SMBIOS tables ...
(XEN) HVM1: Loading ROMBIOS ...
(XEN) HVM1: 9628 bytes of ROMBIOS high-memory extensions:
(XEN) HVM1:   Relocating to 0xfc000000-0xfc00259c ... done
(XEN) HVM1: Creating MP tables ...
(XEN) HVM1: Loading Cirrus VGABIOS ...
(XEN) HVM1: Loading PCI Option ROM ...
(XEN) HVM1:  - Manufacturer: http://etherboot.org
(XEN) HVM1:  - Product name: gPXE
[root@localhost bug-report-20110217180212]# (XEN) HVM1: Loading ACPI ...
(XEN) HVM1:  - Lo data: 000ea020-000ea04f
(XEN) HVM1:  - Hi data: fc002800-fc01293f
(XEN) HVM1: vm86 TSS at fc012c00
(XEN) HVM1: BIOS map:
(XEN) HVM1:  c0000-c8fff: VGA BIOS
(XEN) HVM1:  c9000-d6fff: Etherboot ROM
(XEN) HVM1:  eb000-eb193: SMBIOS tables
(XEN) HVM1:  f0000-fffff: Main BIOS
(XEN) HVM1: E820 table:
(XEN) HVM1:  [00]: 00000000:00000000 - 00000000:0009e000: RAM
(XEN) HVM1:  [01]: 00000000:0009e000 - 00000000:0009fc00: RESERVED
(XEN) HVM1:  [02]: 00000000:0009fc00 - 00000000:000a0000: RESERVED
(XEN) HVM1:  HOLE: 00000000:000a0000 - 00000000:000e0000
(XEN) HVM1:  [03]: 00000000:000e0000 - 00000000:00100000: RESERVED
(XEN) HVM1:  [04]: 00000000:00100000 - 00000000:2ec00000: RAM
(XEN) HVM1:  HOLE: 00000000:2ec00000 - 00000000:fc000000
(XEN) HVM1:  [05]: 00000000:fc000000 - 00000001:00000000: RESERVED
(XEN) HVM1: Invoking ROMBIOS ...
(XEN) HVM1: $Revision: 1.221 $ $Date: 2008/12/07 17:32:29 $
(XEN) stdvga.c:147:d1 entering stdvga and caching modes
(XEN) HVM1: VGABios $Id: vgabios.c,v 1.67 2008/01/27 09:44:12 vruppert Exp $
(XEN) HVM1: Processor 1: Xen(R) Virtual CPU
(XEN) HVM1: ata0-0: PCHS=16383/16/63 translation=lba LCHS=1024/255/63
(XEN) HVM1: XS Virtual IDE Controller      Hard Drive (8192MB)
(XEN) HVM1: IDE time out
(XEN) HVM1: XS Virtual ATAPI-4             CD-Rom/DVD-Rom
(XEN) HVM1:
(XEN) HVM1:
(XEN) HVM1:
(XEN) HVM1: Press F12 for boot menu.
(XEN) HVM1:
(XEN) HVM1: Boot device: CD-Romata_is_ready returned 1
(XEN) HVM1:  - failure: could not read boot disk
(XEN) HVM1:
(XEN) HVM1: Boot device: Hard Drive - success.
(XEN) HVM1: Booting from 0000:7c00
(XEN) HVM1: int13_harddisk: function 41, unmapped device for ELDL=81
(XEN) HVM1: int13_harddisk: function 08, unmapped device for ELDL=81
(XEN) HVM1: *** int 15h function AX=00c0, BX=0000 not yet supported!
(XEN) HVM1: int13_harddisk: function 15, unmapped device for ELDL=81
(XEN) HVM1: KBD: unsupported int 16h function 03
(XEN) HVM1: int13_harddisk: function 15, unmapped device for ELDL=81
(XEN) HVM1: *** int 15h function AX=e980, BX=e6f5 not yet supported!
(XEN) HVM1: int13_harddisk: function 02, unmapped device for ELDL=81
(XEN) HVM1: int13_harddisk: function 41, unmapped device for ELDL=81
(XEN) irq.c:258: Dom1 PCI link 0 changed 5 -> 0
(XEN) irq.c:258: Dom1 PCI link 1 changed 10 -> 0
(XEN) irq.c:258: Dom1 PCI link 2 changed 11 -> 0
(XEN) irq.c:258: Dom1 PCI link 3 changed 5 -> 0
(XEN) irq.c:324: Dom1 callback via changed to PCI INTx Dev 0x03 IntC
(XEN) Xen WARN at msi.c:635
(XEN) ----[ Xen-4.1.0.rc2.pre  x86_64  debug=y  Not tainted ]----
(XEN) CPU:    7
(XEN) RIP:    e008:[<ffff82c480161a08>] pci_enable_msi+0x464/0x960
(XEN) RFLAGS: 0000000000010206   CONTEXT: hypervisor
(XEN) rax: 0000000000000000   rbx: 00000000dd6a0000   rcx: 0000000000000001
(XEN) rdx: ffff82c48025bc40   rsi: 0000000000000246   rdi: ffff82c48025bc40
(XEN) rbp: ffff830919aafdc8   rsp: ffff830919aafcf8   r8:  000000000000001a
(XEN) r9:  000000000000003f   r10: 0000000000000072   r11: 000000000000001a
(XEN) r12: ffff830919aafe98   r13: 0000000000000003   r14: ffff83091996ce40
(XEN) r15: ffff830919aafe18   cr0: 000000008005003b   cr4: 00000000000026f0
(XEN) cr3: 00000009199b0000   cr2: 00000000e8da6fe8
(XEN) ds: 007b   es: 007b   fs: 00d8   gs: 0033   ss: 0000   cs: e008
(XEN) Xen stack trace from rsp=ffff830919aafcf8:
(XEN)    ffff82c48012422a ffff83092f508000 ffff830919aafd48 00ff82c400000003
(XEN)    ffff830900000003 0000000000000010 0000000000000020 0000007000020056
(XEN)    ffff830821aa9f60 0000000400000000 000000000000001a 0000000400000072
(XEN)    000000000000001a 00000000000dd6a0 00000000000dd6a0 00000000dd6a0000
(XEN)    00000000dd6a0000 ffff83092f46c4b8 0000000000000202 ffff830919aafda8
(XEN)    ffff82c48012419f ffff830919aafe98 ffff830919708000 0000000000000056
(XEN)    000000000000005a 00000000ffffffed ffff830919aafe48 ffff82c480163850
(XEN)    0000000000000001 0000000000000000 0000000000000158 000000000000005a
(XEN)    0000000000000168 ffff830919c05a80 ffff83091996ce40 ffff830919aafe28
(XEN)    ffff82c48012419f ffff830919708000 ffff830919aafe98 000000000a0fa004
(XEN)    0000000000000056 000000000000005a ffff830919aafef8 ffff82c4802121d0
(XEN)    ffff830919aafe68 ffff82c48020b5bf 0000000000000001 ffffffffffffffff
(XEN)    000000d000000004 dd6a000000000000 ffff830900000000 ffff8300ceeea1f8
(XEN)    000000d000000004 000000000000005a 00000000dd6a0000 aaaaaaaaaaaaaaaa
(XEN)    aaaaaaaaaaaaaaaa aaaaaaaaaaaaaaaa ffff8300ceeea000 ffff8300ceeea000
(XEN)    0000000000000000 0000000000000000 0000000000000000 0000000000000000
(XEN)    00007cf6e65500c7 ffff82c480214ec1 00000000c0101427 0000000000000021
(XEN)    0000000000000000 0000000000000000 0000000000000000 0000000000000000
(XEN)    00000000edab3ed4 000000000000000d 0000000000000000 0000000000000000
(XEN)    0000000000000000 0000000000000000 0000000000000021 000000000a0fa004
(XEN) Xen call trace:
(XEN)    [<ffff82c480161a08>] pci_enable_msi+0x464/0x960
(XEN)    [<ffff82c480163850>] map_domain_pirq+0x20f/0x309
(XEN)    [<ffff82c4802121d0>] compat_physdev_op+0x9e0/0x1420
(XEN)    [<ffff82c480214ec1>] compat_hypercall+0xa1/0xfa
(XEN)
(XEN) Xen WARN at msi.c:648
(XEN) ----[ Xen-4.1.0.rc2.pre  x86_64  debug=y  Not tainted ]----
(XEN) CPU:    7
(XEN) RIP:    e008:[<ffff82c480161a8c>] pci_enable_msi+0x4e8/0x960
(XEN) RFLAGS: 0000000000010246   CONTEXT: hypervisor
(XEN) rax: 0000000000000000   rbx: 0000000000002003   rcx: 0000000000000001
(XEN) rdx: 0000000000000000   rsi: 0000000000000246   rdi: ffff82c48025bc40
(XEN) rbp: ffff830919aafdc8   rsp: ffff830919aafcf8   r8:  000000000000001a
(XEN) r9:  000000000000003f   r10: 0000000000000072   r11: 000000000000001a
(XEN) r12: ffff830919aafe98   r13: 0000000000000003   r14: ffff83091996ce40
(XEN) r15: ffff830919aafe18   cr0: 000000008005003b   cr4: 00000000000026f0
(XEN) cr3: 00000009199b0000   cr2: 00000000e8da6fe8
(XEN) ds: 007b   es: 007b   fs: 00d8   gs: 0033   ss: 0000   cs: e008
(XEN) Xen stack trace from rsp=ffff830919aafcf8:
(XEN)    ffff82c48012422a ffff83092f508000 ffff830919aafd48 00ff82c400000003
(XEN)    ffff830900000003 0000000000000010 0000000000000020 0000007000020056
(XEN)    ffff830821aa9f60 0000000400000000 000000000000001a 0000000400000072
(XEN)    000000000000001a 00000000000dd6a0 00000000000dd6a0 00000000dd6a0000
(XEN)    00000000dd6a0000 ffff83092f46c4b8 0000000000000202 ffff830919aafda8
(XEN)    ffff82c48012419f ffff830919aafe98 ffff830919708000 0000000000000056
(XEN)    000000000000005a 00000000ffffffed ffff830919aafe48 ffff82c480163850
(XEN)    0000000000000001 0000000000000000 0000000000000158 000000000000005a
(XEN)    0000000000000168 ffff830919c05a80 ffff83091996ce40 ffff830919aafe28
(XEN)    ffff82c48012419f ffff830919708000 ffff830919aafe98 000000000a0fa004
(XEN)    0000000000000056 000000000000005a ffff830919aafef8 ffff82c4802121d0
(XEN)    ffff830919aafe68 ffff82c48020b5bf 0000000000000001 ffffffffffffffff
(XEN)    000000d000000004 dd6a000000000000 ffff830900000000 ffff8300ceeea1f8
(XEN)    000000d000000004 000000000000005a 00000000dd6a0000 aaaaaaaaaaaaaaaa
(XEN)    aaaaaaaaaaaaaaaa aaaaaaaaaaaaaaaa ffff8300ceeea000 ffff8300ceeea000
(XEN)    0000000000000000 0000000000000000 0000000000000000 0000000000000000
(XEN)    00007cf6e65500c7 ffff82c480214ec1 00000000c0101427 0000000000000021
(XEN)    0000000000000000 0000000000000000 0000000000000000 0000000000000000
(XEN)    00000000edab3ed4 000000000000000d 0000000000000000 0000000000000000
(XEN)    0000000000000000 0000000000000000 0000000000000021 000000000a0fa004
(XEN) Xen call trace:
(XEN)    [<ffff82c480161a8c>] pci_enable_msi+0x4e8/0x960
(XEN)    [<ffff82c480163850>] map_domain_pirq+0x20f/0x309
(XEN)    [<ffff82c4802121d0>] compat_physdev_op+0x9e0/0x1420
(XEN)    [<ffff82c480214ec1>] compat_hypercall+0xa1/0xfa
(XEN)


Similar problems have been reported also in the bugzilla bug 1742:

http://bugzilla.xensource.com/bugzilla/show_bug.cgi?id=1742

Do you have any ideas on the cause of the issue?

Cheers,

Stefano
_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-devel
<Prev in Thread] Current Thread [Next in Thread>