[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[Xen-devel] Re: VF passthrough problems



>>> On 18.02.11 at 14:36, Stefano Stabellini <stefano.stabellini@xxxxxxxxxxxxx>
wrote:
> I am having reports of PCI passthrough problems with SR-IOV, in
> particular it looks like we are hitting the warning at msi:635 and
> msi:648 in xen; see the following log:
> 
> (XEN) [VT-D]iommu.c:1785: VT-d page table not sharing with EPT table
> xenbus dev backend/vbd/1/5696 error 6 opening device
> (XEN) PCI add Virtual Function 04:1a.0
> (XEN) HVM1: HVM Loader
> (XEN) HVM1: Detected Xen v4.1.0.rc2.pre
> (XEN) HVM1: CPU speed is 2660 MHz
> (XEN) HVM1: Xenbus rings @0xfeffc000, event channel 2
> (XEN) irq.c:258: Dom1 PCI link 0 changed 0 -> 5
> (XEN) HVM1: PCI-ISA link 0 routed to IRQ5
> (XEN) irq.c:258: Dom1 PCI link 1 changed 0 -> 10
> (XEN) HVM1: PCI-ISA link 1 routed to IRQ10
> (XEN) irq.c:258: Dom1 PCI link 2 changed 0 -> 11
> (XEN) HVM1: PCI-ISA link 2 routed to IRQ11
> (XEN) irq.c:258: Dom1 PCI link 3 changed 0 -> 5
> (XEN) HVM1: PCI-ISA link 3 routed to IRQ5
> (XEN) HVM1: pci dev 01:2 INTD->IRQ5
> (XEN) HVM1: pci dev 01:3 INTA->IRQ10
> (XEN) HVM1: pci dev 02:0 INTA->IRQ11
> (XEN) HVM1: pci dev 03:0 INTC->IRQ10
> (XEN) HVM1: pci dev 04:0 INTA->IRQ5
> (XEN) HVM1: pci dev 02:0 bar 10 size 02000000: f0000008
> (XEN) HVM1: pci dev 03:0 bar 14 size 01000000: f2000008
> (XEN) HVM1: pci dev 05:0 bar 10 size 00004000: f3000004
> (XEN) domctl.c:982:d0 memory_map:add: gfn=f3000 mfn=dd5a0 nr_mfns=4
> (XEN) domctl.c:982:d0 memory_map:add: gfn=f3004 mfn=dd6a0 nr_mfns=4
> (XEN) domctl.c:992:d0 memory_map:remove: gfn=f3004 mfn=dd6a0 nr_mfns=1
> (XEN) HVM1: pci dev 05:0 bar 1c size 00004000: f3004004
> (XEN) HVM1: pci dev 02:0 bar 14 size 00001000: f3008000
> (XEN) HVM1: pci dev 03:0 bar 10 size 00000100: 0000c001
> (XEN) HVM1: pci dev 04:0 bar 10 size 00000100: 0000c101
> (XEN) HVM1: pci dev 04:0 bar 14 size 00000100: f3009000
> (XEN) HVM1: pci dev 01:2 bar 20 size 00000020: 0000c201
> (XEN) HVM1: pci dev 01:1 bar 20 size 00000010: 0000c221
> (XEN) HVM1: Multiprocessor initialisation:
> (XEN) HVM1:  - CPU0 ... 40-bit phys ... fixed MTRRs ... var MTRRs [2/8] ...
> done.
> (XEN) HVM1: Testing HVM environment:
> (XEN) HVM1:  - REP INSB across page boundaries ... passed
> (XEN) HVM1:  - GS base MSRs and SWAPGS ... passed
> (XEN) HVM1: Passed 2 of 2 tests
> (XEN) HVM1: Writing SMBIOS tables ...
> (XEN) HVM1: Loading ROMBIOS ...
> (XEN) HVM1: 9628 bytes of ROMBIOS high-memory extensions:
> (XEN) HVM1:   Relocating to 0xfc000000-0xfc00259c ... done
> (XEN) HVM1: Creating MP tables ...
> (XEN) HVM1: Loading Cirrus VGABIOS ...
> (XEN) HVM1: Loading PCI Option ROM ...
> (XEN) HVM1:  - Manufacturer: http://etherboot.org 
> (XEN) HVM1:  - Product name: gPXE
> [root@localhost bug-report-20110217180212]# (XEN) HVM1: Loading ACPI ...
> (XEN) HVM1:  - Lo data: 000ea020-000ea04f
> (XEN) HVM1:  - Hi data: fc002800-fc01293f
> (XEN) HVM1: vm86 TSS at fc012c00
> (XEN) HVM1: BIOS map:
> (XEN) HVM1:  c0000-c8fff: VGA BIOS
> (XEN) HVM1:  c9000-d6fff: Etherboot ROM
> (XEN) HVM1:  eb000-eb193: SMBIOS tables
> (XEN) HVM1:  f0000-fffff: Main BIOS
> (XEN) HVM1: E820 table:
> (XEN) HVM1:  [00]: 00000000:00000000 - 00000000:0009e000: RAM
> (XEN) HVM1:  [01]: 00000000:0009e000 - 00000000:0009fc00: RESERVED
> (XEN) HVM1:  [02]: 00000000:0009fc00 - 00000000:000a0000: RESERVED
> (XEN) HVM1:  HOLE: 00000000:000a0000 - 00000000:000e0000
> (XEN) HVM1:  [03]: 00000000:000e0000 - 00000000:00100000: RESERVED
> (XEN) HVM1:  [04]: 00000000:00100000 - 00000000:2ec00000: RAM
> (XEN) HVM1:  HOLE: 00000000:2ec00000 - 00000000:fc000000
> (XEN) HVM1:  [05]: 00000000:fc000000 - 00000001:00000000: RESERVED
> (XEN) HVM1: Invoking ROMBIOS ...
> (XEN) HVM1: $Revision: 1.221 $ $Date: 2008/12/07 17:32:29 $
> (XEN) stdvga.c:147:d1 entering stdvga and caching modes
> (XEN) HVM1: VGABios $Id: vgabios.c,v 1.67 2008/01/27 09:44:12 vruppert Exp $
> (XEN) HVM1: Processor 1: Xen(R) Virtual CPU
> (XEN) HVM1: ata0-0: PCHS=16383/16/63 translation=lba LCHS=1024/255/63
> (XEN) HVM1: XS Virtual IDE Controller      Hard Drive (8192MB)
> (XEN) HVM1: IDE time out
> (XEN) HVM1: XS Virtual ATAPI-4             CD-Rom/DVD-Rom
> (XEN) HVM1:
> (XEN) HVM1:
> (XEN) HVM1:
> (XEN) HVM1: Press F12 for boot menu.
> (XEN) HVM1:
> (XEN) HVM1: Boot device: CD-Romata_is_ready returned 1
> (XEN) HVM1:  - failure: could not read boot disk
> (XEN) HVM1:
> (XEN) HVM1: Boot device: Hard Drive - success.
> (XEN) HVM1: Booting from 0000:7c00
> (XEN) HVM1: int13_harddisk: function 41, unmapped device for ELDL=81
> (XEN) HVM1: int13_harddisk: function 08, unmapped device for ELDL=81
> (XEN) HVM1: *** int 15h function AX=00c0, BX=0000 not yet supported!
> (XEN) HVM1: int13_harddisk: function 15, unmapped device for ELDL=81
> (XEN) HVM1: KBD: unsupported int 16h function 03
> (XEN) HVM1: int13_harddisk: function 15, unmapped device for ELDL=81
> (XEN) HVM1: *** int 15h function AX=e980, BX=e6f5 not yet supported!
> (XEN) HVM1: int13_harddisk: function 02, unmapped device for ELDL=81
> (XEN) HVM1: int13_harddisk: function 41, unmapped device for ELDL=81
> (XEN) irq.c:258: Dom1 PCI link 0 changed 5 -> 0
> (XEN) irq.c:258: Dom1 PCI link 1 changed 10 -> 0
> (XEN) irq.c:258: Dom1 PCI link 2 changed 11 -> 0
> (XEN) irq.c:258: Dom1 PCI link 3 changed 5 -> 0
> (XEN) irq.c:324: Dom1 callback via changed to PCI INTx Dev 0x03 IntC
> (XEN) Xen WARN at msi.c:635
> (XEN) ----[ Xen-4.1.0.rc2.pre  x86_64  debug=y  Not tainted ]----
> (XEN) CPU:    7
> (XEN) RIP:    e008:[<ffff82c480161a08>] pci_enable_msi+0x464/0x960
> (XEN) RFLAGS: 0000000000010206   CONTEXT: hypervisor
> (XEN) rax: 0000000000000000   rbx: 00000000dd6a0000   rcx: 0000000000000001
> (XEN) rdx: ffff82c48025bc40   rsi: 0000000000000246   rdi: ffff82c48025bc40
> (XEN) rbp: ffff830919aafdc8   rsp: ffff830919aafcf8   r8:  000000000000001a
> (XEN) r9:  000000000000003f   r10: 0000000000000072   r11: 000000000000001a
> (XEN) r12: ffff830919aafe98   r13: 0000000000000003   r14: ffff83091996ce40
> (XEN) r15: ffff830919aafe18   cr0: 000000008005003b   cr4: 00000000000026f0
> (XEN) cr3: 00000009199b0000   cr2: 00000000e8da6fe8
> (XEN) ds: 007b   es: 007b   fs: 00d8   gs: 0033   ss: 0000   cs: e008
> (XEN) Xen stack trace from rsp=ffff830919aafcf8:
> (XEN)    ffff82c48012422a ffff83092f508000 ffff830919aafd48 00ff82c400000003
> (XEN)    ffff830900000003 0000000000000010 0000000000000020 0000007000020056
> (XEN)    ffff830821aa9f60 0000000400000000 000000000000001a 0000000400000072
> (XEN)    000000000000001a 00000000000dd6a0 00000000000dd6a0 00000000dd6a0000
> (XEN)    00000000dd6a0000 ffff83092f46c4b8 0000000000000202 ffff830919aafda8
> (XEN)    ffff82c48012419f ffff830919aafe98 ffff830919708000 0000000000000056
> (XEN)    000000000000005a 00000000ffffffed ffff830919aafe48 ffff82c480163850
> (XEN)    0000000000000001 0000000000000000 0000000000000158 000000000000005a
> (XEN)    0000000000000168 ffff830919c05a80 ffff83091996ce40 ffff830919aafe28
> (XEN)    ffff82c48012419f ffff830919708000 ffff830919aafe98 000000000a0fa004
> (XEN)    0000000000000056 000000000000005a ffff830919aafef8 ffff82c4802121d0
> (XEN)    ffff830919aafe68 ffff82c48020b5bf 0000000000000001 ffffffffffffffff
> (XEN)    000000d000000004 dd6a000000000000 ffff830900000000 ffff8300ceeea1f8
> (XEN)    000000d000000004 000000000000005a 00000000dd6a0000 aaaaaaaaaaaaaaaa
> (XEN)    aaaaaaaaaaaaaaaa aaaaaaaaaaaaaaaa ffff8300ceeea000 ffff8300ceeea000
> (XEN)    0000000000000000 0000000000000000 0000000000000000 0000000000000000
> (XEN)    00007cf6e65500c7 ffff82c480214ec1 00000000c0101427 0000000000000021
> (XEN)    0000000000000000 0000000000000000 0000000000000000 0000000000000000
> (XEN)    00000000edab3ed4 000000000000000d 0000000000000000 0000000000000000
> (XEN)    0000000000000000 0000000000000000 0000000000000021 000000000a0fa004
> (XEN) Xen call trace:
> (XEN)    [<ffff82c480161a08>] pci_enable_msi+0x464/0x960
> (XEN)    [<ffff82c480163850>] map_domain_pirq+0x20f/0x309
> (XEN)    [<ffff82c4802121d0>] compat_physdev_op+0x9e0/0x1420
> (XEN)    [<ffff82c480214ec1>] compat_hypercall+0xa1/0xfa
> (XEN)
> (XEN) Xen WARN at msi.c:648
> (XEN) ----[ Xen-4.1.0.rc2.pre  x86_64  debug=y  Not tainted ]----
> (XEN) CPU:    7
> (XEN) RIP:    e008:[<ffff82c480161a8c>] pci_enable_msi+0x4e8/0x960
> (XEN) RFLAGS: 0000000000010246   CONTEXT: hypervisor
> (XEN) rax: 0000000000000000   rbx: 0000000000002003   rcx: 0000000000000001
> (XEN) rdx: 0000000000000000   rsi: 0000000000000246   rdi: ffff82c48025bc40
> (XEN) rbp: ffff830919aafdc8   rsp: ffff830919aafcf8   r8:  000000000000001a
> (XEN) r9:  000000000000003f   r10: 0000000000000072   r11: 000000000000001a
> (XEN) r12: ffff830919aafe98   r13: 0000000000000003   r14: ffff83091996ce40
> (XEN) r15: ffff830919aafe18   cr0: 000000008005003b   cr4: 00000000000026f0
> (XEN) cr3: 00000009199b0000   cr2: 00000000e8da6fe8
> (XEN) ds: 007b   es: 007b   fs: 00d8   gs: 0033   ss: 0000   cs: e008
> (XEN) Xen stack trace from rsp=ffff830919aafcf8:
> (XEN)    ffff82c48012422a ffff83092f508000 ffff830919aafd48 00ff82c400000003
> (XEN)    ffff830900000003 0000000000000010 0000000000000020 0000007000020056
> (XEN)    ffff830821aa9f60 0000000400000000 000000000000001a 0000000400000072
> (XEN)    000000000000001a 00000000000dd6a0 00000000000dd6a0 00000000dd6a0000
> (XEN)    00000000dd6a0000 ffff83092f46c4b8 0000000000000202 ffff830919aafda8
> (XEN)    ffff82c48012419f ffff830919aafe98 ffff830919708000 0000000000000056
> (XEN)    000000000000005a 00000000ffffffed ffff830919aafe48 ffff82c480163850
> (XEN)    0000000000000001 0000000000000000 0000000000000158 000000000000005a
> (XEN)    0000000000000168 ffff830919c05a80 ffff83091996ce40 ffff830919aafe28
> (XEN)    ffff82c48012419f ffff830919708000 ffff830919aafe98 000000000a0fa004
> (XEN)    0000000000000056 000000000000005a ffff830919aafef8 ffff82c4802121d0
> (XEN)    ffff830919aafe68 ffff82c48020b5bf 0000000000000001 ffffffffffffffff
> (XEN)    000000d000000004 dd6a000000000000 ffff830900000000 ffff8300ceeea1f8
> (XEN)    000000d000000004 000000000000005a 00000000dd6a0000 aaaaaaaaaaaaaaaa
> (XEN)    aaaaaaaaaaaaaaaa aaaaaaaaaaaaaaaa ffff8300ceeea000 ffff8300ceeea000
> (XEN)    0000000000000000 0000000000000000 0000000000000000 0000000000000000
> (XEN)    00007cf6e65500c7 ffff82c480214ec1 00000000c0101427 0000000000000021
> (XEN)    0000000000000000 0000000000000000 0000000000000000 0000000000000000
> (XEN)    00000000edab3ed4 000000000000000d 0000000000000000 0000000000000000
> (XEN)    0000000000000000 0000000000000000 0000000000000021 000000000a0fa004
> (XEN) Xen call trace:
> (XEN)    [<ffff82c480161a8c>] pci_enable_msi+0x4e8/0x960
> (XEN)    [<ffff82c480163850>] map_domain_pirq+0x20f/0x309
> (XEN)    [<ffff82c4802121d0>] compat_physdev_op+0x9e0/0x1420
> (XEN)    [<ffff82c480214ec1>] compat_hypercall+0xa1/0xfa
> (XEN)
> 
> 
> Similar problems have been reported also in the bugzilla bug 1742:
> 
> http://bugzilla.xensource.com/bugzilla/show_bug.cgi?id=1742 
> 
> Do you have any ideas on the cause of the issue?

See the thread "Comments on Xen bug 1732" (starting at
http://lists.xensource.com/archives/html/xen-devel/2011-01/msg02083.html).

Iirc, according to what was discussed there, the warnings do not
imply any loss of functionality.

Jan

_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-devel


 


Rackspace

Lists.xenproject.org is hosted with RackSpace, monitoring our
servers 24x7x365 and backed by RackSpace's Fanatical Support®.