WARNING - OLD ARCHIVES

This is an archived copy of the Xen.org mailing list, which we have preserved to ensure that existing links to archives are not broken. The live archive, which contains the latest emails, can be found at http://lists.xen.org/
   
 
 
Xen 
 
Home Products Support Community News
 
   
 

xen-devel

Re: [Xen-devel] Intel S3420GPLX VT-d VF question

To: Konrad Rzeszutek Wilk <konrad.wilk@xxxxxxxxxx>
Subject: Re: [Xen-devel] Intel S3420GPLX VT-d VF question
From: "Michael A. Collins" <mike@xxxxxxxxxxx>
Date: Wed, 08 Dec 2010 12:12:27 -0500
Cc: xen-devel@xxxxxxxxxxxxxxxxxxx
Delivery-date: Thu, 09 Dec 2010 01:23:49 -0800
Envelope-to: www-data@xxxxxxxxxxxxxxxxxxx
In-reply-to: <20101208163217.GA18739@xxxxxxxxxxxx>
List-help: <mailto:xen-devel-request@lists.xensource.com?subject=help>
List-id: Xen developer discussion <xen-devel.lists.xensource.com>
List-post: <mailto:xen-devel@lists.xensource.com>
List-subscribe: <http://lists.xensource.com/mailman/listinfo/xen-devel>, <mailto:xen-devel-request@lists.xensource.com?subject=subscribe>
List-unsubscribe: <http://lists.xensource.com/mailman/listinfo/xen-devel>, <mailto:xen-devel-request@lists.xensource.com?subject=unsubscribe>
References: <30410a64d335f82097af217b0ed7d060@xxxxxxxxxxxxxxxx> <20101208163217.GA18739@xxxxxxxxxxxx>
Sender: xen-devel-bounces@xxxxxxxxxxxxxxxxxxx
User-agent: Roundcube Webmail/0.4.2
On Wed, 8 Dec 2010 11:32:18 -0500, Konrad Rzeszutek Wilk <konrad.wilk@xxxxxxxxxx> wrote:
On Tue, Dec 07, 2010 at 11:52:24PM -0500, Michael A. Collins wrote:
I have successfully booted xen on Fedora 14 x86_64 with iommu=force

Ok.. Um, what Fedora kernel are we taking about here? Do you have
the full serial log?
on the kernel line, I can unbind a pci device and rebind to pci-stub
and see it with xm pci-list-assignable-devices.  That's cool.  Now I
have an Intel 82576 dual-port ET Adapter that supports SR-IOV and
started configuring everything to enable it's virtual functions:
added pci_pt_e820_access=on to the module line that contains the
vmlinuz

Why? It doesn't automatically load without that parameter?
created igb.conf under /etc/modprobe.d with options igb max_vfs=7
added blacklist igbvf to /etc/modprobe.d/blacklist.conf

Why blacklist it?

I was under the impression that I should see some kind of message
about MMCONFIG in xm dmesg, but there isn't anything.  I do a xm
dmesg | grep -i pci and it finds nothing with MMCONFIG.  I guess my

Huh? Why? Do you see the 7 ethernet PCI device being created?

next question is what do I do next?  How do I troubleshoot further?

What are you trying to troubleshoot? Did you lspci output change
after you loaded the igbvf?

Below is the VT-d messages from xm dmesg:
(XEN) Intel VT-d Snoop Control supported.
(XEN) Intel VT-d DMA Passthrough not supported.
(XEN) Intel VT-d Queued Invalidation supported.
(XEN) Intel VT-d Interrupt Remapping not supported.

Does MMCONFIG have something to do with the fact the Interrupt
Remapping not supported message is displayed?

No. It just means your VT-D chipset does not support interrupt
remapping.

Mike

_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-devel

_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-devel


I didn't know if this actually made it on the list, since it didn't show up in my inbox when I sent it, so the second email from me is a duplicate. Sorry.

The kernel I am using is myoung's pre-built rpm from http://myoung.fedorapeople.org/dom0/x86_64/kernel-2.6.32.26-174.2.xendom0.fc12.x86_64.rpm. I am also using the 4.0.1 rpms from http://pasik.reaktio.net/fedora/xen-4.0.1-6.fc14.src.rpm. I am following the instructions from http://wiki.xen.org/xenwiki/Fedora13Xen4Tutorial.

The pci_pt_e820_access=on setting was taken from the following blog: http://blogs.oracle.com/wim/2010/10/playing_with_sr_iov_in_oracle.html. I was under the impression that that option had to be set for the VFs to be seen by the kernel. I have not tried it without, but will do that tonight. The blacklist settings was referenced in the above article, so I stuck it in. I will try to load the igbvf tonight as well.

I do not see the 7 Virtual Functions in lspci.

Thanks for the reply, I will try without the e820 option and loading the igbvf module tonight if that works, I'll let you know. If not, I'll respond with the full xen dmesg output.
Mike

_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-devel