[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [Xen-devel] Re: [Xen-users] wiki page on 10G SRIOV



I am using Ethernet Server Adapater X520 - DA2 (E10G42BTDA) Card.
Â
For the Device Id 0x10FB, I was able to see all the 64 Virtual Functions, when I run lspci command.
But when the Device ID started showing 0x10D8, I cannot see any Virtual Functions, when I run lspci command.
On Mon, Jul 19, 2010 at 2:35 PM, Rose, Gregory V <gregory.v.rose@xxxxxxxxx> wrote:

If you have an 82599EB that is using 10D8h for the Virtual Function Device ID then the adapter is a very old, preproduction version or else the correct EEPROM image has been over-written with an invalid image. The correct Device ID value for an 82599EB virtual function is 10EDh.

Â

- Greg

Â

From: xen-devel-bounces@xxxxxxxxxxxxxxxxxxx [mailto:xen-devel-bounces@xxxxxxxxxxxxxxxxxxx] On Behalf Of Byrne, John (HP Labs)
Sent: Monday, July 19, 2010 2:22 PM
To: kishore kumar
Cc: xen-devel@xxxxxxxxxxxxxxxxxxx; wangalalei; xen-users@xxxxxxxxxxxxxxxxxxx
Subject: RE: [Xen-devel] Re: [Xen-users] wiki page on 10G SRIOV

Â

Iâm a bit confused with your device IDs. The 10fb device is the PCI id for the physical NIC; the 10d8 device is the SRIOV Virtual Function device created by the driver. ÂWith the latest xen-unstable, I have successfully used this NIC to create and assign the VF devices to HVM guests. The ixgbevf driver, which binds to the VF devices, expects device id 0x10ed. I simply assumed that the driver was not quite up to date and tweaked things to work. ÂSo, if you are just a bit confused, the following might help.

Â

I added the following in my modprobe.d directory to create four VF devices (ixgbe.conf, attached):

Â

options ixgbe max_vfs=4

Â

So, on my machine, I can see the physical NIC and the 4 VFs created.

Â

lspci ân | grep 0a:

0a:00.0 0200: 8086:10fb (rev 01)

0a:10.0 0200: 8086:10d8 (rev 01)

0a:10.2 0200: 8086:10d8 (rev 01)

0a:10.4 0200: 8086:10d8 (rev 01)

0a:10.6 0200: 8086:10d8 (rev 01)

Â

I added the ixgbevf driver to both my dom0 and domUs. While it is a simple tweak to add the device id to the driver, I decided to play with modprobe instead and added the following to my modprobe.d directory in both dom0 and domU (ixgbvevf.conf, attached):

Â

install ixgbevf /sbin/modprobe --ignore-install ixgbevf; echo "0x8086 0x10d8" >/

sys/bus/pci/drivers/ixgbevf/new_id

Â

If you are working with HVM guests, there has to be a patch to Âqemu as well. (Attached) ÂYou also have to add â(pci-passthrough-strict-check no)â to your xend-config.sxp. (I donât think you need the xend-config change for PV guests.)

Â

Then it is simply a matter of adding the VF PCI devices to your domU configurations and configuring the ixgbevf devices in the guests.

Â

Both the ixgbe and ixgbevf drivers will generate random MAC addresses for the devices. What I wanted to do was to set the MAC addresses for the VF devices in dom0 and then my guestsâ networking configuration was much easier. The physical NIC must be up. It doesnât have to have an IP address, but if it isnât up the MAC address set in dom0 will be lost. Iâve attached my dom0 rc.local where I set the MAC addresses and assign the devices to pciback.

Â

I canât swear that this is the best way to do this, but this did work.

Â

John Byrne

Â

Â

From: xen-devel-bounces@xxxxxxxxxxxxxxxxxxx [mailto:xen-devel-bounces@xxxxxxxxxxxxxxxxxxx] On Behalf Of kishore kumar
Sent: Monday, July 19, 2010 10:16 AM
To: Pasi KÃrkkÃinen; xen-devel@xxxxxxxxxxxxxxxxxxx
Cc: wangalalei; xen-users@xxxxxxxxxxxxxxxxxxx
Subject: [Xen-devel] Re: [Xen-users] wiki page on 10G SRIOV

Â


Hello Everyone,

Â

I am facing a strange issue with my 10G 82599 PCIe device.

Â

The Device Id has to be 0x10FB for SRIOV to function properly, But all of sudden the Device IDÂstarted showing me as 0x10D8, and because of this the SRIOV feature is not working and I cannot assign the Virtual Function to my guest.

Â

When I did lspci command it is showing me as Intel Corporation Unknown device 10d8 (rev 01). Previously it was showing me Intel Corporation 82599EB Gigabit Networking with 10FB, and I was able to assign the Virtual Function to my guest.

Â

I googled and found out that the device ID 0x10D8 is a 82599 Unprogrammed device.

Â

Can any one please let me know what is happening here and how to recover back from this?

I am totally blocked for 2 days because of this issue.

Â

Thank You.

On Fri, Jul 16, 2010 at 1:05 AM, Pasi KÃrkkÃinen <pasik@xxxxxx> wrote:

On Fri, Jul 16, 2010 at 02:17:30AM +0000, wangalalei wrote:
> Â Âhi all:
>
> Â Â Â i read intel 82576 card datasheet,and finding it saying that the 82576
> Â Âcan set the vf's bandwidth,
> Â Âbut when i test this card,i can not find any parameter to it
> Â Â Â any one else notice this problem? or anyone knows whether the 82576
> Â Âcard can control its vf's bandwidth?
>

I think bandwidth management is a work-in-progress by Intel..

-- Pasi


> Â Âalaleiwang
>
> Â Â--------------------------------------------------------------------------
>
> Â ÂDate: Thu, 15 Jul 2010 18:35:57 -0700
> Â ÂSubject: Re: [Xen-users] wiki page on 10G SRIOV
> Â ÂFrom: bodkekumar@xxxxxxxxx
> Â ÂTo: pasik@xxxxxx
> Â ÂCC: xen-users@xxxxxxxxxxxxxxxxxxx
>
> Â ÂYeah, I configured 64 Virtual Functions in DOM-0 Âand passthru 1 VF to
> Â Âassign it to the guest. ÂIt worked for me.
>
> Â ÂI assign static IP to my guest and tried to ping the remote machine. It
> Â Âworked for me.
>
> Â ÂBut I am wondering that ping to DOM-0 from guest makes any sense here?
> Â ÂCan you let me know on this? Âping worked though from guest to DOM-0 as
> Â Âwell.
>

> Â ÂOn Thu, Jul 15, 2010 at 1:11 PM, Pasi KÃârkkÃâinen <[1]pasik@xxxxxx>

> Â Âwrote:
>
> Â Â ÂOn Thu, Jun 24, 2010 at 10:56:28AM -0700, kishore kumar wrote:
> Â Â Â> Â ÂHi All,
> Â Â Â>
> Â Â Â> Â ÂCan any one please let me know if there is a WIKI page which talks
> Â Â Âabout
> Â Â Â> Â Âhow to configure SRIOV in Xen and use Physical Functions Âand
> Â Â ÂVirtual
> Â Â Â> Â ÂFunctions ?
> Â Â Â>
> Â Â Â> Â ÂI searched xen wiki, but could not find.
> Â Â Â>
>
> Â Â ÂEach virtual function should be a separate PCI device, so you can
> Â Â Âpassthru
> Â Â Âthem like any other normal PCI device.
>
> Â Â ÂDid you get it to work?
> Â Â Â-- Pasi
>

> Â Â--------------------------------------------------------------------------
>
>  ÂÃ**ÃâÂ+Ã**ÃÅÂ+Ã*ÂàÃ*ÂÃÅ*ÃÅÂÃ*ÅÃ*ÂÃÅÅ,Ã**Ã*ÂMSNÃÅÂÃÅ Ã**ÃÂ*!
> Â Â[2]ÃÂ*Ã*ÂÃÅ*ÃÅÅÃÅ*

>
> References
>
> Â ÂVisible links
> Â Â1. mailto:pasik@xxxxxx

> Â Â2. http://3g.msn.cn/

Â


_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-devel

 


Rackspace

Lists.xenproject.org is hosted with RackSpace, monitoring our
servers 24x7x365 and backed by RackSpace's Fanatical Support®.