WARNING - OLD ARCHIVES

This is an archived copy of the Xen.org mailing list, which we have preserved to ensure that existing links to archives are not broken. The live archive, which contains the latest emails, can be found at http://lists.xen.org/
   
 
 
Xen 
 
Home Products Support Community News
 
   
 

xen-users

Re: [Xen-users] 10Gbit ethernet NIC gives slow throughput

To: fabi.a169@xxxxxxxxx
Subject: Re: [Xen-users] 10Gbit ethernet NIC gives slow throughput
From: Pasi Kärkkäinen <pasik@xxxxxx>
Date: Mon, 22 Dec 2008 20:42:42 +0200
Cc: xen-users@xxxxxxxxxxxxxxxxxxx
Delivery-date: Mon, 22 Dec 2008 10:43:26 -0800
Envelope-to: www-data@xxxxxxxxxxxxxxxxxxx
In-reply-to: <494FD2E5.30601@xxxxxxxxx>
List-help: <mailto:xen-users-request@lists.xensource.com?subject=help>
List-id: Xen user discussion <xen-users.lists.xensource.com>
List-post: <mailto:xen-users@lists.xensource.com>
List-subscribe: <http://lists.xensource.com/mailman/listinfo/xen-users>, <mailto:xen-users-request@lists.xensource.com?subject=subscribe>
List-unsubscribe: <http://lists.xensource.com/mailman/listinfo/xen-users>, <mailto:xen-users-request@lists.xensource.com?subject=unsubscribe>
References: <b42ab6100812220836x17f461ebj1f5802c9bb92f60b@xxxxxxxxxxxxxx> <20081222171409.GK15052@xxxxxxxxxxxxxxx> <494FD2E5.30601@xxxxxxxxx>
Sender: xen-users-bounces@xxxxxxxxxxxxxxxxxxx
User-agent: Mutt/1.5.13 (2006-08-11)
On Mon, Dec 22, 2008 at 06:48:21PM +0100, fabi.a169@xxxxxxxxx wrote:
> Pasi Kärkkäinen wrote:
> >On Mon, Dec 22, 2008 at 05:36:40PM +0100, fabi.a169@xxxxxxxxx wrote:
> >  
> >>Hello,
> >>
> >>I would like to use a server having myricom 10gbit ethernet interfaces
> >>(driver myri10ge) for Xen. But between dom0s (no domU running), I get 
> >>only a
> >>throughput of about 2.3Gbit/s (I use Xen 3.2 with the 2.6.18 kernel and
> >>debian in dom0), whether xend is running or not.  However, on linux kernel
> >>with the same version but without xen patch, I get more than 6Gbit/s.
> >>Clearly, with Xen, the CPU is not the bottleneck, beeing used at much less
> >>than 100%.
> >>
> >>Does anybody have experiences with Xen and 10Gbit ethernet ?
> >>
> >>    
> >
> >With Xen, are you using bridged networking? 
> >
> >The default network configuration in Xen creates virtual ethernet 
> >interface called
> >'eth0', which is bridged to the real NIC (which is renamed to peth0).
> >
> >So, when making comparisons, make sure you're using the actual physical 
> >interface. 
> >Dunno if there's something to optimize in the bridge-setup.. have you done
> >all the normal optimizations? txqueuelen for all interfaces (including vif
> >interfaces), tcp window sizes etc.
> >
> >-- Pasi
> >
> >  
> I don't even use the brigdes, for example without starting xend. Also, 
> when I measure throughput on the loopback interface, I get the same 
> throughput bounded to 2.29 Gbps. There should be something bounding 
> everything to this value, maybe related to the vcpus. If I send for 
> example 2 flows in parallel, I get the double of this throughput.

OK. 

I'm wondering if that could be caused by Xen scheduling timeslices or
something like that.. 

You might want to ask about this issue from xen-devel list. 

-- Pasi

_______________________________________________
Xen-users mailing list
Xen-users@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-users

<Prev in Thread] Current Thread [Next in Thread>