WARNING - OLD ARCHIVES

This is an archived copy of the Xen.org mailing list, which we have preserved to ensure that existing links to archives are not broken. The live archive, which contains the latest emails, can be found at http://lists.xen.org/
   
 
 
Xen 
 
Home Products Support Community News
 
   
 

xen-users

Re: [Xen-users] slow network with gplpv drivers in vlan setup

To: James Harper <james.harper@xxxxxxxxxxxxxxxx>
Subject: Re: [Xen-users] slow network with gplpv drivers in vlan setup
From: Pasi Kärkkäinen <pasik@xxxxxx>
Date: Tue, 9 Feb 2010 12:27:55 +0200
Cc: Matthieu Patou <mat+Informatique.xen@xxxxxxxxx>, xen-users@xxxxxxxxxxxxxxxxxxx
Delivery-date: Tue, 09 Feb 2010 02:28:26 -0800
Envelope-to: www-data@xxxxxxxxxxxxxxxxxxx
In-reply-to: <20100209102208.GB2861@xxxxxxxxxxx>
List-help: <mailto:xen-users-request@lists.xensource.com?subject=help>
List-id: Xen user discussion <xen-users.lists.xensource.com>
List-post: <mailto:xen-users@lists.xensource.com>
List-subscribe: <http://lists.xensource.com/mailman/listinfo/xen-users>, <mailto:xen-users-request@lists.xensource.com?subject=subscribe>
List-unsubscribe: <http://lists.xensource.com/mailman/listinfo/xen-users>, <mailto:xen-users-request@lists.xensource.com?subject=unsubscribe>
References: <4B711ED7.8040702@xxxxxxxxx> <AEC6C66638C05B468B556EA548C1A77D01899127@trantor> <20100209102208.GB2861@xxxxxxxxxxx>
Sender: xen-users-bounces@xxxxxxxxxxxxxxxxxxx
User-agent: Mutt/1.5.18 (2008-05-17)
On Tue, Feb 09, 2010 at 12:22:09PM +0200, Pasi Kärkkäinen wrote:
> On Tue, Feb 09, 2010 at 09:03:49PM +1100, James Harper wrote:
> > > > Large Send is probably what is causing you problems. Some network
> > cards
> > > > support large send offload only for untagged packets.
> > >
> > > Well that's a bit strange because on 2 identical dom0 servers
> > configured
> > > the same way I had this behavior only on one dom0 (the really loaded
> > > server).
> > 
> > How identical is identical? Are you able to determine the exact chipset
> > and firmware version of the network adapters? Even if you bought the two
> > servers from the same supplier at exactly the same time, there is still
> > a chance that there is some hardware difference, most likely firmware.
> > 
> 
> ethtool -i <interface> in dom0 might show the firmware version.
> 
> like this:
> 
> # ethtool -i eth0
> driver: e1000e
> version: 1.0.2-k2
> firmware-version: 5.11-8
> bus-info: 0000:04:00.0
> 
> 
> > 
> > Large send means that the network card will accept TCP packets well in
> > excess of the actual MTU, up to about 60K. The network card computes
> > checksum, seq, etc for you. So if you want to send a lot of TCP data
> > it's the difference between windows giving one 60K packet to the network
> > card vs 40 packets.
> > 
> > It gets even better when you are talking about virtual machines because
> > a Linux Dom0 can keep the packet 'large' as long as all the things it
> > has to pass through can handle it, whether that's from the DomU to Dom0,
> > DomU through the bridge to another DomU, or DomU through the bridge to
> > the physical network card.
> > 
> > In the testing I've done it's been the difference between 2GBits/second
> > iperf throughput and 3-4GBits/second. That's probably not representative
> > of real-world workloads though.
> > 
> > So in turning it off you do lose out on performance, but only if it
> > worked in the first place, which it doesn't for you.
> > 
> > If you could figure out exactly what is different between you're 2
> > Dom0's I'd be grateful. I keep getting these reports of LSO causing
> > problems for some people and have never been able to properly figure out
> > exactly why...
> > 
> 
> Please paste "ethtool ethX" and "ethtool -i ethX" output from both dom0s. 
> If you're using the xen network-bridge script then the device is pethX 
> instead of ethX.
> 

Oh, and also "ethtool -k ethX" to get the dom0 offloading settings.

-- Pasi


_______________________________________________
Xen-users mailing list
Xen-users@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-users