This is an archived copy of the Xen.org mailing list, which we have preserved to ensure that existing links to archives are not broken. The live archive, which contains the latest emails, can be found at http://lists.xen.org/
Home Products Support Community News


Re: [Xen-users] domU network fails under load - vif breaks

To: xen-users@xxxxxxxxxxxxxxxxxxx
Subject: Re: [Xen-users] domU network fails under load - vif breaks
From: "Jon Simonds" <jsimonds@xxxxxxxxx>
Date: Thu, 11 Sep 2008 14:34:27 -0400
Delivery-date: Thu, 11 Sep 2008 11:35:03 -0700
Dkim-signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to :subject:mime-version:content-type:content-transfer-encoding :content-disposition; bh=ITLJWaB03LqaSQE10mU1IwK6DZRKZk6Epr54z4DJwwI=; b=SsQKE0dqiFKdGlm+uPLeV7TJENPkJpgw1eCXIMCbFhvvHblQXgDQG2pRBQJZxDnJU1 kJvvx4wKW5A21P2kwuTv+KRSWgnW15LnfVx7kVJrlZugAM7VF4CFzJUZa6cb4U6LcKzY RPctiNWdpf8/Y5CIAzi1easiyQOgQuRZ7TJJU=
Domainkey-signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:mime-version:content-type :content-transfer-encoding:content-disposition; b=IZsp0CqS5t6OUYIqYYGlAbjclZZdF5Bi0oy1eFp/NObfwR/SPDCO5uunqQpnjgldTn w5epRzU+u616jxMorxzQubcLXFKOhOnkz1UnnTpCA55187Wy0qgvH8tD7VhzTrJTHdj3 j7nOIbUFrVjBXq/ea6bmRVo9h70Z3bvXtg2eM=
Envelope-to: www-data@xxxxxxxxxxxxxxxxxxx
List-help: <mailto:xen-users-request@lists.xensource.com?subject=help>
List-id: Xen user discussion <xen-users.lists.xensource.com>
List-post: <mailto:xen-users@lists.xensource.com>
List-subscribe: <http://lists.xensource.com/mailman/listinfo/xen-users>, <mailto:xen-users-request@lists.xensource.com?subject=subscribe>
List-unsubscribe: <http://lists.xensource.com/mailman/listinfo/xen-users>, <mailto:xen-users-request@lists.xensource.com?subject=unsubscribe>
Sender: xen-users-bounces@xxxxxxxxxxxxxxxxxxx
> Nathan Eisenberg wrote:
> I'm wondering if #3 is a large enough change to rule out driver issues.  
> Maybe try an entirely different chipset and manufacturer - perhaps an Intel, 
> Broadcom, etc NIC.

I'm curious if anybody has made any further progress on this.
I too have the exact same issues as Paul-372 (identical.) Only fix is
to reboot the dom0.
Now running Xen 3.3.0 with Xen-Sources 2.6.21 on a gentoo base system.
Same issues on Xen 3.2.0.

I will add to the list that I am using a SuperMicro based server, with
built-in Intel Pro/1000 Nics.
I've had this issue from the beginning, and have tried to limit things
that cause the network bridge to collapse, but this makes the machine
worthless.  This is supposed to be a production level machine for us,
but at the moment it obviously isn't useable.  I can cause an
immediate drop of all the vifs by doing a copy to an nfs share on dom0
from any of the domU machines.  I am running 4 PV domUs and 1 Win32
DomU on this machine.  I will provide any information that may help in
determining the root of the problem.

from lspci:
0d:00.0 Ethernet controller: Intel Corporation 82573E Gigabit Ethernet
Controller (Copper) (rev 03)
0e:00.0 Ethernet controller: Intel Corporation 82573L Gigabit Ethernet

from syslog:
Sep 10 18:58:15 xen Intel(R) PRO/1000 Network Driver - version 7.3.20-k2
Sep 10 18:58:15 xen e1000: eth0: e1000_probe: Intel(R) PRO/1000
Network Connection
Sep 10 18:58:15 xen e1000: eth1: e1000_probe: Intel(R) PRO/1000
Network Connection

I see that intel has a new driver, but it is only available as a
module.  I tend to compile the kernel for exactly what I need, and
keep the machines as lean as possible.  I would prefer not to go this
route, but will if it offers a fix.  I have not done this yet, as it
seems to not matter what NIC is being used.  I believe I may be the
first to post about the problem with Intel Pro/1000 nics.

So far for me, this problem seems to be strictly related to heavy
traffic between the dom0 and the domUs.  If I place an nfs server on
one of the other domUs I seem to be able to transfer files without
causing the vif drop.  I have a colleague that has the exact same
servers, and he doesn't do any domU to dom0 traffic, just domU to the
internet, and he is able to sustain from 15Mb/sec to 100Mb/sec data
streams without dropping the vifs.  Maybe it is possible that this
level of throughput is not causing him problems, as I'm not completely
aware of what type of throughput between my DomUs and Dom0 is actually
dropping the vifs, but I see that it is as low as 3Mbit for some

-- I appologize if this hits the list incorrectly or misses the
thread... I tried to reply through Nabble, but my post has been
pending since yesterday, so I figured I would try posting directly to
the list.

Xen-users mailing list