This is an archived copy of the Xen.org mailing list, which we have preserved to ensure that existing links to archives are not broken. The live archive, which contains the latest emails, can be found at http://lists.xen.org/
Home Products Support Community News


Re: [Xen-users] High availability Xen with bonding

To: Florian Heigl <florian.heigl@xxxxxxxxx>
Subject: Re: [Xen-users] High availability Xen with bonding
From: Bart Coninckx <bart.coninckx@xxxxxxxxxx>
Date: Sun, 17 Oct 2010 14:07:38 +0200
Cc: xen-users@xxxxxxxxxxxxxxxxxxx, Eric van Blokland <Eric@xxxxxxxxxxxx>
Delivery-date: Sun, 17 Oct 2010 05:09:23 -0700
Envelope-to: www-data@xxxxxxxxxxxxxxxxxxx
In-reply-to: <AANLkTi=c4MRMnWOS33NpxtsW9SFa-XNOs2=HFwzOoqcy@xxxxxxxxxxxxxx>
List-help: <mailto:xen-users-request@lists.xensource.com?subject=help>
List-id: Xen user discussion <xen-users.lists.xensource.com>
List-post: <mailto:xen-users@lists.xensource.com>
List-subscribe: <http://lists.xensource.com/mailman/listinfo/xen-users>, <mailto:xen-users-request@lists.xensource.com?subject=subscribe>
List-unsubscribe: <http://lists.xensource.com/mailman/listinfo/xen-users>, <mailto:xen-users-request@lists.xensource.com?subject=unsubscribe>
References: <32D516B498BAE9439B6502E86F31007A01BA76E6DDF3@domain> <201010161537.49007.bart.coninckx@xxxxxxxxxx> <AANLkTi=c4MRMnWOS33NpxtsW9SFa-XNOs2=HFwzOoqcy@xxxxxxxxxxxxxx>
Sender: xen-users-bounces@xxxxxxxxxxxxxxxxxxx
User-agent: KMail/1.13.5 (Linux/; KDE/4.4.4; x86_64; ; )
On Sunday 17 October 2010 07:19:26 Florian Heigl wrote:
> Hi both,
> I had very good success after some pulling-hairs.
> I run lacp + vlan trunking.
> Key assumptions:
> - All device setup (eth, bond, bridges) is done via normal OS config,
> because that is more reliable.
> - All libvirt stuff is disabled, it just limits Xen's possibilities to
> "home user level" by assuming you'd only have one bridge.
> (chkconfig  XXX off ...)
> - No messing with ARP is wanted
> - You have switches current enough to do "real" LACP
> There's a very good (and I think the only working one) manual in the
> Oracle VM wiki at
> http://wiki.oracle.com/page/Oracle+VM+Server+Configuration-+bonded+and+trun
> ked+network+interfaces
> I myself had followed one manual from redhat, which left off somewhere
> in the middle.
> It's called "Xen_Networking.pdf" by Mark Nielsen. It's a good intro,
> but only covers 50% of a good setup.
> Notes:
> a) if you look not just at link aggregation but a VLAN-heavy
> environment there might be a point (>128 VLANs) where the number of
> virtual bridges might become an issue. Then wait for OpenVswitch to
> mature or email xen-devel and ask for the status of "vnetd". (just
> kidding)
> b) using ethernet (n ethernet links into bond0) and infiniband (2
> infiniband hca ports into bond1) bonding on the same host is more
> tricky. it seems the ethernet bonding driver tries to cover infiniband
> too. The setup is completely undocumented. It is possible, but when I
> tried it just didn't pass any more traffic.
> For the setup check the following thread in HP itrc:
> http://forums13.itrc.hp.com/service/forums/questionanswer.do?admit=10944762
> 7+1287292335750+28353475&threadId=1445752 c) added speed is only guaranteed
> for multiple connections. if you do it via bonding, you need a lacp
> algorithm in your switch that will hash based on the ip destination ports,
> not just mac address or ip address. current cisco gear can do that. for
> plain iscsi your path grouping would decide if you see loadbalancing with
> multiple iSCSI lans.
> Hope you get it to work!
> Florian
> 2010/10/16 Bart Coninckx <bart.coninckx@xxxxxxxxxx>:
> > On Friday 15 October 2010 13:44:42 Eric van Blokland wrote:
> >> Hello everyone,
> >> 
> >> A few days back I decided to give Ethernet port bonding in Xen another
> >> try. I've never been able to get it to work properly and after a short
> >> search I found the network-bridge-bonding script shipped with CentOS-5
> >> probably wasn't going to solve my problems. Instead of searching for a
> >> tailored
> [...]
> > curious to see your progress in this. Up till now I tackled network
> > redundancy with multipathing, not with bonding. However, this does not
> > provide added speed, though theoretically it should. So I recently
> > decided to switch to bonding for the hypervisors in their connections to
> > iSCSI, using rr and running over seperate switches, just like you but
> > I'm not at the point of installing domU's, so I can't really comment on
> > how and if it works. Will know next week though so I will return to this
> > post with my findings...
> that should definitely get you increased speed, plus multiple iSCSI
> connections via separate subnets / nics is the only way you can get
> close to FC reliabilty for lower budget.

I have no VLAN-ning, no LACP, running across different switches but I do have 
at least two network bridges. Don't know if Eric's setup is similar, but this 
seems so basic to me that it *should* work without any special pitfalls. But 
ask me again in a week ;-)


Xen-users mailing list