Re: [Xen-devel] Problem with VLANs on tg3 NICs

[Evan Bigall <evan.bigall@xxxxxxxxxxx>]

Ian Pratt wrote:
> > I have 3 machines,
> >     T60 thinkpad with e1000 NIC
> >     Dell PowerEdge 2950 with bnx2 NIC
> >     HP DL360 G4P with tg3 NIC
> > All running xen 3.03 / 2.6.16.29-xen
> >
> > I have a netbootable image with 2.6.16.29-xenU.  This image when it
> > boots creates a vlan eth0.4002, and then tries to communicate on that
> > interface to a central server.
> >   
>
> Please can you describe the setup in more detail, including the bridge
> and NIC setup in dom0. It sounds like you're trying to pass a VLAN trunk
> into a guest and then use vconfig inside the guest, but I didn't think
> you could do this with the standard linux bridge as it didn't support
> VLAN trunking.
The network setup in dom0 is the default (I've just downloaded the
source tarball and then built and installed it.  The only change I've
made is to enable 8021.q support in the xenU kernel).  Then you are
correct, in domU I use vconfig to create a vlan interface and ifconfig
to give it an address and bring it up. On systems whose NICs don't use
the tg3 driver, this seems to work fine.  I can tcpdump on the bridge
in dom0 and see the tagged traffic coming and going.  Here is some info
from dom0 on one of the working systems.

Successful arp request / reply:

[root@localhost ~]# tcpdump -s 0 -e -v -x -i xenbr0 vlan 4002 and  arp
tcpdump: WARNING: xenbr0: no IPv4 address assigned
tcpdump: listening on xenbr0, link-type EN10MB (Ethernet), capture size
65535 bytes
13:41:05.560522 00:0e:aa:04:00:0a > 00:0e:aa:04:00:01, ethertype
802.1Q (0x8100), length 46: vlan 4002, p 0, ethertype ARP, arp who-has
10.21.1.1 tell 10.21.1.9
        0x0000:  0fa2 0806 0001 0800 0604 0001 000e aa04 
................
        0x0010:  000a 0a15 0109 0000 0000 0000 0a15 0101 
................
13:41:05.560596 00:0e:aa:04:00:01 > 00:0e:aa:04:00:0a, ethertype
802.1Q (0x8100), length 64: vlan 4002, p 0, ethertype ARP, arp reply
10.21.1.1 is-at 00:0e:aa:04:00:01
        0x0000:  0fa2 0806 0001 0800 0604 0002 000e aa04 
................
        0x0010:  0001 0a15 0101 000e aa04 000a 0a15 0109 
................
        0x0020:  0000 0000 0000 0000 0000 0000 0000 0000 
................
        0x0030:  0000 

Bridge:

[root@localhost ~]# brctl show
bridge name     bridge id               STP enabled     interfaces
xenbr0          8000.feffffffffff       no              peth0
                                                        vif0.0
                                                        vif41.0
                                                        vif42.0
                                                        vif43.0

Interfaces:

[root@localhost ~]# ifconfig
eth0      Link encap:Ethernet  HWaddr 00:18:8B:47:B9:DA
          inet addr:10.20.36.150  Bcast:10.20.36.255  Mask:255.255.255.0
          inet6 addr: fe80::218:8bff:fe47:b9da/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:1966533 errors:0 dropped:0 overruns:0 frame:0
          TX packets:98750 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:1034752722 (986.8 MiB)  TX bytes:73493849 (70.0 MiB)

lo        Link encap:Local Loopback
          inet addr:127.0.0.1  Mask:255.0.0.0
          inet6 addr: ::1/128 Scope:Host
          UP LOOPBACK RUNNING  MTU:16436  Metric:1
          RX packets:208 errors:0 dropped:0 overruns:0 frame:0
          TX packets:208 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:20595 (20.1 KiB)  TX bytes:20595 (20.1 KiB)

peth0     Link encap:Ethernet  HWaddr FE:FF:FF:FF:FF:FF
          inet6 addr: fe80::fcff:ffff:feff:ffff/64 Scope:Link
          UP BROADCAST RUNNING NOARP  MTU:1500  Metric:1
          RX packets:2387336 errors:0 dropped:0 overruns:0 frame:0
          TX packets:1488147 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:1704932347 (1.5 GiB)  TX bytes:400348056 (381.8 MiB)
          Interrupt:16 Memory:d6000000-d6011100

vif0.0    Link encap:Ethernet  HWaddr FE:FF:FF:FF:FF:FF
          inet6 addr: fe80::fcff:ffff:feff:ffff/64 Scope:Link
          UP BROADCAST RUNNING NOARP  MTU:1500  Metric:1
          RX packets:98764 errors:0 dropped:0 overruns:0 frame:0
          TX packets:1966544 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:73496741 (70.0 MiB)  TX bytes:1034753448 (986.8 MiB)

vif41.0   Link encap:Ethernet  HWaddr FE:FF:FF:FF:FF:FF
          inet6 addr: fe80::fcff:ffff:feff:ffff/64 Scope:Link
          UP BROADCAST RUNNING NOARP  MTU:1500  Metric:1
          RX packets:74309 errors:0 dropped:0 overruns:0 frame:0
          TX packets:234316 errors:0 dropped:82 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:15679399 (14.9 MiB)  TX bytes:123190189 (117.4 MiB)

vif42.0   Link encap:Ethernet  HWaddr FE:FF:FF:FF:FF:FF
          inet6 addr: fe80::fcff:ffff:feff:ffff/64 Scope:Link
          UP BROADCAST RUNNING NOARP  MTU:1500  Metric:1
          RX packets:74107 errors:0 dropped:0 overruns:0 frame:0
          TX packets:171556 errors:0 dropped:68 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:15630126 (14.9 MiB)  TX bytes:96787536 (92.3 MiB)

vif43.0   Link encap:Ethernet  HWaddr FE:FF:FF:FF:FF:FF
          inet6 addr: fe80::fcff:ffff:feff:ffff/64 Scope:Link
          UP BROADCAST RUNNING NOARP  MTU:1500  Metric:1
          RX packets:74210 errors:0 dropped:0 overruns:0 frame:0
          TX packets:179269 errors:0 dropped:44 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:15624781 (14.9 MiB)  TX bytes:107122338 (102.1 MiB)

xenbr0    Link encap:Ethernet  HWaddr FE:FF:FF:FF:FF:FF
          inet6 addr: fe80::200:ff:fe00:0/64 Scope:Link
          UP BROADCAST RUNNING NOARP  MTU:1500  Metric:1
          RX packets:46072 errors:0 dropped:0 overruns:0 frame:0
          TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:2601825 (2.4 MiB)  TX bytes:0 (0.0 b)

/Evan


_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-devel