|  |  | 
  
    |  |  | 
 
  |   |  | 
  
    |  |  | 
  
    |  |  | 
  
    |   xen-users
[Xen-users] losing network packets on heavy load, xen 3.0.3 
| I have made this test many times with similar results all times: 
 Two virtual machines, both with Debian 3.1 r3, the firs is running "iperf -s -d" and the second runs in a infite loop "iperf -c [ip addr of machine 1]  -t 60 -N -P 10 -d" whit this creates 10(+10)  parallel bidirectional connections for 60 seconds on the server side I get this:
 
 vm-debian-B:~#  iperf -s
 ------------------------------------------------------------
 Server listening on TCP port 5001
 TCP window size: 85.3 KByte (default)
 ------------------------------------------------------------
 connect failed: Connection refused
 connect failed: Connection refused
 connect failed: Connection refused
 connect failed: Connection refused
 [  4] local 10.0.41.131 port 5001 connected with 
10.0.41.129 port 39537
 write2 failed: Broken pipe
 write2 failed: Broken pipe
 write2 failed: Broken pipe
 ------------------------------------------------------------
 Client connecting to 
10.0.41.129, TCP port 5001
 write2 failed: Broken pipe
 TCP window size: 16.0 KByte (default)
 ------------------------------------------------------------
 [  6] local 
0.0.0.0 port 46381 connected with 10.0.41.129 port 5001
 [  6]  0.0- 0.0 sec  0.00 Bytes  0.00 bits/sec
 [ ... ]
 [  9] local 0.0.0.0 port 46383 connected with 
10.0.41.129 port 5001
 [  9]  0.0- 0.0 sec  0.00 Bytes  0.00 bits/sec
 [ 13] local 10.0.41.131 port 46387 connected with 10.0.41.129
 port 5001
 [ 12] local 10.0.41.131 port 46386 connected with 10.0.41.129 port 5001
 [ 14] local 10.0.41.131 port 46388 connected with 
10.0.41.129 port 5001
 [ 10] local 10.0.41.131 port 46384 connected with 10.0.41.129 port 5001
 [ 16] local 
10.0.41.131 port 46390 connected with 10.0.41.129 port 5001
 [ 11] local 10.0.41.131 port 46385 connected with 10.0.41.129
 port 5001
 [  8] local 10.0.41.131 port 5001 connected with 10.0.41.129 port 39538
 ------------------------------------------------------------
 Client connecting to 10.0.41.129, TCP port 5001
 TCP window size: 16.0 KByte (default)
 ------------------------------------------------------------
 [  7] local 
10.0.41.131 port 5001 connected with 10.0.41.129 port 39539
 connect failed: Connection refused
 ------------------------------------------------------------
 Client connecting to 
10.0.41.129, TCP port 5001
 TCP window size: 16.0 KByte (default)
 ------------------------------------------------------------
 connect failed: Connection refused
 connect failed: Connection refused
 connect failed: Connection refused
 connect failed: Connection refused
 connect failed: Connection refused
 connect failed: Connection refused
 connect failed: Connection refused
 connect failed: Connection refused
 [ 32] local 10.0.41.131 port 5001 connected with 10.0.41.129 port 39540
 connect failed: Connection refused
 connect failed: Connection refused
 write2 failed: Broken pipe
 write2 failed: Broken pipe
 write2 failed: Broken pipe
 write2 failed: Broken pipe
 write2 failed: Broken pipe
 ------------------------------------------------------------
 Client connecting to 
10.0.41.129, TCP port 5001
 TCP window size: 16.0 KByte (default)
 ------------------------------------------------------------
 [ 35] local 0.0.0.0 port 46411 connected with 
10.0.41.129 port 5001
 [ 35]  0.0- 0.0 sec  0.00 Bytes  0.00 bits/sec
 [ ... ]
 [ 39] local 0.0.0.0 port 46415 connected with 
10.0.41.129 port 5001
 [ 39]  0.0- 0.0 sec  0.00 Bytes  0.00 bits/sec
 write2 failed: Broken pipe
 [ 41] local 0.0.0.0 port 46417 connected with 10.0.41.129
 port 5001
 write2 failed: Broken pipe
 [ 41]  0.0- 0.0 sec  0.00 Bytes  0.00 bits/sec
 [ 40] local 0.0.0.0 port 46416 connected with 10.0.41.129 port 5001
 [ 40]  0.0- 0.0 sec  0.00 Bytes  0.00 bits/sec
 write2 failed: Broken pipe
 [ 44] local 0.0.0.0 port 46419 connected with 10.0.41.129 port 5001
 [ 44]  
0.0- 0.1 sec  0.00 Bytes  0.00 bits/sec
 connect failed: Connection refused
 connect failed: Connection refused
 connect failed: Connection refused
 connect failed: Connection refused
 connect failed: Connection refused
 connect failed: Connection refused
 connect failed: Connection refused
 write2 failed: Broken pipe
 write2 failed: Broken pipe
 [ 43] local 0.0.0.0 port 46418 connected with 
10.0.41.129 port 5001
 [ 43]  0.0- 0.2 sec  0.00 Bytes  0.00 bits/sec
 [ 34] local 0.0.0.0 port 46410 connected with 10.0.41.129 port 5001
 [ 34]  0.0
- 0.2 sec  0.00 Bytes  0.00 bits/sec
 [SUM]  0.0- 0.2 sec  0.00 Bytes  0.00 bits/sec
 connect failed: Connection refused
 [ 42] local 10.0.41.131 port 5001 connected with 
10.0.41.129 port 39541
 connect failed: Connection refused
 connect failed: Connection refused
 connect failed: Connection refused
 connect failed: Connection refused
 connect failed: Connection refused
 connect failed: Connection refused
 connect failed: Connection refused
 connect failed: Connection refused
 connect failed: Connection refused
 connect failed: Connection refused
 connect failed: Connection refused
 write2 failed: Broken pipe
 connect failed: Connection refused
 write2 failed: Broken pipe
 [ 30] local 0.0.0.0 port 46407 connected with 10.0.41.129 port 5001
 [ 30]  0.0- 0.0 sec  
0.00 Bytes  0.00 bits/sec
 [ 31] local 0.0.0.0 port 46408 connected with 10.0.41.129 port 5001
 [ 31]  0.0- 0.0 sec  0.00 Bytes  0.00 bits/sec
 [ 22] local 
10.0.41.131 port 46399 connected with 10.0.41.129 port 5001
 write2 failed: Broken pipe
 write2 failed: Broken pipe
 write2 failed: Broken pipe
 write2 failed: Broken pipe
 write2 failed: Connection reset by peer
 write2 failed: Broken pipe
 write2 failed: Broken pipe
 [ 23] local 0.0.0.0 port 46400 connected with 10.0.41.129
 port 5001
 [ 23]  0.0- 0.0 sec  0.00 Bytes  0.00 bits/sec
 [ ... ]
 [ 27] local 0.0.0.0 port 46404 connected with 10.0.41.129 port 5001
 [ 27]  0.0
- 0.0 sec  0.00 Bytes  0.00 bits/sec
 
 write2 failed: Broken pipe
 write2 failed: Connection reset by peer
 write2 failed: Connection reset by peer
 write2 failed: Connection reset by peer
 write2 failed: Broken pipe
 [ 28] local 0.0.0.0 port 46405 connected with 10.0.41.129 port 5001
 [ 28]  0.0- 0.0 sec  0.00 Bytes  0.00 bits/sec
 [ ... ]
 [ 19] local 
10.0.41.131 port 46396 connected with 10.0.41.129 port 5001
 [ 51] local 10.0.41.131 port 5001 connected with 10.0.41.129
 port 39542
 connect failed: Connection refused
 connect failed: Connection refused
 write2 failed: Broken pipe
 write2 failed: Broken pipe
 write2 failed: Broken pipe
 write2 failed: Broken pipe
 write2 failed: Broken pipe
 write2 failed: Broken pipe
 ------------------------------------------------------------
 Client connecting to 10.0.41.129, TCP port 5001
 TCP window size: 16.0 KByte (default)
 ------------------------------------------------------------
 [ 47] local 0.0.0.0 port 46422 connected with 10.0.41.129 port 5001
 [ 47]  0.0- 0.0 sec  0.00
 Bytes  0.00 bits/sec
 [ ... ]
 [ 48] local 0.0.0.0 port 46423 connected with 10.0.41.129 port 5001
 [ 48]  0.0- 0.0 sec  0.00 Bytes  0.00 bits/sec
 write2 failed: Broken pipe
 write2 failed: Broken pipe
 write2 failed: Broken pipe
 write2 failed: Broken pipe
 [ 37] local 0.0.0.0 port 46428 connected with 10.0.41.129 port 5001
 [ 37]  0.0- 0.0 sec  0.00 Bytes  0.00 bits/sec
 [ ... ]
 [ 35] local 0.0.0.0 port 46426 connected with 10.0.41.129 port 5001
 [ 35]  0.0- 0.0 sec  0.00
 Bytes  0.00 bits/sec
 [SUM]  0.0- 0.0 sec  0.00 Bytes  0.00 bits/sec
 [ 18] local 10.0.41.131 port 5001 connected with 10.0.41.129 port 39543
 [ 33] local 
10.0.41.131 port 5001 connected with 10.0.41.129 port 39544
 [ 50] local 10.0.41.131 port 5001 connected with 
10.0.41.129 port 39546
 [ 61] local 10.0.41.131 port 5001 connected with 10.0.41.129 port 39545
 connect failed: Connection refused
 connect failed: Connection refused
 write2 failed: Connection reset by peer
 connect failed: Connection refused
 connect failed: Connection refused
 connect failed: Connection refused
 connect failed: Connection refused
 [ 22]  0.0- 0.1 sec  11.3
 KBytes  1.40 Mbits/sec
 [SUM]  0.0- 0.1 sec  11.3 KBytes  1.40 Mbits/sec
 write2 failed: Connection reset by peer
 [ 19]  0.0- 1.2 sec  11.3 KBytes  78.0 Kbits/sec
 connect failed: Connection refused
 ------------------------------------------------------------
 Client connecting to 10.0.41.129, TCP port 5001
 TCP window size: 16.0 KByte (default)
 ------------------------------------------------------------
 connect failed: Connection refused
 connect failed: Connection refused
 connect failed: Connection refused
 connect failed: Connection refused
 connect failed: Connection refused
 connect failed: Connection refused
 connect failed: Connection refused
 connect failed: Connection refused
 connect failed: Connection refused
 connect failed: Connection refused
 write2 failed: Broken pipe
 write2 failed: Broken pipe
 write2 failed: Broken pipe
 write2 failed: Broken pipe
 write2 failed: Broken pipe
 write2 failed: Broken pipe
 write2 failed: Broken pipe
 write2 failed: Broken pipe
 write2 failed: Broken pipe
 write2 failed: Broken pipe
 ------------------------------------------------------------
 Client connecting to 10.0.41.129, TCP port 5001
 TCP window size: 16.0 KByte (default)
 ------------------------------------------------------------
 [ 54] local 
0.0.0.0 port 46459 connected with 10.0.41.129 port 5001
 [ 54]  0.0- 0.0 sec  0.00 Bytes  0.00 bits/sec
 [ ... ]
 [ 53] local 0.0.0.0 port 46458 connected with 
10.0.41.129 port 5001
 [ 53]  0.0- 0.0 sec  0.00 Bytes  0.00 bits/sec
 [SUM]  0.0- 0.0 sec  0.00 Bytes  0.00 bits/sec
 connect failed: Connection refused
 connect failed: Connection refused
 connect failed: Connection refused
 connect failed: Connection refused
 connect failed: Connection refused
 connect failed: Connection refused
 connect failed: Connection refused
 connect failed: Connection refused
 connect failed: Connection refused
 connect failed: Connection refused
 write2 failed: Broken pipe
 write2 failed: Broken pipe
 write2 failed: Broken pipe
 write2 failed: Broken pipe
 write2 failed: Broken pipe
 write2 failed: Broken pipe
 write2 failed: Broken pipe
 write2 failed: Broken pipe
 write2 failed: Broken pipe
 write2 failed: Broken pipe
 ------------------------------------------------------------
 Client connecting to 
10.0.41.129, TCP port 5001
 TCP window size: 16.0 KByte (default)
 ------------------------------------------------------------
 [ 65] local 0.0.0.0 port 46469 connected with 
10.0.41.129 port 5001
 [ 65]  0.0- 0.0 sec  0.00 Bytes  0.00 bits/sec
 [ ... ]
 [ 64] local 0.0.0.0 port 46468 connected with 
10.0.41.129 port 5001
 [ 64]  0.0- 0.0 sec  0.00 Bytes  0.00 bits/sec
 [SUM]  0.0- 0.0 sec  0.00 Bytes  0.00 bits/sec
 connect failed: Connection refused
 connect failed: Connection refused
 connect failed: Connection refused
 connect failed: Connection refused
 connect failed: Connection refused
 connect failed: Connection refused
 connect failed: Connection refused
 connect failed: Connection refused
 connect failed: Connection refused
 connect failed: Connection refused
 write2 failed: Broken pipe
 write2 failed: Broken pipe
 write2 failed: Broken pipe
 ------------------------------------------------------------
 Client connecting to 
10.0.41.129, TCP port 5001
 TCP window size: 16.0 KByte (default)
 ------------------------------------------------------------
 [ 75] local 0.0.0.0 port 46479 connected with 
10.0.41.129 port 5001
 [ 75]  0.0- 0.0 sec  0.00 Bytes  0.00 bits/sec
 [ ... ]
 [ 67] local 0.0.0.0 port 46471 connected with 10.0.41.129 port 5001
 [ 67]  0.0- 0.0 sec  0.00 Bytes  0.00 bits/sec
 [SUM]  0.0- 0.0 sec  0.00 Bytes  0.00 bits/sec
 write2 failed: Broken pipe
 write2 failed: Broken pipe
 write2 failed: Broken pipe
 write2 failed: Broken pipe
 write2 failed: Broken pipe
 write2 failed: Broken pipe
 write2 failed: Broken pipe
 [ 68] local 0.0.0.0 port 46472 connected with 10.0.41.129 port 5001
 [ 68]  0.0- 0.0 sec  0.00
 Bytes  0.00 bits/sec
 [ ... ]
 [ 74] local 0.0.0.0 port 46478 connected with 10.0.41.129 port 5001
 [ 74]  0.0- 0.0 sec  0.00 Bytes  0.00 bits/sec
 connect failed: Connection refused
 connect failed: Connection refused
 connect failed: Connection refused
 connect failed: Connection refused
 ------------------------------------------------------------
 Client connecting to 
10.0.41.129, TCP port 5001
 TCP window size: 16.0 KByte (default)
 ------------------------------------------------------------
 connect failed: Connection refused
 connect failed: Connection refused
 connect failed: Connection refused
 write2 failed: Broken pipe
 connect failed: Connection refused
 connect failed: Connection refused
 connect failed: Connection refused
 write2 failed: Broken pipe
 write2 failed: Broken pipe
 write2 failed: Broken pipe
 write2 failed: Broken pipe
 write2 failed: Broken pipe
 [ 17] local 0.0.0.0 port 46438 connected with 10.0.41.129 port 5001
 [ 17]  0.0- 0.0 sec  0.00
 Bytes  0.00 bits/sec
 [ ... ]
 [SUM]  0.0- 0.0 sec  0.00 Bytes  0.00 bits/sec
 write2 failed: Broken pipe
 write2 failed: Broken pipe
 write2 failed: Broken pipe
 write2 failed: Broken pipe
 write2 failed: Broken pipe
 write2 failed: Broken pipe
 write2 failed: Broken pipe
 write2 failed: Broken pipe
 write2 failed: Broken pipe
 write2 failed: Broken pipe
 write2 failed: Broken pipe
 write2 failed: Broken pipe
 [ 40] local 
0.0.0.0 port 46432 connected with 10.0.41.129 port 5001
 [ 40]  0.0- 0.0 sec  0.00 Bytes  0.00 bits/sec
 [ ... ]
 [ 23] local 0.0.0.0
 port 46437 connected with 10.0.41.129 port 5001
 [ 23]  0.0- 0.0 sec  0.00 Bytes  0.00 bits/sec
 write2 failed: Broken pipe
 write2 failed: Broken pipe
 [ 20] local 
0.0.0.0 port 46439 connected with 10.0.41.129 port 5001
 [ ... ]
 [  5]  0.0-57.9 sec  11.1 MBytes  1.61 Mbits/sec
 
 the client side shows this:
 Debian31r1-vm1:~# iperf -c 
10.0.41.131 -t 60 -N -P 10 -d
 ------------------------------------------------------------
 Server listening on TCP port 5001
 TCP window size: 85.3 KByte (default)
 ------------------------------------------------------------
 ------------------------------------------------------------
 Client connecting to 10.0.41.131, TCP port 5001
 TCP window size: 16.0 KByte (default)
 ------------------------------------------------------------
 [  4] local 10.0.41.129 port 39538 connected with 10.0.41.131 port 5001
 [  6] local 10.0.41.129 port 39540 connected with 
10.0.41.131 port 5001
 [  8] local 10.0.41.129 port 39542 connected with 10.0.41.131 port 5001
 [  7] local 
10.0.41.129 port 39541 connected with 10.0.41.131 port 5001
 [  9] local 10.0.41.129 port 39543 connected with 10.0.41.131
 port 5001
 [ 10] local 10.0.41.129 port 39544 connected with 10.0.41.131 port 5001
 [  3] local 10.0.41.129 port 39537 connected with 
10.0.41.131 port 5001
 [ 13] local 10.0.41.129 port 39546 connected with 10.0.41.131 port 5001
 [  5] local 
10.0.41.129 port 39539 connected with 10.0.41.131 port 5001
 [ 14] local 10.0.41.129 port 5001 connected with 10.0.41.131
 port 46384
 [ 15] local 10.0.41.129 port 5001 connected with 10.0.41.131 port 46385
 [ 16] local 10.0.41.129 port 5001 connected with 
10.0.41.131 port 46386
 [ 17] local 10.0.41.129 port 5001 connected with 10.0.41.131 port 46387
 [ 18] local 
10.0.41.129 port 5001 connected with 10.0.41.131 port 46388
 [ 19] local 10.0.41.129 port 5001 connected with 10.0.41.131
 port 46389
 [ 11] local 10.0.41.129 port 39545 connected with 10.0.41.131 port 5001
 [ 20] local 10.0.41.129 port 5001 connected with 
10.0.41.131 port 46391
 [ 22] local 10.0.41.129 port 5001 connected with 10.0.41.131 port 46392
 [ 23] local 
10.0.41.129 port 5001 connected with 10.0.41.131 port 46393
 [ 21] local 10.0.41.129 port 5001 connected with 10.0.41.131
 port 46390
 [  4]  0.0-60.0 sec  11.6 MBytes  1.62 Mbits/sec
 [  7]  0.0-60.0 sec  11.8 MBytes  1.65 Mbits/sec
 [  6]  0.0-60.0 sec  12.2 MBytes  1.71 Mbits/sec
 [ 14]  0.0-60.0 sec  18.1 MBytes  2.53 Mbits/sec
 [ 16]  0.0-60.0 sec  14.1 MBytes  1.97 Mbits/sec
 [ 18]  0.0-60.0 sec  14.3 MBytes  2.00 Mbits/sec
 [ 19]  0.0-60.0 sec  12.5 MBytes  1.75 Mbits/sec
 [ 21]  0.0-60.0 sec  13.2 MBytes  1.85 Mbits/sec
 [ 15]  0.0-60.0
 sec  14.4 MBytes  2.01 Mbits/sec
 [ 13]  0.0-60.3 sec  10.1 MBytes  1.40 Mbits/sec
 [  9]  0.0-60.3 sec  8.66 MBytes  1.20 Mbits/sec
 [ 17]  0.0-60.2 sec  12.2 MBytes  1.71 Mbits/sec
 [  8]  0.0-60.5 sec  4.96 MBytes    688 Kbits/sec
 [ 11]  0.0-60.5 sec  11.0 MBytes  1.53 Mbits/sec
 [ 23]  0.0-60.6 sec  17.6 MBytes  2.44 Mbits/sec
 [  5]  0.0-60.7 sec  12.8 MBytes  1.77 Mbits/sec
 [ 22]  0.0-60.6 sec  14.0 MBytes  1.93 Mbits/sec
 [  3]  0.0-60.7
 sec  12.8 MBytes  1.77 Mbits/sec
 [ 10]  0.0-61.1 sec  9.49 MBytes  1.30 Mbits/sec
 [SUM]  0.0-61.1 sec    105 MBytes  14.5 Mbits/sec
 [ 20]  0.0-61.7 sec  11.1 MBytes  1.52 Mbits/sec
 [SUM]  0.0-61.7 sec    142 MBytes  
19.3 Mbits/sec
 
 As we can see there is a lot of connection errors and the speed measurement reveals a very poor performance
 
 Test platform detail:
 
 Dom0
 Dell PE1950, 4 Xeon @1.6G, 8Gig memory
 RedHat Enterprise Server 4 update 4
 Xen 3.0.3, kernel 2.6.16.29
 
 Virtual Machines
 1 CPU, 300Mb memory
 Debian 3.1r3
 Kernel 2.6.8-3-386
 
 Both machines are on the same Dom0 and the use bridged networking
 
 Any ideas or comments?
 
 _______________________________________________
Xen-users mailing list
Xen-users@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-users | 
 
| <Prev in Thread] | Current Thread | [Next in Thread> |  | 
[Xen-users] losing network packets on heavy load, xen 3.0.3,
Luis Vinay <=
 |  |  | 
  
    |  |  |