Good day
Hoping someone out there may shed some light on an issue I am facing. First, no AV or FW involved. Going host to host via LC/LC multimode.
Cards: Intel x520
Servers: Server A is Dell PowerEdge 2950/16GB memory. Server B is Dell PowerEdge 710/16GB Memory (C1 and CE disabled, Max performace) both running Windows Server R2.
All settings on adapters are default except:
- Large Send Offload IPV6 = Disabled
- RSS Queues = 16
- Interrupt Moderation Rate = off
- Receive Buffers = 2048
- Transmit Buffers = 16384
- Jumbo Packet = 9014
Following was set on each server:
- netsh int tcp set global autotuninglevel=normal
- netsh int tcp set global chimney=enabled
- netsh int tcp set global rss=enable
I can not achieve over 6GB - I would like to possibly saturate the line with testing close to 10GB. Using NTTTCP or iPerf, same results.
Suggestions????
Results:
C:\Tmp\NTttcp-v5.28\x64>ntttcp.exe -s -m 8,*,192.168.2.3 -l 128K -a 2 -t 15
Copyright Version 5.28
Network activity progressing...
Thread Time(s) Throughput(KB/s) Avg B / Compl
====== ======= ================ =============
0 15.016 54197.123 131072.000
1 15.016 81116.676 131072.000
2 15.016 54214.172 131072.000
3 15.016 81295.685 131072.000
4 15.016 54205.647 131072.000
5 15.016 81116.676 131072.000
6 15.016 132372.936 131072.000
7 15.016 81304.209 131072.000
##### Totals: #####
Bytes(MEG) realtime(s) Avg Frame Size Throughput(MB/s)
================ =========== ============== ================
9089.125000 15.016 8738.133 605.296
Throughput(Buffers/s) Cycles/Byte Buffers
===================== =========== =============
4842.368 0.750 72713.000
DPCs(count/s) Pkts(num/DPC) Intr(count/s) Pkts(num/intr)
============= ============= =============== ==============
12107.619 2.995 18379.595 1.973
Packets Sent Packets Received Retransmits Errors Avg. CPU %
============ ================ =========== ====== ==========
1090695 544517 0 0 1.177
Test via iPerf -
Server A: iperf-s
Server B: iperf -c 192.168.2.3 -w 64K P8 -t60
C:\Tmp\iperf-2.0.5-2-win32>iperf -c 192.168.2.3 -w 64K -P8 -t60
------------------------------------------------------------
Client connecting to 192.168.2.3, TCP port 5001
TCP window size: 64.0 KByte
------------------------------------------------------------
[ 5] local 192.168.2.2 port 49548 connected with 192.168.2.3 port 5001
[ 4] local 192.168.2.2 port 49547 connected with 192.168.2.3 port 5001
[ 7] local 192.168.2.2 port 49550 connected with 192.168.2.3 port 5001
[ 6] local 192.168.2.2 port 49549 connected with 192.168.2.3 port 5001
[ 3] local 192.168.2.2 port 49546 connected with 192.168.2.3 port 5001
[ 9] local 192.168.2.2 port 49552 connected with 192.168.2.3 port 5001
[ 8] local 192.168.2.2 port 49551 connected with 192.168.2.3 port 5001
[ 10] local 192.168.2.2 port 49553 connected with 192.168.2.3 port 5001
[ ID] Interval Transfer Bandwidth
[ 9] 0.0-57.0 sec 4.38 GBytes 660 Mbits/sec
[ 8] 0.0-57.0 sec 4.34 GBytes 655 Mbits/sec
[ 10] 0.0-57.0 sec 4.47 GBytes 673 Mbits/sec
[ 7] 0.0-60.0 sec 4.73 GBytes 677 Mbits/sec
[ 6] 0.0-60.0 sec 4.76 GBytes 682 Mbits/sec
[ 3] 0.0-60.0 sec 4.81 GBytes 689 Mbits/sec
[ 5] 0.0-60.0 sec 4.80 GBytes 688 Mbits/sec
[ 4] 0.0-60.0 sec 4.70 GBytes 673 Mbits/sec
[SUM] 0.0-60.0 sec 37.0 GBytes 5.30 Gbits/sec
Also - ran this as well - still could not get above 6GB......
ntttcp -s -m 1,0,X.X.X.X -l 1048576 -n 100000 -w -a 16
ntttcp -r -m 1,0,X.X.X.X -l 1048576 -rb 2097152 -n 100000 -w -a 16