This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
10-Gigabit Ethernet Connectivity for Computer Servers
May/June 2007 (vol. 27 no. 3)
pp. 94-105
ASCII Text
x 
 
Serag GadelRab, "10-Gigabit Ethernet Connectivity for Computer Servers," IEEE Micro, vol. 27, no. 3, pp. 94-105, May/June, 2007.
 
 
BibTex
x
 
@article{ 10.1109/MM.2007.46,
author = {Serag GadelRab},
title = {10-Gigabit Ethernet Connectivity for Computer Servers},
journal ={IEEE Micro},
volume = {27},
number = {3},
issn = {0272-1732},
year = {2007},
pages = {94-105},
doi = {http://doi.ieeecomputersociety.org/10.1109/MM.2007.46},
publisher = {IEEE Computer Society},
address = {Los Alamitos, CA, USA},
}
 
 
RefWorks Procite/RefMan/Endnote
x 
 
TY - MGZN
JO - IEEE Micro
TI - 10-Gigabit Ethernet Connectivity for Computer Servers
IS - 3
SN - 0272-1732
SP94
EP105
EPD - 94-105
A1 - Serag GadelRab,
PY - 2007
KW - Ethernet
KW - I/O and data communications
KW - local-area networks
KW - communication and networking
VL - 27
JA - IEEE Micro
ER -
 
Serag GadelRab, Double-Pole Technologies
Widespread deployment of 10-gigabit Ethernet connections to servers has been hampered by the high cost of network interfaces and the fast-network, slow-host phenomenon. Although the cost of 10GbE connectivity is decreasing, the mismatch between network bandwidth and host computational capacity still needs attention. This article describes the challenges posed by 10GbE termination in modern servers, presents evolving methods that can overcome the computational challenges, and highlights future research trends.

1. T. Shimizu et al., "A Single Chip Shared Memory Switch with Twelve 10Gb Ethernet Ports," Hot Chips 15, 2003; http://www.hotchips.org/archives/hc15/3_Tue 1.fujitsu.pdf.
1. T. Shimizu et al., "A Single Chip Shared Memory Switch with Twelve 10Gb Ethernet Ports," Hot Chips 15, 2003; http://www.hotchips.org/archives/hc15/3_Tue 1.fujitsu.pdf.
2. B. Wheeler , "10G Ethernet Adoption in Volume Servers," white paper, the Linley Group, 2006; http://www.linleygroup.com/pdf10GbE_Adoption_WP.pdf .
2. B. Wheeler, "10G Ethernet Adoption in Volume Servers," white paper, the Linley Group, 2006; http://www.linleygroup.com/pdf10GbE_Adoption_WP.pdf .
3. A. Foong et al., "TCP Performance Re-visited," Proc. IEEE Int'l Symp. Performance Analysis of Software and Systems (ISPASS 03), IEEE CS Press, 2003, pp. 70 –79.
3. A. Foong et al., "TCP Performance Re-visited," Proc. IEEE Int'l Symp. Performance Analysis of Software and Systems (ISPASS 03), IEEE CS Press, 2003, pp. 70 –79.
4. J. Pinkerton , "The Case for RDMA," RDMA Consortium, 2002; http://www.rdmaconsortium.org/homeThe_Case_for_RDMA020531.pdf .
4. J. Pinkerton, "The Case for RDMA," RDMA Consortium, 2002; http://www.rdmaconsortium.org/homeThe_Case_for_RDMA020531.pdf .
5. D. Clark et al., "An Analysis of TCP Processing Overhead," IEEE Comm. Magazine, vol. 27, no. 6, June 1989, pp. 23 –29.
5. D. Clark et al., "An Analysis of TCP Processing Overhead," IEEE Comm. Magazine, vol. 27, no. 6, June 1989, pp. 23 –29.
6. J. Chase et al., "End System Optimization for High-Speed TCP," IEEE Comm. Magazine, vol. 39, no. 4, Apr. 2001, pp. 68 –74.
6. J. Chase et al., "End System Optimization for High-Speed TCP," IEEE Comm. Magazine, vol. 39, no. 4, Apr. 2001, pp. 68 –74.
7. G. Regnier et al., "TCP Onloading for Data Center Servers," Computer, vol. 37, no. 11, Nov. 2004, pp. 48 –58.
7. G. Regnier et al., "TCP Onloading for Data Center Servers," Computer, vol. 37, no. 11, Nov. 2004, pp. 48 –58.
8. G. Regnier et al., "ETA: Experience with an Intel Xeon Processor as a Packet Processing Engine," IEEE Micro, vol. 24, no. 1, Jan.-Feb. 2004, pp. 24 –31.
8. G. Regnier et al., "ETA: Experience with an Intel Xeon Processor as a Packet Processing Engine," IEEE Micro, vol. 24, no. 1, Jan.-Feb. 2004, pp. 24 –31.
9. E. Nahum et al., "Cache Behavior of Network Protocols," Proc. ACM Sigmetrics Int'l Conf., ACM Press, 1997, pp. 169 –180.
9. E. Nahum et al., "Cache Behavior of Network Protocols," Proc. ACM Sigmetrics Int'l Conf., ACM Press, 1997, pp. 169 –180.
10. H. Kim et al., "Network Interface Data Caching," IEEE Trans. Computers, vol. 54, no. 11, Nov. 2005, pp. 1394 –1408.
10. H. Kim et al., "Network Interface Data Caching," IEEE Trans. Computers, vol. 54, no. 11, Nov. 2005, pp. 1394 –1408.
11. W. Wulf and S. McKee , "Hitting the Memory Wall: Implications of the Obvious," Computer Architecture News, vol. 23, no. 1, Mar. 1995, pp. 20 –24.
11. W. Wulf and S. McKee, "Hitting the Memory Wall: Implications of the Obvious," Computer Architecture News, vol. 23, no. 1, Mar. 1995, pp. 20 –24.
12. A. Allman , "TCP Congestion Control with Appropriate Byte Counting (ABC)," Internet Engineering Task Force, RFC 3465; http://www.ietf.org/rfcrfc3465.txt.
12. A. Allman, "TCP Congestion Control with Appropriate Byte Counting (ABC)," Internet Engineering Task Force, RFC 3465; http://www.ietf.org/rfcrfc3465.txt.
13. J. Corbet , A. Rubini , and G. Kroah-Hartman , Linux Device Drivers, third ed. O'Reilly, 2005.
13. J. Corbet, A. Rubini, and G. Kroah-Hartman, Linux Device Drivers, third ed. O'Reilly, 2005.
14. W. Feng et al., "Performance Characterization of a 10-Gigabit Ethernet TOE," Proc. 13th Symp. High-Performance Interconnects (HOTI 05), IEEE CS Press, 2005, pp. 58 –63.
14. W. Feng et al., "Performance Characterization of a 10-Gigabit Ethernet TOE," Proc. 13th Symp. High-Performance Interconnects (HOTI 05), IEEE CS Press, 2005, pp. 58 –63.
15. T.J. O'Gorman et al., "Field Testing for Cosmic Ray Soft Errors in Semiconductor Memories," IBM J. Research and Development, vol. 40, no. 1, 1996.
15. T.J. O'Gorman et al., "Field Testing for Cosmic Ray Soft Errors in Semiconductor Memories," IBM J. Research and Development, vol. 40, no. 1, 1996.
16. "Scalable Networking: Eliminating the Receive Processing Bottleneck —Introducing RSS," white paper, WinHEC 2004, Microsoft.
16. "Scalable Networking: Eliminating the Receive Processing Bottleneck —Introducing RSS," white paper, WinHEC 2004, Microsoft.
17. H. Tang , "Optimizing Network Performance on New Intel Xeon Servers with Intel I/OAT," Intel Developer Forum, 2006; http://www.prcidf.com.cn/bj/eng/systems_conf track1_BSR.html.
17. H. Tang, "Optimizing Network Performance on New Intel Xeon Servers with Intel I/OAT," Intel Developer Forum, 2006; http://www.prcidf.com.cn/bj/eng/systems_conf track1_BSR.html.
18. C. Keltcher et al., "The AMD Opteron Processor for Multiprocessor Servers," IEEE Micro, vol. 23, no. 2, Mar.-Apr. 2003, pp. 66 –76.
18. C. Keltcher et al., "The AMD Opteron Processor for Multiprocessor Servers," IEEE Micro, vol. 23, no. 2, Mar.-Apr. 2003, pp. 66 –76.
19. L. Grossman , "Large Receive Offload Implementation in Neterion 10 GbE Ethernet Driver," Proc. Linux Symp, vol. 1, 2005, pp. 195 –200, http://www.linuxsymposium.org/2005linuxsymposium_procv1.pdf .
19. L. Grossman, "Large Receive Offload Implementation in Neterion 10 GbE Ethernet Driver," Proc. Linux Symp, vol. 1, 2005, pp. 195 –200, http://www.linuxsymposium.org/2005linuxsymposium_procv1.pdf .
20. J. Mogul , "TCP Offload Is a Dumb Idea Whose Time Has Come," Proc. Usenix Workshop Hot Topics in Operating Systems (HotOS IX), Usenix Assoc., http://bcr2.uwaterloo.ca/~brecht/servers/ readings-newmogul-offload-2003.pdf. 2003.
20. J. Mogul, "TCP Offload Is a Dumb Idea Whose Time Has Come," Proc. Usenix Workshop Hot Topics in Operating Systems (HotOS IX), Usenix Assoc., http://bcr2.uwaterloo.ca/~brecht/servers/ readings-newmogul-offload-2003.pdf. 2003.
21. "Scalable Networking: Network Protocol Offload —Introducing TCP Chimney," white paper, WinHEC 2004; Microsoft, 2004; http://www.microsoft.com/whdc/device/network TCP_Chimney.mspx
21. "Scalable Networking: Network Protocol Offload —Introducing TCP Chimney," white paper, WinHEC 2004; Microsoft, 2004; http://www.microsoft.com/whdc/device/network TCP_Chimney.mspx
22. P. Sarkar et al., "Storage over IP: When Does Hardware Support Help?," Proc. 2nd Usenix Conf. File and Storage Tech. (FAST 03), Usenix Assoc., 2003, pp. 231 –244.
22. P. Sarkar et al., "Storage over IP: When Does Hardware Support Help?," Proc. 2nd Usenix Conf. File and Storage Tech. (FAST 03), Usenix Assoc., 2003, pp. 231 –244.
23. P. Balaji et al., "Bridging the Ethernet-Ethernot Performance Gap," IEEE Micro, vol. 26, no. 3, May-June 2006, pp. 24 –40.
23. P. Balaji et al., "Bridging the Ethernet-Ethernot Performance Gap," IEEE Micro, vol. 26, no. 3, May-June 2006, pp. 24 –40.
24. D. Dalessandro et al., "Initial Performance Evaluation of the NetEffect 10 Gigabit iWARP Adapter," Proc. IEEE Int'l Conf. Cluster Computing, IEEE Press, 2006, pp. 1 –7.
24. D. Dalessandro et al., "Initial Performance Evaluation of the NetEffect 10 Gigabit iWARP Adapter," Proc. IEEE Int'l Conf. Cluster Computing, IEEE Press, 2006, pp. 1 –7.
25. P. Geoffray , "A Critique of RDMA," HPC Wire, http://www.hpcwire.com/hpc815242.html 8 Aug. 2006
25. P. Geoffray, "A Critique of RDMA," HPC Wire, http://www.hpcwire.com/hpc815242.html 8 Aug. 2006
26. R. Recio , "A Tutorial of the RDMA Model," HPC Wire, http://www.hpcwire.com/hpc885757.html. 15 Sept. 2006.
26. R. Recio, "A Tutorial of the RDMA Model," HPC Wire, http://www.hpcwire.com/hpc885757.html. 15 Sept. 2006.
27. Corbet , "Linux and TCP Offload Engines," http://lwn.net/Articles148697 and http://lwn.net/Articles152648.
27. Corbet, "Linux and TCP Offload Engines," http://lwn.net/Articles148697and http://lwn.net/Articles152648.
28. M. Rosenblum and T. Garfinkel , "Virtual Machine Monitors: Current Technology and Future Trends," Computer, vol. 38, no. 5, May 2005, pp. 39 –47.
28. M. Rosenblum and T. Garfinkel, "Virtual Machine Monitors: Current Technology and Future Trends," Computer, vol. 38, no. 5, May 2005, pp. 39 –47.
29. J. Sugerman et al., "Virtualizing I/O Devices on VMware Workstation's Hosted Virtual Machine Monitor," Proc. Usenix Ann. Tech. Conf., Usenix Assoc., 2001, pp. 1 –14.
29. J. Sugerman et al., "Virtualizing I/O Devices on VMware Workstation's Hosted Virtual Machine Monitor," Proc. Usenix Ann. Tech. Conf., Usenix Assoc., 2001, pp. 1 –14.
30. C. Waldspurger , "Memory Resource Management in VMware ESX Server," ACM SIGOPS Operating Systems Rev., vol. 36, Winter 2002, pp. 181 –194.
30. C. Waldspurger, "Memory Resource Management in VMware ESX Server," ACM SIGOPS Operating Systems Rev., vol. 36, Winter 2002, pp. 181 –194.
31. M. Aravind et al., "Optimizing Network Virtualization in Xen," Proc. Usenix Ann. Tech. Conf., Usenix Assoc., 2006, pp. 15 –28.
31. M. Aravind et al., "Optimizing Network Virtualization in Xen," Proc. Usenix Ann. Tech. Conf., Usenix Assoc., 2006, pp. 15 –28.
32. J. Shafer et al., "Concurrent Direct Network Access for Virtual Machine Monitors," Proc. Int'l Symp. High-Performance Computer Architecture (HPCA 2007), IEEE CS Press, 2007, pp. 306 –317.
32. J. Shafer et al., "Concurrent Direct Network Access for Virtual Machine Monitors," Proc. Int'l Symp. High-Performance Computer Architecture (HPCA 2007), IEEE CS Press, 2007, pp. 306 –317.

Index Terms:
Ethernet, I/O and data communications, local-area networks, communication and networking
Citation:
Serag GadelRab, "10-Gigabit Ethernet Connectivity for Computer Servers," IEEE Micro, vol. 27, no. 3, pp. 94-105, May-June 2007, doi:10.1109/MM.2007.46
Usage of this product signifies your acceptance of the Terms of Use.