Design Article

IMG1

Design for network convergence

Jim McKeon, Cortina Systems

5/8/2006 11:29 AM EDT

Convergence is a dominant theme in modern telecommunications and networking, and it touches virtually all levels of the communications hierarchy. In the core, carriers desire a simple, unified network over which to offer largely packet-oriented services. For access, cable, DSL, and Passive Optical Network (PON) alternatives compete for the last mile, while the aggregation equipment transitions from ATM circuit uplinks to IP packets. In wireless, base stations are making a similar transition from ATM to IP. And in the enterprise, businesses wish to unify distinct voice and data systems in favor of a single, converged network.

This article will consider some of the history of the communications and data networking industries with an eye to how the disparate past is evolving into a unified future.

Background
The past forty years of communications and networking industry development has left a vast footprint of technology standards and protocols. The earliest of these was voice, where the T-carrier system of the 1960's introduced the first digitization of speech. As these networks expanded and demand arose in the 1980's for data networking alongside voice, pressure developed for a standard interface between telecom operators as well as a roadmap to higher-bandwidth links; the result was the SONET protocol.

Simultaneously in the 1980's, Token Ring and Ethernet battled for LAN interconnection supremacy. As Ethernet achieved dominance by the mid-nineties, the vision of a unified network began to take hold among enterprises and service providers alike. For the enterprise, this was a means of dispensing with a separate phone network; for carriers, leased lines would become a thing of the past.

The telecom community produced the ATM standards in the 1990's as a solution to this unification problem, and this was an early step towards convergence. However, ATM was caught on the wrong side of a trend--the world was moving away from circuits and towards packets. Although ATM achieved wide deployment in many telecom verticals, particularly wireless and DSL aggregation, it never succeeded in the LAN; the cost advantages of Ethernet-based packet networking were too dramatic, and the applications at the time couldn't benefit from ATM service guarantees. By the late 1990's the prevailing view of convergence had shifted, and methods to scale Ethernet into traditional circuit realms gained momentum.

Today we are somewhere in the middle of the transition to that converged Ethernet network. With the stacked VLAN (802.1ad) and provider bridging (802.1ah) enhancements to the Ethernet standard, the customer separation and management infrastructure is emerging that will allow carriers and their customers to share a common Ethernet domain. Concurrently, the Resilient Packet Ring (RPR, or 802.17) standard provides for simple transmission of Ethernet frames in a ring-based topology and enables economical telecom-quality reliability. Both of these developments are symptoms of a dominant preference for packet-based over circuit-based networks.

The widespread adoption of Voice Over IP (VOIP) technology both throughout the enterprise and increasingly among the carriers themselves is helping shape this preference. By defining Quality of Service (QoS) requirements and taking advantage of the bursty nature of Ethernet traffic, VOIP allows enterprises to merge their voice traffic onto the data network and dispense with separate PBX equipment. The Power Over Ethernet (802.3af) standard was an important milestone in this effort, allowing a copper 10/100 Ethernet connection to supply power to the phone unit and successfully replicating the existing telephone service model.

VOIP technologies are also quickly transforming the residential voice landscape, as customers choose to receive voice service over either their cable/DSL connections via a third-party provider like Skype or Vonage, or directly from a cable company competing against the incumbent phone monopoly. Even the traditional voice providers themselves are moving in this direction, with British Telecom perhaps the most visible proponent--they intend to offer only a fully converged packet network by 2010.

What to do?
So where does this leave the networking equipment industry? Because we are still in the midst of this transition to a packet-based, largely Ethernet world, the old means of providing voice and data services cannot be ignored or marginalized. The installed base of SONET transport equipment, particularly in North America, exceeds several billions of dollars and still has many years of useful service ahead of it. ATM is still deeply entrenched in both the wireless and access markets. And, the migration to an Ethernet metro service model is steady but slow, leaving most businesses still relying on T-1 connections for Internet and VPN connectivity.

At its root, today's convergence means offering a single packet network while preserving the flexibility to integrate legacy connections. This can take a variety of forms: multiple protocols on an individual port, split circuit and packet capabilities, or enhanced QoS. Let's consider each of these in turn.

The core transport SONET network has already converged on MPLS for packet routing in most large providers. But even within this 'unified' network there are multiple widely-installed Layer 1 and 2 protocol choices that must be supported, including Packet Over SONET, ATM, and Ethernet Over SONET. Because these are mapping choices, they can be efficiently supported in the interface silicon of the carrier equipment. With today's highly integrated silicon it is possible to support them all simultaneously on the same IC, reducing the number of discrete line cards that the system vendor must offer.

An additional requirement is supporting the multiple rates of SONET, which range from OC-3 (~155 Mbps) to OC-192 (10 Gbps). Again relying on the power of advanced semiconductor integration, many of these can be integrated on the same device and provide an additional lever of flexibility to the system vendor. This integration extends all the way to the optical module as the interface silicon can include a multi-rate serdes as the line interface, with all framing and mapping work completed in the device.


In the transport market, established networks are often organized into ring topologies based upon SONET. Although suffering the limitations of a circuit-oriented system, SONET provides important management and reliability capabilities that make the provisioning of a nationwide network comprising thousands of nodes feasible and economic. The equipment that bridges traffic on and off these rings is the Add-Drop Mux (ADM). Traditionally these supplied SONET connections both along the ring and from the feeder ports. The SONET circuit conventions were preserved throughout the system, so that both the switch ports and the fabric interconnecting them were circuit-oriented. This made particular sense when voice circuits comprised most of the feeder traffic.

But as packet data has grown to dominate the feeder traffic, there is economy in pushing the packet-awareness into the ADM and isolating SONET to the transport domain. To enable an easy migration, vendors developed the Multi-Service Provisioning Platform (MSPP), a converged system that employs parallel switching fabrics and interface logic, one for circuits on the ring and the other for packet connections among the feeder ports. By integrating Layer 2 packet technology into the MSPP, fewer expensive router ports are required to support connectivity to the transport domain.


Figure 2. MSPP

One step beyond the dual fabric is a redesign of the transport network itself, architecting it around packet transport while creating structures to support legacy circuits; this is the promise of RPR. In a nutshell, RPR melds the resiliency and management advantages of SONET onto a packet ring network. Designed as a packet-based alternative to SONET, RPR is gaining particular momentum as an attractive aggregation mechanism for residential and business access.

Using a packet ring to aggregate packet data is highly efficient, because the bursty nature of packet data allows extensive statistical multiplexing of the ring capacity. Instead of dedicating a fixed circuit to a particular customer, the carrier can oversubscribe the ring bandwidth among a large population of users with reasonable certainly that the traffic patterns won’t overlap. For traffic sensitive to packet loss, such as voice or network control, RPR provides several configurable levels of QoS that convey strict guarantees of an appropriate amount of ring bandwidth.


Figure 3. RPR vs. Fixed SONET circuits

Here is another area where integrated silicon solutions can assist an evolutionary convergence of the network. RPR interfaces can be easily combined with both the packet and circuit switch fabrics in existing ADM's, such that these devices can be upgraded to support RPR rings in parallel with their existing connections or to replace them. The carrier can transition to an RPR access or metro strategy without having to risk an expensive and tricky wholesale upgrade.


Figure 4. RPR on the MSPP

As these examples show, QoS is one of the keys to successful convergence. Although circuit networks are sub-optimal for carrying packet data, they provide extremely reliable and predictable service quality. Once a customer has paid for a circuit and the provider has bolted it down through their network, the user will always get exactly that amount of bandwidth whether they use it or not. This guarantee is exceptionally valuable, particularly for voice transport, and the challenge for packet networks is to match this capability.

With the transition to VOIP in the enterprise, this service guarantee reaches center stage. Most businesses rely on their phone network 24/7, and it can be financially painful and in some cases a breach of contract for those phone connections to go out of service. However, if voice traffic is blindly merged onto the existing enterprise LAN, service interruptions are likely and will occur with greatest frequency during the working day when the network is most utilized and the phone connections most critical.

Ethernet is an inherently bursty protocol; the combination of many users sharing random access to the network produces spikes in utilization. Another important, and often overlooked, aspect of Ethernet is the absence of an access reservatio--a node on the network may begin transmitting whenever it chooses, and for however long. Because most LANs are organized in a hub and spoke system, the total interconnect bandwidth is far less than the sum of all the bandwidth on each user's desktop. If all users chose to send the full bandwidth at the same time, the core of the network lacks the capacity to complete the transmissions and will drop packets; this is where quality of service enters the picture.

This oversubscription of the core switching bandwidth need not degrade application utility. Because of the retransmission policies of the TCP protocol, most services are resilient to packet loss and don’t require reserved bandwidth on the network. It is only real-time communications, such as voice or videoconferencing and network control traffic, that relies on low latency and minimal packet drops. By carefully classifying the traffic stream, and distinguishing the critical packets, the networking equipment can guarantee that only the traffic that truly needs preferential access to the network receives it.


Figure 5. Ethernet Oversubscription

Line card count and productivity
To service both the old world and the new, potentially each port configuration and each protocol requires a new line card. Yet, developing a card for each point solution is enormously inefficient, and ignores the extensive commonality in the underlying technology of each card. A better solution is possible: architect both the system and the underlying ICs to leverage common technology for multiple end products.

A new line card development is an enormous expenditure of R&D dollars and human resources. After IC design, board design, NRE charges, board/IC spins, and qualification cycles an equipment vendor can easily spend in excess of $10 million developing a new line card. But the costs don't end there: once that line card is released into production it must be separately procured, tested, tracked, and inventoried. After the card leaves the manufacturer and enters the distribution system, the tracking and inventory costs are incurred once again. Even in the hands of the end customer, multiple discrete cards can create a qualification and inventory nightmare.

Two factors can dramatically reduce the impact of this: an emphasis on convergence and the emergence of multi-protocol silicon. If the system vendor understands this dynamic, they can architect their cards with an eye towards identifying the common functions inherent in each. And the component vendor can dramatically influence the costs incurred in the system by tailoring their IC design to suit this multi-protocol, multi-rate environment. The situations described above illustrate how the IC and system industries can work together to facilitate convergence efficiently and with minimal disruption to the installed base.

Conclusions
As the communications industry transitions from a multi-protocol, multi-network system to a converged, packet-based, unified system, communications equipment will need to bridge the gap between the old and the new. Highly integrated networking silicon provides a means to cost-effectively service different protocols from a single IC, reducing the quantity of line card developments and improving vendor return on investment. Advanced architectural techniques, such as deep packet inspection and traffic management, provide the necessary quality of service for packet-based networks to achieve the converged vision and replicate the advantages of circuit switching with packet technology.

For equipment vendors, revenue growth in the latter part of the decade will depend upon a ruthless focus on productivity improvement. The true test of any technology is whether it solves important problems more cheaply and effectively than current means. For equipment vendors to increase the size of the networking pie they must embrace a converged vision that enables a cost-effective evolution from the multi-protocol world of the past to the unified network of the future.

About the Author
Jim McKeon a product manager for Ethernet devices at Cortina Systems. He holds A.B. and B.E. degrees from Dartmouth College and an MSEE from the University of Texas at Austin. Jim can be reached at: jim@cortina-systems.com


print

email

rss

Bookmark and Share

Joinpost comment




Please sign in to post comment

Navigate to related information

Product Parts Search

Enter part number or keyword
PartsSearch

FeedbackForm