United Business Media EE Times


Search

HOMEMARKET INTELLIGENCE UNITFORUMSDESIGNNEW PRODUCTSCAREERSBLOGSCONTACTEVENTSSIGN UP!RSSMost Popular contentTrusted Sources

 


Benchmarks beware
Print this article Email this article Reprints RSS Digital Edition

EE Times


Jeff Bier

In the ancient Near East the number 40 was a literary device symbolizing "an impressively large number," not a precise quantity. "It rained for 40 days and 40 nights," "they wandered in the desert for 40 years"-the examples are countless. In the modern world of DSP processors, "10x" has taken on a similar function. Vendor claims that a processor is, for example, "10x faster than existing DSPs" often don't mean that the processor is really 10 times faster-only that it is "much faster." The problem, I suppose, is that "much faster" just doesn't resonate as strikingly in a press release.

While overblown marketing claims are nothing new, the rapid expansion of the DSP market in recent years has created an increasingly competitive sales environment. This has made processor vendors-even some of the very largest-desperate to get our attention. Many have resorted to hyperbole, which can obscure a new processor's true capabilities.

In the old days (say, five years ago), DSPs generally had very similar architectures. This made comparing processors fairly simple: The main performance differentiator was clock speed, and simple performance metrics like Mips provided useful information.

The increasing diversity of both DSP architectures and applications has now rendered clock speed and simple performance metrics useless in assessing processor performance, and has complicated processor comparisons. We frequently see cases where processor A is twice as fast as processor B on, say, an FFT, but twice as slow on another DSP algorithm-a Viterbi decoder, for instance.

This highlights the importance of using appropriate benchmarks to compare processors for DSP applications: not just any benchmarks, but benchmarks that are representative of the target application.

Unfortunately, hyperbolic performance claims ultimately hurt everyone involved. System designers who naively accept exaggerated claims may find-often too late-that their systems don't meet their design goals. Reporters and market analysts who parrot these claims lose credibility with their readers. Processor vendors making such claims lose the trust of their customers, if not their business.

These days, getting educated is the only way to avoid getting burned: Processor performance claims should be evaluated with both caution and a healthy dose of skepticism.

Jeff Bier is General Manager Of Berkeley Design Technology inc. (www.bdti.com), The DSP Technology Analysis and Software Development Company. Jonah Holmes of BDTI Contributed to this column.





The views and opinions expressed in this column are strictly those of the author and should not be taken as an editorial position of EE Times or any of its other editors, publications or Web sites.


  Free Subscription to EE Times
First Name Last Name
Company Name Title
Email address
  Click here for your Free Subscription to EETimes Europe
 
CAREER CENTER
Looking for a new job?
SEARCH JOBS
SPONSOR

RECENT JOB POSTINGS
CAREER NEWS
SRC Expands R&D Centers
The Semiconductor Research Corp has added a new center to its university R&D efforts.

For more great jobs, career related news, features and services, please visit EETimes' Career Center.


All White Papers »   

 
Education and
Learning


Learn Now:












Home | About | Editorial Calendar | Feedback | Subscriptions | Newsletter | Media Kit | Contact | Reprints|  RSS|   Digital|  Mobile
Network Websites
International
Network Features




All materials on this site Copyright © 2009 TechInsights, a Division of United Business Media LLC All rights reserved.
Privacy Statement | Terms of Service | About