Design Con 2015
Breaking News
Comments
Oldest First | Newest First | Threaded View
Page 1 / 3   >   >>
junko.yoshida
User Rank
Blogger
System-level benchmarking
junko.yoshida   8/19/2013 3:09:32 PM
NO RATINGS
One of the most frustrating things for reporters is this. When we ask chip vendors about the performance of their apps processors for smartphones, for example, their answers tend to be specific numbers based on the benchmarking results of CPU and GPu; or they would respond: "Well, it all depends on use-case scenarios."

I'd love to have some answers based on system-level benchmarks -- a tool that measures the performance of a whole phone, based on specifics that consumers care about.  

rick merritt
User Rank
Author
Re: System-level benchmarking
rick merritt   8/19/2013 7:36:56 PM
NO RATINGS
So I guess the door is open for someone to go to Mediatek, Nvidia or Broadcom and develop a competing smartphone benchmark.

 

Patk0317
User Rank
CEO
Re: System-level benchmarking
Patk0317   8/19/2013 9:20:38 PM
NO RATINGS
Junko,

Benchmarks should be renamed to Benchmarketing. (Did I just coin a new term?). I have been involved with becnhmarks since the PREP benchmarking days for FPGAs in the late 1980s and the early 1990s which were gamesmanship at best. Benchmarketing - that's what it is - your mileage may vary ...

Patrick

junko.yoshida
User Rank
Blogger
Re: System-level benchmarking
junko.yoshida   8/19/2013 10:22:39 PM
NO RATINGS
Patrick, "benchmarketing" ain't bad.

The reality is, though, no matter how skeptical and cynical you might get with benchmarketing, benchmark results are often touted and marketed aggressively by those who have money, power and vested interest. 

Susan Rambo
User Rank
Blogger
Re: System-level benchmarking
Susan Rambo   8/20/2013 3:42:11 AM
NO RATINGS
I think testing should happen in US and China at least during the first year of test. I'd like to see if there's a difference in results. Interesting story. Thanks, Junko.

 

Susan Rambo
User Rank
Blogger
Re: System-level benchmarking
Susan Rambo   8/20/2013 3:46:14 AM
NO RATINGS
Like the "benchmarketing" term. (I noticed BDTI is marketing its benchmarket study in this article--marketing benchmarketing.) It will be interesting to see the results of the study. I'd like to compare BDTI results to Consumer Reports'.

junko.yoshida
User Rank
Blogger
Re: System-level benchmarking
junko.yoshida   8/20/2013 8:35:34 AM
NO RATINGS
Susan, I too think that including Chinese smartphones in the mix is very interesting. Considering the growing number of mobile users and smartphones in China, the move is timely. 

prabhakar_deosthali
User Rank
CEO
Simple benchmark from the users' perspective
prabhakar_deosthali   8/20/2013 9:25:55 AM
NO RATINGS
In my opinion, benchmarking of smart phones as far as the end user is concerned should be done on the following criterion

1. The Battery recharge interval

2.  The no of keys/touches required to perform a function

3. How fast the phone boots up

 

This simple criterion will test the processor speed, memory access, UI and power consumption.

 

junko.yoshida
User Rank
Blogger
Re: Simple benchmark from the users' perspective
junko.yoshida   8/20/2013 10:20:40 AM
NO RATINGS
@prabhakar, I like your #2 on the list. How many key strokes (or touch) are necessary to get to the function you need to use is important.

 

DMcCunney
User Rank
CEO
Re: System-level benchmarking
DMcCunney   8/20/2013 1:46:17 PM
NO RATINGS
Structured in a manner that will emphasize the strengths of their offerings?

It reminds me of the comment "The nice thing about standards is there's so many of them!"

I don't have a problem with BDTI being funded by Qualcomm to do this, as long as they are open about their methodology, what they are measuring, and what conclusions might be drawn from it.  Someone has to pay the costs of developing such a thing,

Once they have something they think works, the next step is to pitch it to the appropriate industry consortium as the standard way you measure what the benchmarks track.  Then you make popcorn and sit back and watch the fun.

 

Page 1 / 3   >   >>


Most Recent Comments
Top Comments of the Week
Flash Poll
Like Us on Facebook

Datasheets.com Parts Search

185 million searchable parts
(please enter a part number or hit search to begin)
EE Life
Frankenstein's Fix, Teardowns, Sideshows, Design Contests, Reader Content & More
<b><a href=Betajet">

The Circle – The Future's Imperfect in the Present Tense
Betajet
5 comments
The Circle, a satirical, dystopian novel published in 2013 by San Francisco-based writer Dave Eggers, is about a large, very powerful technology company that combines aspects of Google, ...

Max Maxfield

Recommended Reads From the Engineer's Bookshelf
Max Maxfield
25 comments
I'm not sure if I read more than most folks or not, but I do I know that I spend quite a lot of time reading. I hate to be idle, so I always have a book or two somewhere about my person -- ...

Martin Rowe

Make This Engineering Museum a Reality
Martin Rowe
Post a comment
Vincent Valentine is a man on a mission. He wants to make the first house to ever have a telephone into a telephone museum. Without help, it may not happen.

Rich Quinnell

Making the Grade in Industrial Design
Rich Quinnell
16 comments
As every developer knows, there are the paper specifications for a product design, and then there are the real requirements. The paper specs are dry, bland, and rigidly numeric, making ...

Special Video Section
The LT8640 is a 42V, 5A synchronous step-down regulator ...
The LTC2000 high-speed DAC has low noise and excellent ...
How do you protect the load and ensure output continues to ...
General-purpose DACs have applications in instrumentation, ...
Linear Technology demonstrates its latest measurement ...
10:29
Demos from Maxim Integrated at Electronica 2014 show ...
Bosch CEO Stefan Finkbeiner shows off latest combo and ...
STMicroelectronics demoed this simple gesture control ...
Keysight shows you what signals lurk in real-time at 510MHz ...
TE Connectivity's clear-plastic, full-size model car shows ...
Why culture makes Linear Tech a winner.
Recently formed Architects of Modern Power consortium ...
Specially modified Corvette C7 Stingray responds to ex Indy ...
Avago’s ACPL-K30T is the first solid-state driver qualified ...
NXP launches its line of multi-gate, multifunction, ...
Doug Bailey, VP of marketing at Power Integrations, gives a ...
See how to ease software bring-up with DesignWare IP ...
DesignWare IP Prototyping Kits enable fast software ...
This video explores the LT3086, a new member of our LDO+ ...
In today’s modern electronic systems, the need for power ...