Breaking News
Comments
Newest First | Oldest First | Threaded View
Page 1 / 2   >   >>
Wilco1
User Rank
CEO
Re: Compiler Question
Wilco1   7/18/2013 6:33:29 AM
NO RATINGS
Agreed, GCC is currently the only official compiler on Android, so the OS and all native code is compiled with it. Therefore any Android benchmarking should be done using GCC. Using GCC also has the advantage that unlike some other compilers it is not optimized to do well on benchmarks (or even break them) but actually focusses on performing well on real code.

The next version of AnTuTu will revert back to GCC. Hopefully they also fix the compiler options to be the same on all targets (the ARM version was compiled -Os with inlining and unrolling disabled) so that we finally end up with a fair comparison. Of course none of this changes the fact the benchmark itself remains rubbish - setting bits in memory is not a good memory performance test.

JeffBier
User Rank
Blogger
Re: Compiler Question
JeffBier   7/17/2013 12:08:32 AM
NO RATINGS
Another way to look at this is:  Since we're talking about performance of mobile devices running Android, perhaps benchmarks should use whichever compiler is typically used for on a given processor when that processor is used in Android mobile devices.

In other words, rather than choosing the compiler that yields the best benchmark results, let's use the compiler (and compiler settings) that yields the most realistic benchmark results.

luting
User Rank
CEO
Compiler Question
luting   7/16/2013 2:45:05 PM
NO RATINGS
Jim,

I feel it is not fair to Compare GCC on ARM Processor against ICC on Intel Processor. From my past experience, ARMCC used to outpform GCC 2:1 in some cases. So I feel fair comparison should be either GCC on both ARM & Intel Processor or ARMCC on ARM Processor and ICC on Intel Processor. Of course, that will give ARM processor more edge against Intel Processor. I know ARM inc has been working to improve GNU compiler efficiency. So the gap between ARMCC and GCC might not be as bigger as used to be.

JimMcGregor
User Rank
Blogger
Re: Timing and menaing of benchmarks
JimMcGregor   7/14/2013 1:26:52 PM
NO RATINGS
In terms of the timing, I and many of my colleagues were made aware of the 3.2.2 revision on Wednesday evening, which is what I am going by.

In terms of performance being meaningless, I agree. The best measure is efficiency (performance/Watt), and the most accurate measurement is platform efficiency. Even measuring just the CPU core or SoC is rather meaningless. Take the Intel Atom vs. the Qualcomm Snapdragon. If you were doing a fair comparison you should include all the functions that are integrated into the Snapdragon, such as wi-fi and the cellular baseband modem. On a platfom without those functions integrated into the SoC like the Atom, you have to factor in the combo chip, the baseband modem chip, and the filters managing coexistence issues. Then you need to add in any external accelerators that the other platforms may or may not have ro require, such as image signal processors, video processors, DSP, etc. And this is just to make a viable silicon comparison. However, if you really want to measure overall performance and power, you need to factor all the other system components and software as well.

So, I agree that we need a better way to evalaute mobile paltfroms and the key components that drive them. Any suggestions?

perbacco
User Rank
Rookie
Absolute performance is meaningless
perbacco   7/12/2013 11:14:46 PM
NO RATINGS
Just showing performance numbers without measuing how much energy has been actually used to run the benchmark is meaningless. A quad core out-of-order CPU beating a dual-core in-order CPU in multi-thread benchmarks..color me surprised! 

nick.ro
User Rank
Rookie
Re: Wednesday evening ?
nick.ro   7/12/2013 8:59:57 PM
NO RATINGS
nick.ro
User Rank
Rookie
Re: Wednesday evening ?
nick.ro   7/12/2013 8:54:49 PM
NO RATINGS
Please google 安兔兔 3.3.2

results:

5 days ago

4 days ago

3 days ago

nick.ro
User Rank
Rookie
Re: Wednesday evening ?
nick.ro   7/12/2013 8:36:41 PM
NO RATINGS
Google play isn't only one, you should use google.com. first appeared in China.

JeffBier
User Rank
Blogger
Re: Wednesday evening ?
JeffBier   7/12/2013 8:29:47 PM
NO RATINGS
 

"I confirm the AnTuTu 3.3.2 release on July 8 or July 9."

The Google Play store shows AnTuTu 3.3.2 released on July 10, 2013: http://bit.ly/15BV4EA

nick.ro
User Rank
Rookie
Wednesday evening ?
nick.ro   7/12/2013 7:52:36 PM
NO RATINGS
Jim, really is on wednesday evening?

I confirm the AnTuTu 3.3.2 release on July 8 or July 9.

Page 1 / 2   >   >>


Flash Poll
EE Life
Frankenstein's Fix, Teardowns, Sideshows, Design Contests, Reader Content & More
Engineer's Bookshelf
Caleb Kraft

The Martian: A Delightful Exploration of Math, Mars & Feces
Caleb Kraft
3 comments
To say that Andy Weir's The Martian is an exploration of math, Mars, and feces is a slight simplification. I doubt that the author would have any complaints, though.

The Engineering Life - Around the Web
Caleb Kraft

Surprise TOQ Teardown at EELive!
Caleb Kraft
Post a comment
This year, for EELive! I had a little surprise that I was quite eager to share. Qualcomm had given us a TOQ smart watch in order to award someone a prize. We were given complete freedom to ...

Design Contests & Competitions
Caleb Kraft

Join The Balancing Act With April's Caption Contest
Caleb Kraft
54 comments
Sometimes it can feel like you're really performing in the big tent when presenting your hardware. This month's caption contest exemplifies this wonderfully.

Engineering Investigations
Caleb Kraft

Frankenstein's Fix: The Winners Announced!
Caleb Kraft
8 comments
The Frankenstein's Fix contest for the Tektronix Scope has finally officially come to an end. We had an incredibly amusing live chat earlier today to announce the winners. However, we ...

Top Comments of the Week
Like Us on Facebook
EE Times on Twitter
EE Times Twitter Feed

Datasheets.com Parts Search

185 million searchable parts
(please enter a part number or hit search to begin)