Breaking News
Blog

Ten quotes on parallel programming

NO RATINGS
Page 1 / 2 Next >
View Comments: Newest First | Oldest First | Threaded View
Page 1 / 4   >   >>
I_O
User Rank
Rookie
re: Ten quotes on parallel programming
I_O   6/26/2012 8:50:58 AM
NO RATINGS
In 1995 I was working on a system of some 300 parallel DSP processors used to analyse acoustic data from multiple sources. This was a single purpose system with steady state data flows from one processor to the next. The system worked because the total processing algorithm could be split into parts with deterministic communications between processors. Trying to replicate this with any more general purpose processing function is the stuff of insanity

sharps_eng
User Rank
Rookie
re: Ten quotes on parallel programming
sharps_eng   11/15/2011 11:34:29 PM
NO RATINGS
Plenty of parallel (mutiple-threaded) code runs today, but on single or a few cores, timeshared to simulate parallelism. This is fine when the processors would otherwise be spinning waiting for shared resources or slow I/O. When there is a real performance bottleneck like searching, codecs or graphics you need extra hardware, cores or logic, no software will help unless the algorithm is improved. Meanwhile I suggest we use some of those spare millions of gates to provide proper transparent hardware memory virtualization so that any thread can allocate or free memory any way with no performance, fragmentation or garbage-collection concerns. That would be truly useful in a chipset.

wave.forest
User Rank
Manager
re: Ten quotes on parallel programming
wave.forest   11/15/2011 8:38:20 PM
NO RATINGS
Thanks! You know what I meant.

wave.forest
User Rank
Manager
re: Ten quotes on parallel programming
wave.forest   11/15/2011 5:58:06 PM
NO RATINGS
:) This is the hard part regarding parallel computing: How to transform a seemingly hardcore sequential problem into a parallel problem? For RSA decipherment, it's well known to use CRT. For exponentiation, you may try Montgomery Ladder. So if you have 4 cores and program them accodingly, you may have 12x to 16x throughput increase. ;)

DU00000001
User Rank
CEO
re: Ten quotes on parallel programming
DU00000001   11/14/2011 5:50:57 PM
NO RATINGS
I love quote 4: "... ends up finding mysterious races they thought weren’t possible ..." I've assisted in identifying quite too many race conditions during the last five years.

adrianvons
User Rank
Rookie
re: Ten quotes on parallel programming
adrianvons   11/14/2011 2:48:13 PM
NO RATINGS
'Life is not complex. We are complex. Life is simple and the simple thing is the right thing.' again good old Oscar Wilde. Anyway, I think there is time for a paradigm shift!

adrianvons
User Rank
Rookie
re: Ten quotes on parallel programming
adrianvons   11/14/2011 2:42:53 PM
NO RATINGS
I think the next quote will help Herb Sutter understand the situation. 'Experience is the name everyone gives to his mistakes' - Oscar Wilde

igrbt
User Rank
Rookie
re: Ten quotes on parallel programming
igrbt   11/13/2011 11:51:52 PM
NO RATINGS
Certain(many) algorithms cannot be "parallelized" including RSA generator related. I should perhaps used word MAY instead of CAN (as far as throughput goes)

wave.forest
User Rank
Manager
re: Ten quotes on parallel programming
wave.forest   11/13/2011 7:46:45 PM
NO RATINGS
I like "programmed accordingly" ;) How? Try M^E mod N - one of the most used functions to see how far you can go.

igrbt
User Rank
Rookie
re: Ten quotes on parallel programming
igrbt   11/12/2011 4:20:35 AM
NO RATINGS
I known phenomena: back in 60s it was discovered that adding more processors on top of 4 did not scale linearly e.g. if we'd expect that throughput would quadruple on 4w CPU system it would only increase by fraction on 4+ system. Overhead of system processing + intrinsic sequential nature many typical algorithms would prevent having this from benefiting. Our modern multi-core processors can simply increase throughput if programmed accordingly

Page 1 / 4   >   >>
August Cartoon Caption Winner!
August Cartoon Caption Winner!
"All the King's horses and all the KIng's men gave up on Humpty, so they handed the problem off to Engineering."
5 comments
Top Comments of the Week
Like Us on Facebook

Datasheets.com Parts Search

185 million searchable parts
(please enter a part number or hit search to begin)
EE Times on Twitter
EE Times Twitter Feed
Flash Poll
Radio
LATEST ARCHIVED BROADCAST
David Patterson, known for his pioneering research that led to RAID, clusters and more, is part of a team at UC Berkeley that recently made its RISC-V processor architecture an open source hardware offering. We talk with Patterson and one of his colleagues behind the effort about the opportunities they see, what new kinds of designs they hope to enable and what it means for today’s commercial processor giants such as Intel, ARM and Imagination Technologies.