Embedded Systems Conference
Breaking News
Comments
Newest First | Oldest First | Threaded View
<<   <   Page 2 / 4   >   >>
Eric Verhulst_Altreonic
User Rank
Author
re: Ten quotes on parallel programming
Eric Verhulst_Altreonic   11/11/2011 9:36:45 PM
NO RATINGS
My own since 20 years: Design parallel, optimize by sequentialisation. Software is modelling and most of the things we model are inherently concurrent (or parallel). Almost anything can be expressed as a set of "Interacting Entities". The reason we can get more out of the computer by sequentialisation is because the hardware in inherently designed to be sequential. I call that the von Neuman syndrome. To get most out of 2 or more processors, the program must be designed as a parallel one. Getting parallelism out of a sequential program is really an exercise in reverse engineering.

RoweBots1
User Rank
Author
re: Ten quotes on parallel programming
RoweBots1   11/11/2011 2:50:12 PM
NO RATINGS
One benefit of the array computing approach is that natural parallelism can be exploited, albeit in an inefficient way. The difficulty with this approach is that it fails to deal with I/O. Possibly some mix of this approach with traditional approaches are required. I would note that in many ways the array computing approach maps into CSP. The real problem is that we think sequentially, understand natural parallelism, and have difficulty being creative enough to turn serial streams of processing into parallel algorithms.

RoweBots1
User Rank
Author
re: Ten quotes on parallel programming
RoweBots1   11/11/2011 2:44:05 PM
NO RATINGS
This is a good comment. In image processing often this is very clear by cutting the image into sections; however in many problems the view of early parallel programmers seems more appropriate: Paraphrased it was: "parallel algorithms for the real world are like so much smoke" - creators of Illiac IV, a 64 processor SIMD machine build in 1969. I think that many problems become serial and this is the limitation of multicore. System designers and programmers can think and debug in parallel when natural parallelism exists. They can rise to the occasion and put multiple data processing streams on a shared multicore platform. What they can't do is take a clearly sequential problem and make it parallel. This has been the barrier for the past 30 years.

sharps_eng
User Rank
Author
re: Ten quotes on parallel programming
sharps_eng   11/10/2011 9:39:52 PM
NO RATINGS
Good question. CSP does look a bit ugly but not so bad as C. I guess it needs a makeover like occam got in its incarnation as a hardware language wrapped up in C. Better yet, a graphical (3D?) programming toolset.

Semiconductor Design Engineer
User Rank
Author
re: Ten quotes on parallel programming
Semiconductor Design Engineer   11/9/2011 10:02:17 PM
NO RATINGS
OMGosh, that's brilliant :-), and thanks for making me laugh so hard I shot hot coffee out my nose :-)

KarlS
User Rank
Author
re: Ten quotes on parallel programming
KarlS   11/9/2011 3:30:57 PM
NO RATINGS
Then there's the overlooked fact that there's not enough "processing" to benefit from multi-things in many situations. In a decision/logic tree there can be many initial decisions that are very simple where results must be combined in order to proceed to the next level. Dispatching a task or thread to test if a number is less then zero probably has ten times as much overhead as the compare and to do it to 10 processors for 10 compares wastes a lot of power and time. Here is where a chip can beat the processor by simply testing the sign bit of a register as an instance.

wave.forest
User Rank
Author
re: Ten quotes on parallel programming
wave.forest   11/9/2011 2:51:11 PM
NO RATINGS
It appears no one has mentioned "data dependency" which kills parallel computing because it is too much for a mediocre programmer to take it on. The hard part of parallel computing is to break a data dependent sequence problem into multiple data independent pieces to leverage multiple cores. "I decided long ago to stick to what I know best. Other people understand parallel machines much better than I do; programmers should listen to them, not me, for guidance on how to deal with simultaneity." Donald Knuth, professor emeritus at Stanford

ooferwog
User Rank
Author
re: Ten quotes on parallel programming
ooferwog   11/8/2011 8:25:59 PM
NO RATINGS
"The wall is there. We probably won't have any more products without multicore processors [but] we see a lot of problems in parallel programming." Alex Bachmutsky, chief architect at Nokia Siemens Networks. Which reminds me of Microsoft's short-lived ad campaign whose tag line was: "Imagine life - without walls." Now, I don't think Mr. Bachmutsky's 'wall' was the same sort of wall M$ had in mind (lord knows for them I'm still it's still over the horizon), but I must say that the very first thing that came to mind when I saw Microsoft's ridiculous advert on that billboard was this: "Look, Microsoft, if you don't have walls then what possible use would you have for Windows?" I wrote Microsoft and asked about it, but no one replied. Imagine my surprise. Then, not long ago Microsoft released a product which they dubbed 'Azure.' Remind you of anything? Azure? Blue? Blue, as in "Blue Screen of Death?" I think there's a Linux mole in Marketing. Tex

ooferwog
User Rank
Author
re: Ten quotes on parallel programming
ooferwog   11/8/2011 8:01:21 PM
NO RATINGS
Brian Kernighan certainly has Microsoft pegged. Hi Herb! Tex

fundamentals
User Rank
Author
re: Ten quotes on parallel programming
fundamentals   11/8/2011 3:10:56 PM
NO RATINGS
I like Kernigan's quote the best. It goes to the heart of what is most difficult about parallel programming: debugging. I don't listen to the arm-chair-experts who keep telling us how to write code with accurate modelling so that the program will be bug free. That sort of thing is just wishful thinking. No large program that I know of is bug free, and almost all of them are sequential programs. Now try designing a bug free concurrent program. If it is large enough, it will have bugs (most likely many more than an average sequential program.) Then get ready for your hardest task ever: debugging it!

<<   <   Page 2 / 4   >   >>


Radio
LATEST ARCHIVED BROADCAST
Overview: Battle-hardened veterans of the electronics industry have heard of the “connected car” so often that they assume it’s a done deal. But do we really know what it takes to get a car connected and what its future entails? Join EE Times editor Junko Yoshida as she moderates a panel of movers and shakers in the connected car business. Executives from Cisco, Siemens and NXP will share ideas, plans and hopes for connected cars and their future. After the first 30 minutes of the radio show, our listeners will have the opportunity to ask questions via live online chat.
Top Comments of the Week
Flash Poll
Like Us on Facebook

Datasheets.com Parts Search

185 million searchable parts
(please enter a part number or hit search to begin)
Special Video Section
LED lighting is an important feature in today’s and future ...
Active balancing of series connected battery stacks exists ...
After a four-year absence, Infineon returns to Mobile World ...
A laptop’s 65-watt adapter can be made 6 times smaller and ...
An industry network should have device and data security at ...
The LTC2975 is a four-channel PMBus Power System Manager ...
In this video, a new high speed CMOS output comparator ...
The LT8640 is a 42V, 5A synchronous step-down regulator ...
The LTC2000 high-speed DAC has low noise and excellent ...
How do you protect the load and ensure output continues to ...
General-purpose DACs have applications in instrumentation, ...
Linear Technology demonstrates its latest measurement ...
10:29
Demos from Maxim Integrated at Electronica 2014 show ...
Bosch CEO Stefan Finkbeiner shows off latest combo and ...
STMicroelectronics demoed this simple gesture control ...
Keysight shows you what signals lurk in real-time at 510MHz ...
TE Connectivity's clear-plastic, full-size model car shows ...
Why culture makes Linear Tech a winner.
Recently formed Architects of Modern Power consortium ...
Specially modified Corvette C7 Stingray responds to ex Indy ...