Breaking News
Comments
EREBUS0
User Rank
Rookie
re: Will 2013 be the year of Big Data?
EREBUS0   1/22/2013 8:35:35 PM
NO RATINGS
For big data to work, you need to understand the data collected, learn to process the data for information, validate the data transformation and then use the data to accurately predict a future event. I have watched the progress of the technology for the last three decades and I am not convinced that any of the factors I highlighted are ready for real use. Yes, we are collecting a lot of data, but there is such a rush to show progress that the validation of results is being ignored. Before Big Data becomes useful, it has to develop a level of trust in its results. I do not see that happening any time soon.

docdivakar
User Rank
Manager
re: Will 2013 be the year of Big Data?
docdivakar   1/23/2013 6:13:09 PM
NO RATINGS
@EREBUS, I agree one needs to understand, analyze, generate usable metrics, provide decision making and prognostics from big data. Much of the noise in big data has been in the collection, storage, access and (some) analytics but the rest are lacking, pitifully! Readers may be interested in the link on the topic: Big Data for Smaller Providers –Part 1 http://viodi.com/2012/12/27/big-data-for-smaller-providers-part-1/ MP Divakar

dortloff
User Rank
Rookie
re: Will 2013 be the year of Big Data?
dortloff   1/25/2013 10:02:06 AM
NO RATINGS
@EREBUS, @DOCDIVAR: I agree with your statements that the validation is still lacking. To me, we are only at the beginning of the Big Data era and until it fulfills its promises, it will take a while. Looking back into my career, the technologies mentioned in the article referenced by docdivacar were already a topic of discussion and partly in action in the telecom business 15 years ago. The level of big data adoption really depends on the industry you are looking at. I am currently working for IT solutions in semiconductor (and alike) R&D. Looking there even the collection step is still in its infancy in many organizations. Data is collected in all kinds of data silos (file / MS Sharepoint servers, MS Excel, single purpose databases, …) and cleaning, arranging and analysis is pretty much down to the research engineers. Most of the time even the relations of the data points are not properly archived or data pieces are missing, therefore gaining information from R&D experiments is a challenge. Although solutions for the first steps in your mentioned action sequence are available, people are oftentimes hesitant to adopt and stick with their 25+ years old methodologies. To me big data does depend as much on the willingness to walk the first steps as on the technology. Without early adopters there is no progress in technology. So beside solving the technological challenge we need to educate people to overcome the inertia of adopting new ways of working and thinking while at the same time not to blindly trust the new technologies alone!



Flash Poll
Top Comments of the Week
Like Us on Facebook
EE Times on Twitter
EE Times Twitter Feed

Datasheets.com Parts Search

185 million searchable parts
(please enter a part number or hit search to begin)
EE Life
Frankenstein's Fix, Teardowns, Sideshows, Design Contests, Reader Content & More
Max Maxfield

Energizing the Young Engineers of Tomorrow
Max Maxfield
15 comments
It doesn't seem all that long ago when I was a bright-eyed, bushy-tailed young engineer. Now I feel like an old fool, but where are we going to find one at this time of the day (LOL)?

Jolt Judges and Andrew Binstock

Jolt Awards: The Best Books
Jolt Judges and Andrew Binstock
1 Comment
As we do every year, Dr. Dobb's recognizes the best books of the last 12 months via the Jolt Awards -- our cycle of product awards given out every two months in each of six categories. No ...

Engineering Investigations

Air Conditioner Falls From Window, Still Works
Engineering Investigations
2 comments
It's autumn in New England. The leaves are turning to red, orange, and gold, my roses are in their second bloom, and it's time to remove the air conditioner from the window. On September ...

David Blaza

The Other Tesla
David Blaza
5 comments
I find myself going to Kickstarter and Indiegogo on a regular basis these days because they have become real innovation marketplaces. As far as I'm concerned, this is where a lot of cool ...