Comment Re:Shiny - High Revenue (Score 1) 28
As someone who also works with large amounts of data every day, I know exactly what I'm talking about. You may want to reread what I actually wrote.
Hadoop is a decent technology and is one approach to dealing with "Big Data" problems. There are other products out there, and for the most part they have all been around a lot longer than Hadoop. The problems all these products address have been around for quite some time, as most people know.
So what is the difference at this point in time? Did everyone's data suddenly get fat or something? No. What has happened is that Google published their version of a map and reduce algorithm (with ideas for dealing with associated things like storage), someone else built an open source engine around it, and some other people started publicizing it. There is no problem with any of this.
But then some companies mistakenly believe that their one-million-row MySQL database is "Big Data" and get their IT staff to adopt this shiny -- and it is shiny, you know, compared to the older systems -- technology for their OMG Huge Database. This is what I was talking about. This is a misapplication of technology. It's as bad as using a poorly-tuned Oracle RAC on true "Big Data" databases. Sure, it works. But it's the wrong solution and eventually the company pays a much bigger price than they originally thought.
My bet is that most of Hadoop's growth is due to the marketing and "me too" effects rather than true technological need.