Breaking

Tuesday, March 3, 2015

Hadoop is probably as mature as it's going to get

Five years past, Hadoop came roaring into the thought because the solutions to any or all massive information issues.


We area unit currently dead-center within the middle of the second decade of the twenty first century. once massive information mania got rolling around 5 years past, the accord that the longer term slipped the name Hadoop was shockingly pervasive. Growth within the Hadoop market since that point showed that this was no fashion. The unrelenting packaging has a minimum of had some grounding in Hadoop’s marketplace adoption and innovation.

Given that everyone just about agrees Hadoop is vital, should we tend to within the massive information business continue beating the drum for its proverbial “next massive thing” status? Has Hadoop’s inflection purpose lang syne passed -- and is its maturation purpose quick approaching? once a phase shows all the signs of maturation, it’s time to tone down the selling overkill. The Hadoop “next massive thing” could currently be as “big” as it’ll ever get, in terms of its share of the massive information analytics market (though the market could itself continue growing just like the proverbial gangbusters).

To determine whether or not Hadoop has reached this time, let’s review however way this phase has come back and the way it will doubtless evolve going forward.

Startup activity could be a clear sign of a growth market, and its decline could be a robust signal of maturation. once an incredible burst of startup formation within the early years of this decade, it'd currently seem that Hadoop platform, tool, and application vendors have settled into a well-recognized cluster of usual suspects. as an example, each single merchant mentioned during this recent InformationWeek market summary was already during this house 3 to four years past once I was Forrester’s Hadoop analyst. That’s one clear sign of a maturing market.

Another sign of Hadoop’s maturation is that the proven fact that the chief demand drivers area unit primarily constant from year to year, reflective a distinct segment that's continued to scratch an equivalent itch. Once again, the cited article rattles off survey response numbers showing that users adopt Hadoop primarily for unstructured information analysis, prophetic  client analytics, sentiment analysis, and so on. None of that's appreciably completely different from what I saw in my primary analysis into the then-embryonic Hadoop market in 2011.

Yet another sign of phase maturation is that the proven fact that the business tends to hammer on an equivalent themes over and over, year once year, as befits an answer house that has found its useful sweet spot. as an example, the massive information blogosphere continues to tediously dialogue the already settled issue of whether or not SQL includes a future within the Hadoop scheme. the solution is by all odds affirmative, as proven by the vary of different SQL access/analysis choices from each major merchant listed within the cited article.

Related to that “hammering an equivalent recent themes” trend is that the matter of Hadoop’s still-blurry market scope. As I declared during this Dataversity column from last Gregorian calendar month, Hadoop still has no clear boundaries (vis-à-vis NoSQL and different massive information approaches), that was primarily what I had aforementioned 3 years antecedently in my Forrester days. Then and currently, the Hadoop industry’s “identity crisis” stems partly from the group’s lack of standardization and failure to coalesce a unifying vision for what Hadoop is and might evolve into.

If you scrutinize the Apache computer code Foundation’s definition of Hadoop currently, it still sounds like a catch-all instead of a definitive design. as an example, the recent inclusion of Spark into the scope of Hadoop feels as absolute as continued to incorporate Cassandra. no one within the business seriously considers Spark something apart from a challenger to Hadoop, not a part of it. against this, Cassandra isn’t even the most popular open supply, real-time, massive information community out there, and its growth days appear to own waned significantly.

Also, you sense that a phase is beginning to saturate its target market once discussions more and more specialize in its still-puny adoption rate among thought users. That’s front and center within the cited article’s discussion of its survey findings:

[InformationWeek’s] information suggests that train hasn't left the station simply yet: simply 4WD of corporations use Hadoop extensively, whereas eighteen say they use it on a restricted basis…That is up from the three coverage intensive use and twelve-tone system coverage restricted use of Hadoop in our survey last year. Another 2 hundredth commit to use Hadoop, tho' that also leaves fifty eight with no plans to use it.

If you’ve been within the analytics business for over some of years, this smacks of déjà vu. over twenty years into its existence as a distinct phase, the business intelligence (BI) market continues to agonize over low adoption rates among thought information employees. maybe bismuth -- or Hadoop or the other massive information phase -- wasn't doomed to be as ubiquitously adopted as, say, smartphones.

That doesn’t mean Hadoop can’t grow to be a vastly vital and profitable phase among its own well-defined niche. After all, nothing’s stopping a mature person from growing wealthy and in style as their hair fades to grey.

More Info :- InfoWorld

No comments:

Post a Comment