The Microsoft SQL Server team is not the only group looking to bring Big Data to the masses. Datameer has a desk top version of its eponymously titled 2.0 release that is shipping for $299 and a workgroup server for $2999. Unlike the MS solution this one doesn’t use Hive as the connector to the Hadoop MapReduce interface.
This now looks like Hadoop can scale in any direction. For more details check out the Big Data blog on ZDNet:
In theory combining data access methods in a horses for courses concept is a great idea. It should allow data to be accessed in the manner most suitable for the task at hand. The one concern I have with it though is the increase in complexity it introduces.
If the approach taken by Hadapt helps to reduce that complexity as implied in this ZDNet Blog Post then it may be an approach that has appeal to business. If Microsoft are successful in bringing a similar concept to SS Management studio then business uptake will be rapid as it will provide that single pane of glass that IT departments (development and support) all crave.
I’ve recently come across a series of videos on big data and analytics. Definitely worth a look if you are wondering how you can bring big data concepts into your organisation.
Here’s an alternate way of looking at “Big Data”… You want the data. You can’t handle the data. Well, most of you won’t be able to at the moment unless you are amongst the few who are implementing “Big Data”. But in the end it is all just data
Gartner describes Big Data as being all about three V’s, Velocity, Variety and Volume and lots of each. Big Data is high velocity, high volume data that comes in many different forms from a diverse set of sources in a range of forms and formats (variety). The data tends to be unstructured or semi structured in nature making it difficult to handle through normal relational database structures and methodologies.
Traditionally much of this data has been discarded due to the cost of storage. This is a restriction that is coming to an end, and now that 20gb of Ram now costs less than a 20gb drive did 10 years ago the cost of keeping large data sets in memory is becoming a possibility.
Here’s a blog courtesy of ZDNet that aims to demystify Big Data and look at the trends and developments that are emerging.