5

Facebook Open Sources Corona Hadoop Big Data Framework

view full story
linux-howto

http://www.thevarguy.com – Google (NASDAQ: GOOG), which laid the groundwork for the immensely popular, open source, distributed computing framework known as MapReduce, has already made its mark in the Big Data channel. But Facebook (NASDAQ: FB), which a few days ago open sourced its own alternative to MapReduce, is vying to secure its place in the evolution of Big Data technology as well. Now, we wonder: Which solution will prevail? MapReduce and similar programs are a vital component of the Hadoop framework, which makes it possible to interact with vast quantities of data stored across many different individual compute (IT news)

niaobid's picture
Submitted by niaobid on 11/12/2012 – Made popular on 11/12/2012

Stories similar to Facebook Open Sources Corona Hadoop Big Data Framework

I am learning Hadoop and MapReduce framework. Until now i have played around text files and processed them by leveraging MapReduce framework.

When i started MapReduce learning first popular example i found was WORDCOUNT which is a text file processing scenario. Then i wrote my own logic to process some text files and displayed results.

Virtualization giant VMware has unveiled Spring Hadoop, which integrates its Spring Framework with the Apache Hadoop platform. Spring provides a comprehensive, lightweight framework that will make it easier for devs to build solutions around the Hadoop platform, according to the company. Spring Hadoop is available under the open source Apache 2.0 license and can be downloaded free.

I am following this tutorial.

http://hadoop.apache.org/docs/mapreduce/current/mapred_tutorial.html

javac -classpath ${HADOOP_HOME}/hadoop-core- ${HADOOP_VERSION}.jar:${HADOOP_HOME}/hadoop-mapred-${HADOOP_VERSION}.jar:${HADOOP_HOME}/hadoop-hdfs-${HADOOP_VERSION}.jar -d wordcount_classes

The hadoop version is 0.22.0 and this does not have a hadoop-core-0.22.0.jar though I find hadoop-hdfs-0.22.

i want to access hbase table from hadoop mapreduce....i m using windowsXP and cygwin i m using hadoop-0.20.2 and hbase-0.92.0 hadoop cluster is working fine....i am able to run mapreduce wordcount successfully on 3 pc's hbase is also working .....i can cerate table from shell

i have tried many examples but they are not working....when i try to compile it using javac Example.java

it gives error..

Wondering what comes after the cloud? Literally, usually sunshine — haha. But metaphorically speaking, the next great frontier may well be big-data. And Hadoop, an open-source project enjoying ever-increasing buzz as of late, will likely be at the fore as that niche evolves. If you don’t know much about Hadoop, it’s time to learn.

These days, storing large amounts of data is easy. Where things get complicated is ensuring the integrity and reliability of that data, an increasing challenge as Big Data clusters grow bigger and bigger. This problem has created new opportunities in the Big Data channel, on which companies such as Talend, which has introduced new Hadoop data profiling technology, are working to capitalize.

Quantcast, an internet audience measurement and ad targeting service, processes over 20 petabytes of data per day using Apache Hadoop and its own custom file system called Quantcast File System (QFS). Today, it’s making that technology available to as open source under an Apache license.

Who Loves Hadoop? 45 weeks 1 day ago

Mention big data and the first thing that might come to mind is Hadoop. The open source software framework has recently enjoyed a great deal of popularity among vendors and enterprise users. However, if it is to really be useful to the enterprise, Hadoop may need to be taken out of open source, argues Brian Christian, chief technology officer of Zettaset.

As we've noted before, the open source Hadoop software framework has becom a phenomenon as a way of breaking complicated problems apart, spreading them across many computers, and allowing organiations to glean insight from extremely large data sets.