here is a commercial open source company, Cloudera, that supports and evangelizes Hadoop, and mainstream organizations and businesses ranging from the New York Times to IBM are using it...
on 05/26/2010 – Made popular on 05/26/2010
Hadoop, the open source Big Data platform, has taken another step forward into the world of business information management (BIM) and analytics through a new partnership between Cloudera and Capgemini.
I am required to hack a single node hadoop "cluster" (cloudera psuedo-distributed) to be able to access it remotely. I have successfully installed hadoop and I have updated the localhost identifiers in the configs to the IP address of the machine. I can run hadoop fs -ls / and all is good. I have created a passphraseless key and I can ssh to the hadoop machine.
Cloudera has raised $65 million to further fuel Hadoop adoption and expand its European operations. The new round led by Accel Partners, brings the total raised to $140 million. Existing investors Greylock Partners, Ignition Partners, In-Q-Tel and Meritech Capital Partners all participated in the round.
Cloudera has established itself as one of the true leaders of the big data movement.
I am trying to set up Hadoop permanently on Amazon EC2. Currently what I am doing is every morning launch EC2 instances and set up Hadoop. Is there any way i can avoid this tedious step? I am looking for an Hadoop image which can be loaded on EC2 and make things easy for me.
Ok, this is the first script I've ever attempted to write so go easy on me. I'm just trying to simple copy a tar.gz file from the directory the script is located to /usr/local/filename.tar.gz The script is run as root so it shouldn't be a permissions issue.
How is it possible to make a folder under $HOME accessible to other users? I thought that's the case why we have softlinks but apparently I am missing some bits here. Can someone please shed a light on that?
User Hadoop runs hadoop installaion and that contain bin folder with awailable commands to execute.
[hadoop@A1n1 hadoop-1.0.4]$ ls -al