2

cp not working in script

view story
linux-howto

http://www.unix.com – Ok, this is the first script I've ever attempted to write so go easy on me. I'm just trying to simple copy a tar.gz file from the directory the script is located to /usr/local/filename.tar.gz The script is run as root so it shouldn't be a permissions issue. (at least to my knowledge) This is what it looks like #!/bin/bash HADOOP="hadoop-1.0.3.tar.gz" cp $HADOOP /usr/local/$HADOOP -v tar xzf /usr/local/$HADOOP mv /usr/local/$HADOOP hadoop chown -R hduser:hadoop hadoop What happens is the following: $hadoop is never copied to the /usr/local directory and then after that (HowTos)

suki's picture
Submitted by suki on 08/01/2012

Stories similar to cp not working in script

Hey guys Montana here,

I have configured Hadoop for single node cluster, when I run my URLS, the .jsp's they work which means Hadoop is working but upon booting Hadoop by formatting a new distributed filesystem

Code: bin/hadoop namenode -format I get an SSH error, but then when I actually start Hadoop

Code: bin/start-dfs.sh Which should also handle the "${HADOOP_CONF_DIR}&q

Mapreduce Compilation in Java 20 weeks 3 days ago

I am following this tutorial.

http://hadoop.apache.org/docs/mapreduce/current/mapred_tutorial.html

javac -classpath ${HADOOP_HOME}/hadoop-core- ${HADOOP_VERSION}.jar:${HADOOP_HOME}/hadoop-mapred-${HADOOP_VERSION}.jar:${HADOOP_HOME}/hadoop-hdfs-${HADOOP_VERSION}.jar -d wordcount_classes

The hadoop version is 0.22.0 and this does not have a hadoop-core-0.22.0.jar though I find hadoop-hdfs-0.22.

Despite an error specified on Error of start of the demon of Namenode with a log of errors me it was succeeded to execute a command

./hadoop fs - mkdir/user/hadoop

and to create the appropriate folder (that the command confirmed ./hadoop fs - lsr/).

I am required to hack a single node hadoop "cluster" (cloudera psuedo-distributed) to be able to access it remotely. I have successfully installed hadoop and I have updated the localhost identifiers in the configs to the IP address of the machine. I can run hadoop fs -ls / and all is good. I have created a passphraseless key and I can ssh to the hadoop machine.

Full list of error:

hb@localhost:/etc/hadoop/conf$ sudo service hadoop-hdfs-namenode start * Starting Hadoop namenode: starting namenode, logging to /var/log/hadoop-hdfs/hadoop-hdfs-namenode-localhost.out 12/09/10 14:41:09 INFO namenode.NameNode: STARTUP_MSG: /************************************************************ STARTUP_MSG: Starting NameNode STARTUP_MSG: host = localhost/127.0.0.1 S

I am a newbie to the ubuntu OS. I am trying to install hadoop on an ubuntu 12.04LTS vm (on virtual box).

I created a group hadoop for the hadoop home directory - then I created a new user hduser and added it to that grp. I then changed my mind and gave my root user "aniruddha" privileges with "chown" to the hadoop folder.

With configuration, installation, and the use of Hadoop in single-node and also the use in multi-node architectures under your belt, you can now turn to the task of developing applications within the Hadoop infrastructure. This article explores the Hadoop APIs and data flow and demonstrates their use with a simple mapper and reducer application.

I've setup Hadoop to use Kerberos (following the Cloudera security guide), but it is unclear how I connect to hadoop with regular users (e.g. username=myuser).

Currently I have myself authenticated with Kerberos with my Keberos admin user (via kinit kerbadmin/admin), but that doesn't seem to help. Do I need to tell Hadoop that kerberos user "kerbadmin" is allowed to use Hadoop?

I am using Eclipse Indigo Service Release 2 and hadoop 0.22.0 on win 7. Trying to use the eclipse plugin provided in the Hadoop package but that does not seem to work.