【Hadoop】 分布式Hadoop集群安装配置
第一次安装hadoop 集群，记录其安装过程！ 1 前期准备，配置所有的机器的/etc/hosts 文件 # cat /etc/hosts # Do not remove the following line, or various programs # that require network functionality will fail. 127.0.0.1 rac localhost ::1 rac3 localhost 10.250.7.225 rac1 10.250.7.249 rac2 10.250.7.241 rac3 10.250.7.220 rac4 1 获取hadoop安装文件 可以从一下网址获取hadoop 安装文件 hadoop-0.20.2.tar.gz： http://apache.etoak.com//hadoop/common/ http://mirror.bjtu.edu.cn/apache//hadoop/common/ http://labs.renren.com/apache-mirror//hadoop/common/ #tar zxvf hadoop-0.20.2.tar.gz #mv hadoop-0.20.2.tar.gz hadoop #cd hadoop/conf 配置conf文件夹里面的core-site.xml,hdfs-site.xml,mapread-site.xml,mapred-site.xml，hadoop-env.sh。具体各个配置的含义请参考Hadoop帮助文档。 core-site.xml文件 <?xml version="1.0"?> <?xml-stylesheet type="text/xsl" href="configuration.xsl"?> fs.default.name hdfs://rac2:9000 2.其次编辑所有节点的hdfs-site.xml，命令如下： #vi /root/hadoop/conf/hdfs-site.xml <?xml version="1.0"?> <?xml-stylesheet type="text/xsl" href="configuration.xsl"?> dfs.name.dir /opt/hadoop/NameData dfs.permissions false dfs.replication 1 3 编辑所有节点mapred-site.xml文件： #vi /home/hadoop/conf/mapred-site.xml <?xml version="1.0"?> <?xml-stylesheet type="text/xsl" href="configuration.xsl"?> mapred.job.tracker 192.168.0.10:9001 4 在所有节点编辑hadoop-env.sh export HADOOP_HOME=/root/hadoop export HADOOP_CONF_DIR=$HADOOP_HOME/conf export PATH=$PATH:$HADOOP_HOME/bin export JAVA_HOME=/usr/java/jdk1.6.0_29 export CLASSHOME=/usr/java/jdk1.6.0_29/lib/tools.jar:/usr/java/jdk1.6.0_29/lib/dt.jar 5 在所有节点修改masters ，slaves 文件，其中masters 文件写入master 节点的ip，slaves 文件写入slaves 节点的ip [root@rac1 conf]# cat masters 10.250.7.225 [root@rac1 conf]# cat slaves 10.250.7.220 10.250.7.249 10.250.7.241 6 启动hadoop [root@rac1 bin]# sh start-all.sh starting namenode, logging to /root/hadoop/logs/hadoop-root-namenode-rac1.out 10.250.7.220: starting datanode, logging to /root/hadoop/logs/hadoop-root-datanode-rac4.out 10.250.7.241: starting datanode, logging to /root/hadoop/logs/hadoop-root-datanode-rac3.out 10.250.7.249: starting datanode, logging to /root/hadoop/logs/hadoop-root-datanode-rac2.out 10.250.7.225: starting secondarynamenode, logging to /root/hadoop/logs/hadoop-root-secondarynamenode-rac1.out jobtracker running as process 20175. Stop it first. 10.250.7.220: starting tasktracker, logging to /root/hadoop/logs/hadoop-root-tasktracker-rac4.out 10.250.7.241: starting tasktracker, logging to /root/hadoop/logs/hadoop-root-tasktracker-rac3.out 10.250.7.249: starting tasktracker, logging to /root/hadoop/logs/hadoop-root-tasktracker-rac2.out
