您现在的位置是:首页 > 文章详情

yum cdh4

日期:2014-03-14点击:574

cdh4 install for Centos6
那个最美的年代,最好的时光,一路梦想,一路流泪,流的不会是懦弱的泪,而是对奋斗的寄于;
1,repo配置
>>>/etc/yum.repo/wget http://archive.cloudera.com/cdh4/redhat/6/x86_64/cdh/cloudera-cdh4.repo
或是wget archive.cloudera.com/cdh4/one-click-install/redhat/6/x86_64/cloudera-cdh-4-0.x86_64.rpm
yum --nogpgcheck localinstall cloudera-cdh-4.x86_64.rpm

2,添加Repository key for Centos6
rpm --import http://archive.cloud.com/cdh4/redhat/6/x86_64/cdh/RPM-GPG-KEY-cloudera

3,yum 安装cdh相关daemons在相关master,slaves上命令,此时未考虑HA;
默认MRv1,MRv2(YARN)未考虑

where to install          install commands

JobTracker:

yum -y install hadoop-0.20-mapreduce-jobtracker;

NameNode:

yum -y install hadoop-hdfs-namenode

SecondaryNameNode:

yum -y install hadoop-hdfs-secondarynamenode

DataNode,TaskTracker:

yum -y install hadoop-0.20-mapreduce-tasktracker hadoop-hdfs-datanode

Client hosts:

yum -y install hadoop-client

MRv1版本yum部署

yum.repos.d]# yum -y install hadoop-0.20-mapreduce-jobtracker hadoop-hdfs-namenode hadoop-hdfs-secondarynamenode hadoop-0.20-mapreduce-tasktracker hadoop-hdfs-datanode hadoop-client

 

MRv2 即 YARN:

Resource Manguager(analogous MRv1 JobTracker):
yum -y install hadoop-yarn-resourcemanager
yum -y install hadoop-hdfs-namenode
yum -y install yarn-nodemanager hadoop-hdfs-datanode hadoop-mapreduce
yum -y install hadoop-mapreduce-historyserver hadoop-yarn-proxyserver


MRv2(YARN)与MRv1 yum Install区别
Resource Manager host
    yum -y install hadoop-yarn-resourcemanager
NameNode host
    yum -y install hadoop-hdfs-namenode
SecondaryName host
    yum -y install hadoop-hdfs-secondarynode
All cluster host except Resource Manager
    yum -y install hadoop-yarn-nodemanager hadoop-hdfs-datanode hadoop-mapreduce

one host in the cluster
    yum -y install hadoop-mapreduce-historyserver hadoop-yarn-proxyserver

可选项:

1,LZO(压缩算法,具体见google)

wget http://archive.cloudera.com/gplextras/redhat/6/x86_64/gplextras/cloudera-gplextras4.repo 到/etc/yum.repo/

  yum -y install hadoop-lzo-cdh4

 

原文链接:https://yq.aliyun.com/articles/440728
关注公众号

低调大师中文资讯倾力打造互联网数据资讯、行业资源、电子商务、移动互联网、网络营销平台。

持续更新报道IT业界、互联网、市场资讯、驱动更新,是最及时权威的产业资讯及硬件资讯报道平台。

转载内容版权归作者及来源网站所有,本站原创内容转载请注明来源。

文章评论

共有0条评论来说两句吧...

文章二维码

扫描即可查看该文章

点击排行

推荐阅读

最新文章