cdh教程 cms安装

🧙 Questions

通过scm安装服务

☄️ Ideas

安装cms

1. 版本选择 免费版 Cloudera Express
2. Cluster Name: isxcode
3. Hostname: isxcode-data-center
4. Cloudera Manager Agent
5. -> Custom Repository
6. -> http://isxcode-data-center:30108/cdh6_parcel/cm6

注意：Parcel Directory 一定要修改为/data/cloudera/parcels，挂载到磁盘
注意：/data/cloudera/parcels 目录一定不要提前创建

7. CDH and other software -> Install Method -> Use Parcels -> More Options ->
8. Remote Parcel Repository URLs -> http://isxcode-data-center:30108/cdh6_parcel/

安装hbase、hive、yarn、hdfs、kafka、zookeeper、impala

1. kafka Broker 添加节点
2. activitiy Monitor 添加节点
3. isxcode-data-center:30102 cdh_hive root root123
4. isxcode-data-center:30102 cdh_monitor root root123
5. 修改地址
6. /dfs/dn -> /data/dfs/dn
7. /dfs/nn -> /data/dfs/nn
8. /dfs/snn -> /data/dfs/snn
9. /var/local/kafka/data
10. /var/lib/cloudera-host-monitor
11. /var/lib/cloudera-service-monitor
12. /yarn/nm -> /data/yarn/nm
13. /var/lib/zookeeper

sudo -u hdfs hdfs dfs -mkdir -p /user/root
sudo -u hdfs hdfs dfs -chown root:supergroup /user/root
sudo -u hdfs hdfs dfs -chmod 755 /user/root

yarn.nodemanager.resource.cpu-vcores: 32
yarn.nodemanager.resource.memory-mb: 64GB
yarn.scheduler.minimum-allocation-vcores: 1 
yarn.scheduler.minimum-allocation-mb: 2GB
yarn.scheduler.maximum-allocation-vcores: 4
yarn.scheduler.maximum-allocation-mb: 4GB

kafka中设置才能使用

offsets.topic.replication.factor=1

https://api.isxcode.com/leo/file/open/show/ispong/902969510242422784

🔗 Links

• hadoop website