hadoop 扩展datanode节点

🧙 Questions

给正在使用的集群扩充datanode节点

☄️ Ideas

修改workers

vim /opt/hadoop/etc/hadoop workers

worker1
worker2
worker3

分发hadoop安装包

scp hadoop root@workers:/data/hadoop

ssh免密登录

刷新datanode

hdfs dfsadmin -refreshNodes
yarn rmadmin -refreshNodes

clusterId必须保持一致

cat /data/hadoop/data/current/VERSION

启动负载均衡

start-balancer.sh

启动集群

hdfs --daemon start datanode

添加8031访问端口

vim yarn-site.xml

<properties>
  <name>yarn.resourcemanager.resource-tracker.address</name>
  <value>172.23.39.242:8031</value>
</properties>

yarn --daemon stop nodemanager
yarn --daemon start nodemanager

🔗 Links

• hadoop docs