hdp 2.6.4 扩容增加数据节点

标签(空格分隔): 大数据平台构建


  • 一: 新增节点的数据系统初始
  • 二: 增加数据节点的步骤

一:新增节点的数据系统初始

1.1 系统主机名:

系统:RHEL7.5x64
cat /etc/hosts

172.17.100.21   ZY-001.flyfish
172.17.100.22   ZY-002.flyfish
172.17.100.23   ZY-003.flyfish
172.17.100.24   ZY-004.flyfish

ZY-004.flyfish 作为增加节点

image_1ce92nmp8ifib6kjrf1jjk1ih09.png-95.6kB

1.2 新增节点关闭防火墙与selinux

yum install -y firewall* iptable* 

  (1) 关闭firewalld

 systemctl stop firewalld.service
 systemctl disable firewalld.service
 firewall-cmd --state

 (2) 关闭iptables 
 iptables -F
 systemctl stop iptables.service 
 service iptables save
 systemctl disable iptables.service 

 (3) 禁用 selinux 

  sed -i '/SELINUX/s/enforcing/disabled/' /etc/selinux/config  
  setenforce 0
  getenforce 0
  sestatus

  重启机器

  reboot

image_1ce92og43dc61f1l1cfctcs1a38m.png-91.1kB

1.3 无密钥登录

做root用户无密钥认证

 ssh-keygen ---一直敲回车到最后

 cat id_rsa.pub >> authorized_keys 

 将所有的公钥导入authorized_keys  分发到 所有的 机器的.ssh/ 下面

 然后测试

 ---

 ssh zy-004.flyfish

image_1ce92ub511soa13fvhmt207s4013.png-270kB

image_1ce92v1gq19pm5sk1hso181q1quk1g.png-201.3kB

image_1ce92vhe7at41gvu1vcin8lm91t.png-78.4kB

1.4 ZY-004.flyfish时间同步 ZY-001.flyfish

login:

   ZY-002.flyfish

scp /etc/chrony.conf ZY-004.flyfish:/etc/

login:
  ZY-004.flyfish

  service chronyd stop 
  service chronyd start
  chkconfig chronyd on 

  chronyc sources -v 

image_1ce933r041kne8ieisc1hsnq0o2a.png-115kB

1.png-83.7kB

2.png-104.7kB

1.5 句柄数更改

login:  

ZY-001.flyfish

scp /etc/security/limits.conf zy-004.flyfish:/etc/security/

image_1ce93kvr817sp1a1u1c7q15dkjm4c.png-56.2kB

1.6 同步yum源

cd /etc/yum.repos.d/
scp ambari.repo hdp.gpl.repo hdp.repo ZY-004.flyfish:/etc/yum.repos.d/

login: 

ZY-004.flyfish

mount /dev/cdrom /media/
yum makecache

image_1ce94bn4amqkuan1k2u9t3je6t.png-114.1kB

image_1ce95ckpi1u3s7mfodt1ddgj428u.png-162.1kB

1.7 安装 jdk

login:

ZY-001.flyfish

scp jdk-8u162-linux-x64.tar.gz ZY-004.flyfish:/root

scp /etc/profile ZY-004.flyfish:/etc/

login:

ZY-004.flyfish

tar -zxvf jdk-8u162-linux-x64.tar.gz -C /training/

cd /training 

ln -s jdk1.8.0_162/ jdk

source /etc/profile 

java -version 

image_1ce940mam1i1fh0abqvpsahik59.png-158.9kB

1.8 : 关于补丁包

libtirpc-0.2.4-0.10.el7.x86_64.rpm  
libtirpc-devel-0.2.4-0.10.el7.x86_64.rpm
---
scp libtirpc-* ZY-004.flyfish:/root

login 
ZY-004.flyfish

rpm -ivh libtirpc-* 

image_1ce95mg811sr91gvcg6d6vthka9b.png-123.3kB

二: 增加数据节点的步骤

image_1ce943d0j1ram1sa54av1cpi1tlg5m.png-285.5kB

image_1ce94402u1dv81p2k138t5dl1u4o63.png-267.6kB

image_1ce945s83j5311j4sjr1tuijh86g.png-331.2kB

image_1ce94caiknu2129b4q01qpt1hs07a.png-350.8kB

image_1ce95p97p1qvh17ce1hvc1o9d13639o.png-307.8kB

image_1ce94e1de15kb1km3kd216co19e484.png-234.4kB

image_1ce94eic5nlt1gcj1ft7vrg1na78h.png-318.1kB

image_1ce961ng211gamc51ug5apk391a5.png-277kB

image_1ce97j6dt1ui4sscco215l5basai.png-306.4kB

image_1ce97jo5kfk4c9e1hnm5d91eqqav.png-277.2kB

image_1ce97nmrc51u1fs11mrcis53c4bc.png-309.6kB