Ambari and Big Data Cluster deployment (Elite)

(Personal experience, if you have any questions, please give your comments in the comment area)

Stepping on the countless pits, and finally the Ambari and Big Data cluster deployment success, please follow the steps carefully to avoid problems.

English Official Document Link: https://docs.hortonworks.com/HDPDocuments/Ambari-2.5.1.0/bk_ambari-installation/bk_ambari-installation.pdf

Basic Environment
Operating system: UBUNTU16
hdp:2.6.2.14
hdp-utils:1.1.0.21
ambari:2.5.2.0
jdk:1.8.0_171
maven:apache-maven-3.5.2
tomcat:apache-tomcat-8.5.24

Important Configuration phase:
To open the root SSH login:
sudo passwd root setting password
sudo apt-get install SSH
Apt-get Install Vim
Vi/etc/ssh/sshd_config
Comment out the Permitrootlogin without-password
Add Permitrootlogin Yes
sudo service ssh restart

Configuring host name and domain name mappings
Vim/etc/hostname
Modify the host name to MASTER.HD
This is also done in each slave, modifying the host name Slave1.hd SLAVE.HD ... (Note the suffix to be the same)
Ifconfig Copy Local IP
Vim/etc/hosts
Do not delete anything, add the local IP and the corresponding host name, but also add the IP and hostname of other machines in the cluster
This is also true from the machine.

SSH Password-free login
sudo ssh-keygen
CD ~/.ssh
Cat Id_rsa.pub >> Authorized_keys
Ssh-copy-id [email protected]
Ssh-copy-id [email protected]
Ssh-copy-id [email protected]
chmod ~/.ssh
chmod ~/.ssh/authorized_keys
Try to login to any other slave using SSH [email protected]

Enable NTP on the cluster and browser host
Apt-get Install NTP
UPDATE-RC.D NTP defaults

Configuring firewalls
sudo ufw disable
sudo iptables-x
sudo iptables-t nat-f
sudo iptables-t nat-x
sudo iptables-t mangle-f
sudo iptables-t mangle-x
sudo iptables-p INPUT ACCEPT
sudo iptables-p FORWARD ACCEPT
sudo iptables-p OUTPUT ACCEPT

Disable SELinux and packagekit and check umask
Setenforce 0
Vim/etc/selinux/config (if any)
Set selinux=disabled
Umask 0022
echo umask 0022 >>/etc/profile

Configuring the Reverse Proxy
Apt-get Install Nginx
Vim/etc/nginx/sites-available/default (or/etc/nginx/nginx.conf)
Add this sentence autoindex on in server{};

Configure Local source
Download HDP hdp-utils Ambari three packs and unzip to different file directories under/var/www/html
Delete the HTML file under/var/www/html/
Enter the HDP directory to the directory with all the file 777 permissions, after the installation to use
Wget-o/etc/apt/sources.list.d/ambari.list http://public-repo-1.
Hortonworks.com/ambari/ubuntu16/2.x/updates/2.5.1.0/ambari.list
Apt-key adv--recv-keys--keyserver keyserver.ubuntu.com B9733A7A07513CAD
Vim/etc/apt/sources.list.d/ambari.list
Modify the address of the Ambari warehouse to the local warehouse address http://xxxx.master/ambari/ambari/ubuntu/(note the modification)
Apt-get Update
Apt-cache showpkg Ambari-server
Apt-cache showpkg ambari-agent
Apt-cache showpkg ambari-metrics-assembly
Apt-get Install Yum
Vim/etc/yum/repos.d/ambari.repo
You can change the version number

Installation Deployment phase
Installing Ambari
Apt-get Install Ambari-server
Ambari-server Setup
N
Select 3 and copy and paste the JDK path
You can return
Ambari-server start
http://< Host ip>:8080
Operation of all machines in the cluster Vim/etc/ambari-agent/conf/ambari-agent.ini
Modify hostname=< Host name >
Add force_https_protocol=protocol_tlsv1_2 to [security]
Ambari-agent Restart (or restarting the server)
Fool-type image operation, not in the statement of fatigue
Encounter a problem, point failed, or go to/var/log/xxx to view the corresponding log

Ambari and Big Data Cluster deployment (Elite)