Tuesday, July 26, 2016

Installing Hortonwork Cluster on Single Node

Installing Hortonwork Cluster on Single Node

1. Installation Of CentOS7(Minimal) on Machine.

2. Configure the Network while Installation.

3. Start the CentOS .

5. Configure the JAVA.

mkdir /usr/java
tar -zxvf jdk-8u71-linux-x64.tar.gz -C /usr/java

Set variables on vi /etc/profile-
export JAVA_HOME=/usr/java/jdk1.8.0_71
export PATH=$PATH:$JAVA_HOME/bin

6. Set the hostname and hosts file.

7. Mount the CentOS Everthing  File.

mkdir /mnt/DVD
mount -r -t iso9660 /dev/sr0 /mnt/DVD

8. Install and enable the httpd Service

yum install -y httpd
service httpd status
service httpd start

9. Create the mannual repo file.

cd /etc/yum.repos.d/

vi Centos.repo

[Centos]
name=Centos
baseurl=file:///mnt/DVD/
enabled=1
gpgcheck=0

vi ambari.repo

[Ambari]
name=Ambari
baseurl=http://192.168.228.133/AMBARI-2.2.1.1/centos7/2.2.1.1-70
enabled=1
gpgcheck=0
---------------------
vi hdp.repo

[HDP_1]
name=HDP_1
baseurl=http://192.168.228.133/HDP/centos7/2.x/updates/2.4.0.0
enabled=1
gpgcheck=0
---------------------
vi hdp-util.repo


[HDP-UTILS]
name=HDP-UTILS
baseurl=http://192.168.228.133/HDP-UTILS-1.1.0.20/repos/centos7/
enabled=1
gpgcheck=0


10. Stop the firewall

"service firewalld stop" On Bootup firewall starts again
systemctl enable httpd"systemctl disable firewalld" permanent disable

11. Extract the both file.

tar -zxvf ambari-2.2.0.0-centos7.tar.gz -C /var/www/html/
tar -zxvf HDP-2.3.4.0-centos7-rpm.tar.gz -C /var/www/html/
tar -zxvf HDP-UTILS-1.1.0.20-centos7.tar.gz -C /var/www/html/

12. Password less SSH

ssh-keygen
cd .ssh/
cat id_rsa.pub >> authorized_keys
ssh node1

13. Disable SELINUX

vi /etc/sysconfig/selinux
"SELINUX=disabled"

14. Restart the Server

15. Install the Ambari Server

yum install ambari-server

16. Install the Postgres SQL

yum install postgresql-jdbc

17. Delete duplicate java entry files.

alternatives --list


18. Setup Ambari with java.

ambari-server setup -j /usr/java/jdk1.8.0_71

19. Setup JDBC Driver with Ambari Server

ambari-server setup --jdbc-db=postgres --jdbc-driver=/usr/share/java/postgresql-jdbc.jar

20. Start the Ambari Server.

ambari-server start




No comments:

Post a Comment

Kafka Architecture

Apache Kafka is a distributed publish-subscribe messaging system and a robust queue that can handle a high volume of data and enables you t...