Set Up a Cluster

Select Services

The Select Services page allows you to select the services you want to install and configure.

You can choose from:

Data Engineering

HDFS, YARN, YARN Queue Manager, Ranger, Atlas, Hive, Hive on Tez, Spark, Oozie, Zeppelin, Livy, and Hue

Data Mart

HDFS, YARN, YARN Queue Manager, Ranger, Atlas, Hive, Impala, and Hue

Operational Database

HDFS, Ranger, Atlas, and HBASE

Custom Services

Choose your own services. Services required by chosen services will automatically be included.

Click on custom services and select your own services

After selecting the services you want to add, click Continue. The Assign Roles page displays.

Customize Role Setups for the Cluster

HDFS:

• NameNode: datacouch.training.io

• Balancer: datacouch.training.io

• Datanode: All Host

Cloudera Management Service:

• Service Monitor: datacouch.training.io

• Activity Monitor: datacouch.training.io

• Host Monitor: datacouch.training.io

• Reports Manager: datacouch.training.io

• Event Server: datacouch.training.io

• Alert Publisher: datacouch.training.io

YARN:

• ResourceManager: datacouch.training.io

• Job History Server: datacouch.training.io

Assign Roles

The Assign Roles page suggests role assignments for the hosts in your cluster.

You can click on the hostname for a role to select a different host. You can also click the View By Host button to see all the roles assigned to a host.

Click on each service and select the host. After assigning all of the roles for your services, click Continue.

Setup Database

On the Setup Database page, you can enter the database hosts, names, usernames, and passwords you created.

Select the database type and enter the database name, username, and password for each service.

Click Test Connection to validate the settings. If the connection is successful, a green checkmark and the word Successful appears next to each service. If there are any problems, the error is reported next to the service that failed to connect.

After verifying that each connection is successful, click Continue.

In Review Changes

Click on Continue.

As the hdfs user, create a home directory for the training user on HDFS and give the training user ownership of it’s home directory.

sudo -u hdfs hdfs dfs -mkdir -p /user/training/
sudo -u hdfs hdfs dfs -chown training /user/training