Category : Hadoop

Configure node labels on YARN

In this post, we will see how to configure node labels on YARN. I work for Hortonworks so obviously we will configure it for HDP 😉   Before we go for the configuration part, let’s understand what is node label  in YARN.   Node labels allows us to divide our cluster in different parts and

Read More →

Automate HDP installation using Ambari Blueprints – Part 3

In previous post we have seen how to install multi node HDP cluster using Ambari Blueprints. In this post we will see how to Automate HDP installation using Ambari Blueprints to configure Namenode HA.   Below are simple steps to install HDP multinode cluster with Namenode HA using internal repository via Ambari Blueprints.   Step 1:

Read More →

Oozie workflow failed – hive-site.xml permission denied

Oozie workflow failed – hive-site.xml permission denied – If you have configured Hive action in your Oozie workflow and its getting failed as hive-site.xml permission denied then you are at correct place!  Oozie workflow failed – hive-site.xml permission denied – This error can possibly occur with below mentioned scenarios:   Scenarios: 1. Your Oozie workflow contains

Read More →

Unable to access Namenode UI after disabling Kerberos authentication

We get 401 authentication error after disabling Kerberos authentication sometimes, error is shown in below screenshot Screenshot – Unable to access Namenode UI after disabling kerberos unable to access namenode ui after disabling kerberos     This can break Ambari metrics as monitoring data wont be available over HTTP for Namenode/Resource manager or any other hadoop

Read More →

How to setup cross realm trust between two MIT KDC

How to setup cross realm trust between two MIT KDC – In this post, we will see how to setup cross realm trust between two MIT KDC. We can access and copy data of one cluster from another if the cross realm trust is setup correctly.   In our example, we have 2 clusters with same HDP version(2.4.2.0)

Read More →

How to configure Ambari Hive View for Kerberized cluster

How to configure Ambari Hive View for Kerberized cluster – This tutorial has been successfully tried and tested on HDP-2.4.0.0 and Ambari 2.2.1.0   I have my HDP Cluster Kerberized and Ambari has been configured for SSL.   Note – Steps are same for Ambari with or without SSL.   Please follow below steps for

Read More →

How to configure Ambari File View with Namenode HA Kerberized

How to configure Ambari File View with Namenode HA Kerberized cluster – This tutorial has been successfully tried and tested on HDP-2.4.2.0 and Ambari 2.2.2.0   I have my HDP Cluster Kerberized with Namenode HA.   Please follow below steps for Configuring File View on Kerberized HDP Cluster.   Step 1 – Please configure your Ambari

Read More →

How to enable Ranger Admin High Availability

It is useful to enable Ranger Admin High availability, since, it would help in having access to Policy Manager even if one of the Ranger Admin is down. This document provides steps to enable Ranger Admin HA [High Availability] using an example. To configure Ranger Admin HA,  it is also required to configure Load Balancing in

Read More →

Oozie HA configuration with Kerberos

Please follow below steps to setup Oozie HA configuration with Kerberos environment.   Step 1:  Configure mysql/oracle database for Oozie as HA configuration does not work with default embedded Derby Database. Please refer https://community.hortonworks.com/articles/183/moving-oozie-to-mysql-with-ambari.html for steps to migrate Oozie database.   Step 2: Login to Ambari UI, goto hosts, select host on which you need to add additional

Read More →

Automated Kerberos Installation and Configuration

Automated Kerberos Installation and Configuration – For this post, I have written a shell script which uses Ambari APIs to configure Kerberos on HDP Single or Multinode clusters. You just need to clone our github repository and modify property file according to your cluster environment, execute setup script and phew!! Within 5-10 minutes you should have

Read More →

1 2 3 4