How to configure Ambari Hive View for Kerberized cluster

Author: Kuldeep Kulkarni /
Posted on: August 1, 2016 /
Categories: Hadoop

How to configure Ambari Hive View for Kerberized cluster – This tutorial has been successfully tried and tested on HDP-2.4.0.0 and Ambari 2.2.1.0   I have my HDP Cluster Kerberized and Ambari has been configured for SSL.   Note – Steps are same for Ambari with or without SSL.   Please follow below steps for

Read More →

How to configure Ambari File View with Namenode HA Kerberized

Author: Kuldeep Kulkarni /
Posted on: August 1, 2016 /
Categories: Hadoop

How to configure Ambari File View with Namenode HA Kerberized cluster – This tutorial has been successfully tried and tested on HDP-2.4.2.0 and Ambari 2.2.2.0   I have my HDP Cluster Kerberized with Namenode HA.   Please follow below steps for Configuring File View on Kerberized HDP Cluster.   Step 1 – Please configure your Ambari

Read More →

How to enable Ranger Admin High Availability

Author: Harini Yadav /
Posted on: July 8, 2016 /
Categories: Hadoop

It is useful to enable Ranger Admin High availability, since, it would help in having access to Policy Manager even if one of the Ranger Admin is down. This document provides steps to enable Ranger Admin HA [High Availability] using an example. To configure Ranger Admin HA,  it is also required to configure Load Balancing in

Read More →

Oozie HA configuration with Kerberos

Author: Kuldeep Kulkarni /
Posted on: May 7, 2016 /
Categories: Hadoop

Please follow below steps to setup Oozie HA configuration with Kerberos environment.   Step 1:  Configure mysql/oracle database for Oozie as HA configuration does not work with default embedded Derby Database. Please refer https://community.hortonworks.com/articles/183/moving-oozie-to-mysql-with-ambari.html for steps to migrate Oozie database.   Step 2: Login to Ambari UI, goto hosts, select host on which you need to add additional

Read More →

Automated Kerberos Installation and Configuration

Author: Kuldeep Kulkarni /
Posted on: April 24, 2016 /
Categories: Hadoop

Automated Kerberos Installation and Configuration – For this post, I have written a shell script which uses Ambari APIs to configure Kerberos on HDP Single or Multinode clusters. You just need to clone our github repository and modify property file according to your cluster environment, execute setup script and phew!! Within 5-10 minutes you should have

Read More →

Oozie coordinator based on input data events

Author: Kuldeep Kulkarni /
Posted on: April 16, 2016 /
Categories: Hadoop

Oozie coordinator based on input data events – This article explains how to start oozie workflow when input data is available.   Here is an example of scheduling oozie coordinator based on input data events. it starts Oozie workflow when input data is available.   In this example, coordinator will start at 2016-04-10, 6:00 GMT and

Read More →

Role of Journal nodes in Namenode HA

Author: Kuldeep Kulkarni /
Posted on: April 13, 2016 /
Categories: Hadoop

What is the Role of Journal nodes in Namenode HA ? I know many of us are aware that Role of Journal nodes is to keep both the Namenodes in sync and avoid hdfs split brain scenario by allowing only Active NN to write into journals. Have you ever wonder how does it works? Here you

Read More →

Oozie Tutorials – SSH Action

Author: Kuldeep Kulkarni /
Posted on: April 11, 2016 /
Categories: Hadoop

Oozie Tutorials – SSH Action Oozie ssh action executes shell script on remote machine in secure shell, workflow will wait until ssh script is complete and then move to next action.    Prerequisites: 1. Shell script must be present on remote host at given path. 2. Shell script will be executed in home directory of

Read More →

Hadoop Cluster Maintenance

Author: Kuldeep Kulkarni /
Posted on: April 7, 2016 /
Categories: Hadoop

As a Hadoop Admin it’s our responsibility to perform Hadoop Cluster Maintenance frequently. Let’s see what we can do to keep our big elephant happy! 😉     1. FileSystem Checks We should check health of HDFS periodically by running fsck command sudo -u hdfs hadoop fsck /   This command contacts the Namenode and checks

Read More →

Oozie Tutorials – Basics of Oozie and Oozie SHELL action

Author: Kuldeep Kulkarni /
Posted on: April 4, 2016 /
Categories: Hadoop

Our Oozie Tutorials will cover most of the available workflow actions with and without Kerberos authentication. Let’s have a look at some basic concepts of Oozie.   What is Oozie? Oozie is open source workflow management system. We can schedule Hadoop jobs via Oozie which includes hive/pig/sqoop etc. actions. Oozie provides great features to trigger workflows

Read More →

1 2 3 4

Support us!

If you like this site please help and make click on any of these buttons!