hadoop-meets-ossec-225x225

Securing Hadoop with OSSEC

Hadoop has built-in security facilities such as kerberos user authentication, encrypted RPC between system nodes and file encryption. While these are important features, Hadoop clusters can benefit from host intrusion detection to round out the security picture. That’s where a system like OSSEC comes in. Find out how I’ve applied OSSEC to monitor and detect…

hbase-makefile-225x225

Makefile for HBase Applications

In my blog Makefile for Hadoop WordCount Example I presented a generic Makefile that could be adapted to build any Hadoop application, including WordCount. Lately I’ve been exploring HBase programming and find myself in need of a similar device for building HBase applications. In this article I’ll show you how to modify the Hadoop Makefile for…

hadoop-debug-225x225

Debugging Hadoop Applications with IntelliJ

In my last blog, I explained how to create and configure a Hadoop development environment so that you can build the jars and example applications from the Hadoop source code you get from the Apache Hadoop trunk repository. This time around I’ll show you how to debug your Hadoop applications using the IntelliJ Community Edition…

hadoop-development-225x225

Create a Hadoop Build and Development Environment

One of the first things I had to do when I started working with Hadoop was fix bugs within the Hadoop stack. To be able to work on Hadoop internals requires numerous programming tools and libraries. If you have a desire or need to work on Hadoop code, I’ve summarized the packages you need to…

intellij-hadoop-225x225

IntelliJ Project for Building Hadoop – The Definitive Guide Examples

I have been studying  Hadoop – The Definitive Guide by Tom White and started building the sample applications with the Makefile I discussed in my last blog. Although the Makefile approach works, I decided to try using the IntelliJ Community Edition IDE to build the examples in any given chapter all at once. This time around I’ll walk you through a…