Stuff for testing mapreduce locally on Java
- Install maven 3.0.x
- goto project root
- run mvn clean install -Pitest
- enjoy :)
Docs
There are several blog post which describe testing approach:
- Unit tests for mapper, combiner, reducer: http://bigdatapath.com/2013/03/23/test-java-mapreduce-job-locally-without-hadoop-installation-unit-tests/
- Integration test for mapreduce program: http://bigdatapath.com/2013/04/16/integration-test-for-java-map-reduce-program-using-minimrcluster/