How to unit test Hadoop MapReduce?

S

SoulSilence2016-09-26 21:26:55

MapReduce

SoulSilence, 2016-09-26 21:26:55

What can be used to test the Mapper and Reducer logic, as well as the entire MapReduce job? I googled MRUnit, but it seems to be closed since 2014, what do you use now and how do you solve this problem? Thanks for answers.

Reply

Answer the question

In order to leave comments, you need to log in

0 answer(s)

Similar questions

I

Ilnur Ibautllin2014-09-27 08:34:34

Hadoop MapReduce, tutorial, hadoop philosophy: Is it worth restarting all daemons after every "wordcount"? 1Reply

M

m312014-10-15 23:06:48

What software, libraries and frameworks do you use to solve high-performance tasks? 0Reply

O

Olzhas Suleimen2015-04-26 14:01:50

Are there examples of image clustering algorithms in java? 1Reply

M

Mr_Sinister2017-05-17 10:08:32

How is Hadoop fault tolerance achieved? 2Reply

R

Roman2017-06-20 14:04:22

What is the correct way to write mapReduce for MongoDB? 1Reply

Didn't find what you were looking for?

Ask your question