What is the purpose of RecordWriter in Hadoop?
-
-
What is RecordWriter in Hadoop MapReduce?
What is the need of RecordWriter in MaprReduce?
-
RecordWriter is the class which handles the job of taking an individual key-value pair i.e output from reducer and writing it to the location prepared by the OutputFormat.
RecordWriter implements: ‘write’ and ‘close’. The ‘write’ function takes key-values from the MapReduce job and writes the bytes to HDFS. The ‘close’ function closes the Hadoop data stream to the output file.
- You must be logged in to reply to this topic.