What are the most common InputFormats in Hadoop?

[DataFlair Team]

What is InputFormat in Hadoop MapReduce?
How many types of InputFormat is there in Hadoop?
What are the different types of input format in MapReduce?

[DataFlair Team]

In Hadoop, Input files stores the data for a MapReducejob. Input files which stores data typically reside in HDFS. Thus, in MapReduce, InputFormat defines how these input files split and read. InputFormat creates Inputsplit.

Most common InputFormat are:

FileInputFormat- It is the base class for all file-based InputFormat. It specifies input directory where data files are present. FileInputFormat also read all files. And, then divides these files into one or more InputSplits.

TextInputFormat- It is the default InputFormat of MapReduce. It uses each line of each input file as separate record. Thus, performs no parsing.

• Key- byte offset.
• Value- It is the contents of the line, excluding line terminators.

Example content of file- is john may which katty

• Key- 0
• Value- is john may which katty

KeyValueTextInputFormat- It is similar to TextInputFormat. Hence, it treats each line of input as a separate record. But the main difference is that TextInputFormat treats entire line as the value. While the KeyValueTextInputFormat breaks the line itself into key and value by the tab character (‘/t’).

• Key- Everything up to tab character.
• Value- Remaining part of the line after tab character.

Example content of file- is -> john may which katty

• Key- is
• Value- john may which katty

Tab character “->”

SequenceFileInputFormat- It is the InputFormat which reads sequence files. Key & Value- Both are user-defined.

Follow the link to learn more about InputFormat in Hadoop

[DataFlair Team]

There are following the most common InputFormat in Hadoop in Hadoop:-

1. Text Input Format (default)

2. Key Value Input Format

3. Sequence File Input Format
a. As Binary Input
b. As text Input

Among them Text Input Format is the Hadoop default one.

Other than these there are some more input formats based on requirements as follows:-
1. CombineFileInputFormat
2. CombineSequenceFileInputFormat
3. CombineTextInputFormat
4. CompositeInputFormat
5. DBInputFormat
6. FixedLengthInputFormat
7. MultiFileInputFormat
8. NLineInputFormat
9. Parser.Node
10. FileInputFormat, etc.

Folloe the link to learn more about InputFormat in Hadoop

[Author]

Posts