Front Page Forums Hadoop What is the relation between MapReduce and Hive?

This topic contains 2 replies, has 1 voice, and was last updated by  dfbdteam3 1 month, 3 weeks ago.

Viewing 3 posts - 1 through 3 (of 3 total)
  • Author
    Posts
  • #5530

    dfbdteam3
    Moderator

    Explain what is the relation between MapReduce and Hive?

    #5532

    dfbdteam3
    Moderator

    After the Hive finishes the query execution, the result is submitted to the JobTracker, which resides on YARN. The JobTracker consists of Map/Reduce tasks which runs the mapper and reducer job to store the final result in the HDFS. The Map task deserializes(reading) the data from the HDFS and the Reduce task serializes(writing) the data as the result of the Hive query.

    #5533

    dfbdteam3
    Moderator

    We can say that both technologies are part of the big data framework.
    Map Reduce is the framework used to process the data which is stored in the HDFS, here java native language is used to writing Map Reduce programs.
    Hive is a batch processing framework. This component process the data using a language called Hive Query Language(HQL). Hive prevents writing MapReduce programs in Java. Instead one can use SQL like language to do their daily tasks.
    For HIVE there is no process to communicate Map/Reduce tasks directly. It communicates with Job tracker(Application Master in YARN) only for job processing related things once it got scheduled.

Viewing 3 posts - 1 through 3 (of 3 total)

You must be logged in to reply to this topic.