Live instructor-led & Self-paced Online Certification Training Courses (Big Data, Hadoop, Spark) Forums Hadoop What are the the issues associated with map and reduce slots based mechanism ?

This topic contains 1 reply, has 1 voice, and was last updated by  dfbdteam3 1 year, 6 months ago.

Viewing 2 posts - 1 through 2 (of 2 total)
  • Author
    Posts
  • #5229

    dfbdteam3
    Moderator

    What are the the issues associated with map and reduce slots based mechanism in Hadoop version 1?

    #5231

    dfbdteam3
    Moderator

    In Hadoop, each MapReduce job is split into the task. Task Tracker run each task on a fixed number of map and reduce slots inside a data node based on a static configuration.

    Issues associated with map and reduce slots are as follows:

    • In a slot based model, it is hard for non-MapReduce applications to be scheduled appropriately.
    • Slots are wasted, anytime the cluster workload does not fit the static configuration.
    • Jobs never leave their original slots and cannot be moved to free slots
Viewing 2 posts - 1 through 2 (of 2 total)

You must be logged in to reply to this topic.