This topic contains 1 reply, has 1 voice, and was last updated by  dfbdteam5 1 year, 6 months ago.

Viewing 2 posts - 1 through 2 (of 2 total)
  • Author
  • #6376


    Define Lazy Evaluation.
    How is the concept of lazy evaluation used in Spark?



    Lazy evaluation means the execution will not start until anaction is triggered. Transformations are lazy in nature i.e. when we call some operation on RDD, it does not execute immediately. Spark adds them to a DAG of computation and only when driver requests some data, this DAG actually gets executed

    Advantages of lazy evaluation.

    1) It is an optimization technique i.e. it provides optimization by reducing the number of queries.
    2) It saves the round trips between driver and cluster, thus speeds up the process.

    Upgrade your knowledge about Lazy Evaluation, click here => Lazy Evaluation in Apache Spark – A Quick guide

Viewing 2 posts - 1 through 2 (of 2 total)

You must be logged in to reply to this topic.