What is lazy evaluation in Spark?

Viewing 1 reply thread
  • Author
    Posts
    • #6376
      DataFlair Team
      Moderator

      Define Lazy Evaluation.
      How is the concept of lazy evaluation used in Spark?

    • #6377
      DataFlair Team
      Moderator

      Introduction
      Lazy evaluation means the execution will not start until anaction is triggered. Transformations are lazy in nature i.e. when we call some operation on RDD, it does not execute immediately. Spark adds them to a DAG of computation and only when driver requests some data, this DAG actually gets executed

      Advantages of lazy evaluation.

      1) It is an optimization technique i.e. it provides optimization by reducing the number of queries.
      2) It saves the round trips between driver and cluster, thus speeds up the process.

      Upgrade your knowledge about Lazy Evaluation, click here => Lazy Evaluation in Apache Spark – A Quick guide

Viewing 1 reply thread
  • You must be logged in to reply to this topic.