Why RDD is immutable ?

[DataFlair Team]

Why RDD is immutable ?

[DataFlair Team]

Following are the reasons:
– Immutable data is always safe to share across multiple processes as well as multiple threads.
– Since RDD is immutable we can recreate the RDD any time. (From lineage graph).
– If the computation is time-consuming, in that we can cache the RDD which result in performance improvement.

Please add more points if I am missing something
RDDs are also fault-tolerant and evaluate lazily for more information read Fault tolerance in Spark and Lazy evaluation in Spark.

[Author]

Posts