Explain the types of transformation on DStream.

Free Online Certification Courses – Learn Today. Lead Tomorrow. Forums Apache Spark Explain the types of transformation on DStream.

Viewing 1 reply thread
  • Author
    Posts
    • #5397
      DataFlair TeamDataFlair Team
      Spectator

      Explain the types of transformation on DStream.

    • #5398
      DataFlair TeamDataFlair Team
      Spectator

      There are two types transformation on DStream.
      # stateless transformation : 
      > In stateless transformation, the processing of each batch does not depend on the data of its previous batches.
      # stateful transformation : 
      > stateful transformation use data or intermediate results from previous batches to compute the result of the current batch.

      Also refer to Transformation operation in Spark Streaming.

Viewing 1 reply thread
  • You must be logged in to reply to this topic.