Spark Streaming Output on HDFS

This topic has 1 reply, 1 voice, and was last updated 5 years, 7 months ago by DataFlair Team.

Viewing 1 reply thread

Author

Posts
- September 20, 2018 at 1:57 pm #5028
  
  DataFlair Team
  Spectator
  
  How can we store spark streaming output in HDFS efficiently? Any suggestion?
- September 20, 2018 at 1:57 pm #5030
  
  DataFlair Team
  Spectator
  
  Hi ,
  After receive data from source you can Create RDD
  and u can use method RDD..saveAsTextFile(“hdfs://localhost:9000/out”) to store that data in HDFS
Author

Posts

Viewing 1 reply thread

You must be logged in to reply to this topic.