Why we need compression and what are the different compression format supported?

Free Online Certification Courses – Learn Today. Lead Tomorrow. Forums Apache Spark Why we need compression and what are the different compression format supported?

Viewing 1 reply thread
  • Author
    Posts
    • #5193
      DataFlair TeamDataFlair Team
      Spectator

      Why we need compression and what are the different compression format supported?

    • #5198
      DataFlair TeamDataFlair Team
      Spectator
        <li style=”list-style-type: none”>
      • In Big Data, when we used the compression, it saves the storage space and reduce the network overhead.
      • One can specify the compression coded while writing the data to HDFS ( Hadoop format)
      • One can also read the compressed data, for that also we can use compression codec.
      • Following are the different compression format support in BigData:

      * gzip
      * lzo
      * bzip2
      * Zlib
      * Snappy

Viewing 1 reply thread
  • You must be logged in to reply to this topic.