Why we need compression and what are the different compression format supported?

Live instructor-led & Self-paced Online Certification Training Courses (Big Data, Hadoop, Spark) Forums Apache Spark Why we need compression and what are the different compression format supported?

Viewing 1 reply thread
  • Author
    Posts
    • #5193
      DataFlair Team
      Moderator

      Why we need compression and what are the different compression format supported?

    • #5198
      DataFlair Team
      Moderator
        <li style=”list-style-type: none”>
      • In Big Data, when we used the compression, it saves the storage space and reduce the network overhead.
      • One can specify the compression coded while writing the data to HDFS ( Hadoop format)
      • One can also read the compressed data, for that also we can use compression codec.
      • Following are the different compression format support in BigData:

      * gzip
      * lzo
      * bzip2
      * Zlib
      * Snappy

Viewing 1 reply thread
  • You must be logged in to reply to this topic.