{"id":49330,"date":"2019-02-28T15:49:03","date_gmt":"2019-02-28T10:19:03","guid":{"rendered":"https:\/\/data-flair.training\/blogs\/?p=49330"},"modified":"2019-02-28T15:49:03","modified_gmt":"2019-02-28T10:19:03","slug":"advantages-and-disadvantages-of-hadoop","status":"publish","type":"post","link":"https:\/\/data-flair.training\/blogs\/advantages-and-disadvantages-of-hadoop\/","title":{"rendered":"Top Advantages and Disadvantages of Hadoop 3"},"content":{"rendered":"

The objective of this tutorial is to discuss the advantages and disadvantages of Hadoop 3.0. As many changes are introduced in Hadoop 3.0<\/strong><\/a> it has become a better product.<\/p>\n

Hadoop is designed to store and manage a large amount of data. There are many advantages of Hadoop like it is free and open source, easy to use, its performance etc. but on the other hand, it has some weaknesses which we called as disadvantages.<\/p>\n

So, let’s start exploring the top\u00a0advantages and disadvantages of Hadoop.<\/p>\n

\"Top<\/a>

Top Advantages and Disadvantages of Hadoop 3<\/p><\/div>\n

Advantages of Hadoop<\/h2>\n

Hadoop is easy to use, scalable and cost-effective. Along with this, Hadoop has many advantages. Here we are discussing the top 12 advantages of Hadoop. So, following are the pros of Hadoop that makes it so popular –<\/p>\n

\"\"<\/a>

Advantages of Hadoop<\/p><\/div>\n

1. Varied Data Sources<\/h3>\n

Hadoop accepts a variety of data. Data can come from a range of sources like email conversation, social media etc. and can be of structured or unstructured form. Hadoop can derive value from diverse data. Hadoop can accept data in a text file, XML file, images, CSV files etc.<\/p>\n

2. Cost-effective<\/h3>\n

Hadoop is an economical solution as it uses a cluster of commodity hardware to store data. Commodity hardware is cheap machines hence the cost of adding nodes to the framework is not much high. In Hadoop 3.0 we have only 50% of storage overhead as opposed to 200% in Hadoop2.x. This requires less machine to store data as the redundant data decreased significantly.<\/p>\n

3. Performance<\/h3>\n

Hadoop with its distributed processing and distributed storage architecture processes huge amounts of data with high speed. Hadoop even defeated supercomputer the fastest machine in 2008<\/strong>. It divides the input data file into a number of blocks and stores data in these blocks over several nodes. It also divides the task that user submits into various sub-tasks which assign to these worker nodes containing required data and these sub-task run in parallel thereby improving the performance.<\/p>\n

4. Fault-Tolerant<\/h3>\n

In Hadoop 3.0 fault tolerance is provided by erasure coding. For example, 6 data blocks produce 3 parity blocks by using erasure coding technique, so HDFS stores a total of these 9 blocks. In event of failure of any node the data block affected can be recovered by using these parity blocks and the remaining data blocks.<\/p>\n

5. Highly Available<\/h3>\n

In Hadoop 2.x, HDFS architecture<\/strong><\/a> has a single active NameNode and a single Standby NameNode, so if a NameNode goes down then we have standby NameNode to count on. But Hadoop 3.0 supports multiple standby NameNode making the system even more highly available as it can continue functioning in case if two or more NameNodes crashes.<\/p>\n

6. Low Network Traffic<\/h3>\n

In Hadoop, each job submitted by the user is split into a number of independent sub-tasks and these sub-tasks are assigned to the data nodes thereby moving a small amount of code to data rather than moving huge data to code which leads to low network traffic.<\/p>\n

7. High Throughput<\/h3>\n

Throughput means job done per unit time. Hadoop stores data in a distributed fashion which allows using distributed processing with ease. A given job gets divided into small jobs which work on chunks of data in parallel thereby giving high throughput.<\/p>\n

8. Open Source<\/h3>\n

Hadoop is an open source technology i.e. its source code is freely available. We can modify the source code to suit a specific requirement.<\/p>\n

9. Scalable<\/h3>\n

Hadoop works on the principle of horizontal scalability i.e. we need to add the entire machine to the cluster of nodes and not change the configuration of a machine like adding RAM, disk and so on which is known as vertical scalability. Nodes can be added to Hadoop cluster<\/strong><\/a> on the fly making it a scalable framework.<\/p>\n

10. Ease of use<\/h3>\n

The Hadoop framework<\/strong> takes care of parallel processing, MapReduce programmers does not need to care for achieving distributed processing, it is done at the backend automatically.<\/p>\n

11. Compatibility<\/h3>\n

Most of the emerging technology of Big Data<\/strong> is compatible with Hadoop like Spark, Flink etc. They have got processing engines which work over Hadoop as a backend i.e. We use Hadoop as data storage platforms for them.<\/p>\n

12. Multiple Languages Supported<\/h3>\n

Developers can code using many languages on Hadoop like C, C++, Perl, Python<\/strong><\/a>, Ruby, and Groovy.<\/p>\n

2. Disadvantages of Hadoop<\/h2>\n
\"Advantages<\/a>

Disadvantages of Hadoop<\/p><\/div>\n

1. Issue With Small Files<\/h3>\n

Hadoop is suitable for a small number of large files but when it comes to the application which deals with a large number of small files, Hadoop fails here. A small file is nothing but a file which is significantly smaller than Hadoop\u2019s block size which can be either 128MB or 256MB by default. These large number of small files overload the Namenode as it stores namespace for the system and makes it difficult for Hadoop to function.<\/p>\n

2. Vulnerable By Nature<\/h3>\n

Hadoop is written in Java which is a widely used programming language<\/strong><\/a> hence it is easily exploited by cyber criminals which makes Hadoop vulnerable to security breaches.<\/p>\n

3. Processing Overhead<\/h3>\n

In Hadoop, the data is read from the disk and written to the disk which makes read\/write operations very expensive when we are dealing with tera and petabytes of data. Hadoop cannot do in-memory calculations hence it incurs processing overhead.<\/p>\n

4. Supports Only Batch Processing<\/h3>\n

At the core, Hadoop has a batch processing engine which is not efficient in stream processing. It cannot produce output in real-time with low latency. It only works on data which we collect and store in a file in advance before processing.<\/p>\n

5. Iterative Processing<\/h3>\n

Hadoop cannot do iterative processing by itself. Machine learning<\/strong> <\/a>or iterative processing has a cyclic data flow whereas Hadoop has data flowing in a chain of stages where output on one stage becomes the input of another stage.<\/p>\n

6. Security<\/h3>\n

For security<\/a><\/strong>, Hadoop uses Kerberos authentication which is hard to manage. It is missing encryption at storage and network levels which are a major point of concern.<\/p>\n

So, this was all about Hadoop Pros and Cons. Hope you liked our explanation.<\/p>\n

Summary – Advantages and Disadvantages of Hadoop<\/h2>\n

Every software used by the industry comes with its own set of drawbacks and benefits. If the software is essential for the organization then one can exploit the benefits and take measures to minimize the faults. We can see that Hadoop has benefits which outweigh its shortcomings making it a strong solution to Big Data needs<\/strong><\/a>. Still, if you have any query regarding Hadoop advantages and disadvantages, ask through the comments.

The objective of this tutorial is to discuss the advantages and disadvantages of Hadoop 3.0. As many changes are introduced in Hadoop 3.0 it has become a better product. Hadoop is designed to store...<\/p>\n","protected":false},"author":6,"featured_media":49402,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[22],"tags":[18869,18868,18870,5280,18867],"class_list":["post-49330","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-hadoop","tag-hadoop-advantages","tag-hadoop-benefits","tag-hadoop-disadvantages","tag-hadoop-limitations","tag-hadoop-pros-and-cons"],"yoast_head":"\nTop Advantages and Disadvantages of Hadoop 3 - DataFlair<\/title>\n<meta name=\"description\" content=\"Explore the top advantages and Disadvantages of Hadoop. Hadoop Pros -Compatibility,Low network traffic,fault-tolerant,performance\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/data-flair.training\/blogs\/advantages-and-disadvantages-of-hadoop\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Top Advantages and Disadvantages of Hadoop 3 - DataFlair\" \/>\n<meta property=\"og:description\" content=\"Explore the top advantages and Disadvantages of Hadoop. Hadoop Pros -Compatibility,Low network traffic,fault-tolerant,performance\" \/>\n<meta property=\"og:url\" content=\"https:\/\/data-flair.training\/blogs\/advantages-and-disadvantages-of-hadoop\/\" \/>\n<meta property=\"og:site_name\" content=\"DataFlair\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/DataFlairWS\/\" \/>\n<meta property=\"article:published_time\" content=\"2019-02-28T10:19:03+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/data-flair.training\/blogs\/wp-content\/uploads\/sites\/2\/2019\/02\/Top-Advantages-and-Disadvantages-of-Hadoop.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1200\" \/>\n\t<meta property=\"og:image:height\" content=\"628\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"DataFlair Team\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@DataFlairWS\" \/>\n<meta name=\"twitter:site\" content=\"@DataFlairWS\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"DataFlair Team\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"5 minutes\" \/>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Top Advantages and Disadvantages of Hadoop 3 - DataFlair","description":"Explore the top advantages and Disadvantages of Hadoop. Hadoop Pros -Compatibility,Low network traffic,fault-tolerant,performance","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/data-flair.training\/blogs\/advantages-and-disadvantages-of-hadoop\/","og_locale":"en_US","og_type":"article","og_title":"Top Advantages and Disadvantages of Hadoop 3 - DataFlair","og_description":"Explore the top advantages and Disadvantages of Hadoop. Hadoop Pros -Compatibility,Low network traffic,fault-tolerant,performance","og_url":"https:\/\/data-flair.training\/blogs\/advantages-and-disadvantages-of-hadoop\/","og_site_name":"DataFlair","article_publisher":"https:\/\/www.facebook.com\/DataFlairWS\/","article_published_time":"2019-02-28T10:19:03+00:00","og_image":[{"width":1200,"height":628,"url":"https:\/\/data-flair.training\/blogs\/wp-content\/uploads\/sites\/2\/2019\/02\/Top-Advantages-and-Disadvantages-of-Hadoop.jpg","type":"image\/jpeg"}],"author":"DataFlair Team","twitter_card":"summary_large_image","twitter_creator":"@DataFlairWS","twitter_site":"@DataFlairWS","twitter_misc":{"Written by":"DataFlair Team","Est. reading time":"5 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/data-flair.training\/blogs\/advantages-and-disadvantages-of-hadoop\/#article","isPartOf":{"@id":"https:\/\/data-flair.training\/blogs\/advantages-and-disadvantages-of-hadoop\/"},"author":{"name":"DataFlair Team","@id":"https:\/\/data-flair.training\/blogs\/#\/schema\/person\/2c58ecb4f73a39f0ef993f1ddfcd7b89"},"headline":"Top Advantages and Disadvantages of Hadoop 3","datePublished":"2019-02-28T10:19:03+00:00","mainEntityOfPage":{"@id":"https:\/\/data-flair.training\/blogs\/advantages-and-disadvantages-of-hadoop\/"},"wordCount":1096,"commentCount":3,"publisher":{"@id":"https:\/\/data-flair.training\/blogs\/#organization"},"image":{"@id":"https:\/\/data-flair.training\/blogs\/advantages-and-disadvantages-of-hadoop\/#primaryimage"},"thumbnailUrl":"https:\/\/data-flair.training\/blogs\/wp-content\/uploads\/sites\/2\/2019\/02\/Top-Advantages-and-Disadvantages-of-Hadoop.jpg","keywords":["Hadoop advantages","Hadoop Benefits","hadoop disadvantages","Hadoop Limitations","Hadoop Pros and Cons"],"articleSection":["Hadoop Tutorials"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/data-flair.training\/blogs\/advantages-and-disadvantages-of-hadoop\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/data-flair.training\/blogs\/advantages-and-disadvantages-of-hadoop\/","url":"https:\/\/data-flair.training\/blogs\/advantages-and-disadvantages-of-hadoop\/","name":"Top Advantages and Disadvantages of Hadoop 3 - DataFlair","isPartOf":{"@id":"https:\/\/data-flair.training\/blogs\/#website"},"primaryImageOfPage":{"@id":"https:\/\/data-flair.training\/blogs\/advantages-and-disadvantages-of-hadoop\/#primaryimage"},"image":{"@id":"https:\/\/data-flair.training\/blogs\/advantages-and-disadvantages-of-hadoop\/#primaryimage"},"thumbnailUrl":"https:\/\/data-flair.training\/blogs\/wp-content\/uploads\/sites\/2\/2019\/02\/Top-Advantages-and-Disadvantages-of-Hadoop.jpg","datePublished":"2019-02-28T10:19:03+00:00","description":"Explore the top advantages and Disadvantages of Hadoop. Hadoop Pros -Compatibility,Low network traffic,fault-tolerant,performance","breadcrumb":{"@id":"https:\/\/data-flair.training\/blogs\/advantages-and-disadvantages-of-hadoop\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/data-flair.training\/blogs\/advantages-and-disadvantages-of-hadoop\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/data-flair.training\/blogs\/advantages-and-disadvantages-of-hadoop\/#primaryimage","url":"https:\/\/data-flair.training\/blogs\/wp-content\/uploads\/sites\/2\/2019\/02\/Top-Advantages-and-Disadvantages-of-Hadoop.jpg","contentUrl":"https:\/\/data-flair.training\/blogs\/wp-content\/uploads\/sites\/2\/2019\/02\/Top-Advantages-and-Disadvantages-of-Hadoop.jpg","width":1200,"height":628,"caption":"Top Advantages and Disadvantages of Hadoop 3"},{"@type":"BreadcrumbList","@id":"https:\/\/data-flair.training\/blogs\/advantages-and-disadvantages-of-hadoop\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Blog Home","item":"https:\/\/data-flair.training\/blogs\/"},{"@type":"ListItem","position":2,"name":"Hadoop Tutorials","item":"https:\/\/data-flair.training\/blogs\/category\/hadoop\/"},{"@type":"ListItem","position":3,"name":"Top Advantages and Disadvantages of Hadoop 3"}]},{"@type":"WebSite","@id":"https:\/\/data-flair.training\/blogs\/#website","url":"https:\/\/data-flair.training\/blogs\/","name":"DataFlair","description":"Learn Today. Lead Tomorrow.","publisher":{"@id":"https:\/\/data-flair.training\/blogs\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/data-flair.training\/blogs\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/data-flair.training\/blogs\/#organization","name":"DataFlair","url":"https:\/\/data-flair.training\/blogs\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/data-flair.training\/blogs\/#\/schema\/logo\/image\/","url":"https:\/\/data-flair.training\/blogs\/wp-content\/uploads\/sites\/2\/2016\/07\/Data-Flair.png","contentUrl":"https:\/\/data-flair.training\/blogs\/wp-content\/uploads\/sites\/2\/2016\/07\/Data-Flair.png","width":106,"height":48,"caption":"DataFlair"},"image":{"@id":"https:\/\/data-flair.training\/blogs\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/DataFlairWS\/","https:\/\/x.com\/DataFlairWS","https:\/\/www.linkedin.com\/company\/dataflair-web-services-pvt-ltd\/","https:\/\/www.youtube.com\/user\/DataFlairWS"]},{"@type":"Person","@id":"https:\/\/data-flair.training\/blogs\/#\/schema\/person\/2c58ecb4f73a39f0ef993f1ddfcd7b89","name":"DataFlair Team","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/1ce4a0e3e542444fc73bbebf83e89e8b73e2d95ccb1fcee64da9945f078b97c5?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/1ce4a0e3e542444fc73bbebf83e89e8b73e2d95ccb1fcee64da9945f078b97c5?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/1ce4a0e3e542444fc73bbebf83e89e8b73e2d95ccb1fcee64da9945f078b97c5?s=96&d=mm&r=g","caption":"DataFlair Team"},"description":"The DataFlair Team provides industry-driven content on programming, Java, Python, C++, DSA, AI, ML, data Science, Android, Flutter, MERN, Web Development, and technology. Our expert educators focus on delivering value-packed, easy-to-follow resources for tech enthusiasts and professionals.","url":"https:\/\/data-flair.training\/blogs\/author\/dfteam2\/"}]}},"amp_enabled":true,"_links":{"self":[{"href":"https:\/\/data-flair.training\/blogs\/wp-json\/wp\/v2\/posts\/49330","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/data-flair.training\/blogs\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/data-flair.training\/blogs\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/data-flair.training\/blogs\/wp-json\/wp\/v2\/users\/6"}],"replies":[{"embeddable":true,"href":"https:\/\/data-flair.training\/blogs\/wp-json\/wp\/v2\/comments?post=49330"}],"version-history":[{"count":3,"href":"https:\/\/data-flair.training\/blogs\/wp-json\/wp\/v2\/posts\/49330\/revisions"}],"predecessor-version":[{"id":51048,"href":"https:\/\/data-flair.training\/blogs\/wp-json\/wp\/v2\/posts\/49330\/revisions\/51048"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/data-flair.training\/blogs\/wp-json\/wp\/v2\/media\/49402"}],"wp:attachment":[{"href":"https:\/\/data-flair.training\/blogs\/wp-json\/wp\/v2\/media?parent=49330"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/data-flair.training\/blogs\/wp-json\/wp\/v2\/categories?post=49330"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/data-flair.training\/blogs\/wp-json\/wp\/v2\/tags?post=49330"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}