Why does one remove or add nodes in a Hadoop cluster frequently?

[DataFlair Team]

Why to add or remove nodes frequently in Hadoop cluster?
What is the need to add or remove nodes in Hadoop cluster frequently?

[DataFlair Team]

1) The most important features of the Hadoop is its utilization of Commodity hardware. However, this leads to frequent Datanode crashes in a Hadoop cluster.

2) Another striking feature of Hadoop is the ease of scale by the rapid growth in data volume.

Hence, due to above reasons, administrator Add/Remove DataNodes in a hadoop Cluster.

[DataFlair Team]

Basically, in a Hadoop cluster a Manager node will be deployed on a reliable hardware with high configurations, the Slave node’s will be deployed on commodity hardware. So chance’s of data node crashing is more . So more frequently you will see admin’s remove and add new data node’s in a cluster.

Also adding of more data node’s in the cluster is done to handle large volume of data.

[Author]

Posts