- This topic has 2 replies, 1 voice, and was last updated 5 years, 7 months ago by
.
-
Posts
-
-
-
<div class=”post”>
Hadoop emerged as a solution to the “Big Data” problems. It is a part of the Apache project sponsored by the Apache Software Foundation (ASF). It is an open source software framework for distributed storage and distributed processing of large data sets. Open source means it is freely available and even we can change its source code as per our requirements.
Hadoop Cluster:
Generally any set of tightly or loosely connected computers, that together works as a single system is called Cluster i.e. a computer cluster used for hadoop is called Hadoop Cluster.
Apache Hadoop cluster is outstanding computational cluster. It is specially designed for storing and processing/ analyzing huge amount of unstructured data in distributed computing environment. Hadoop cluster run on low cost commodity computers.
Apache Hadoop cluster consists of 3 different nodes:- Master node
- Slave node
- Client node
Learning about different nodes will help us to plan hadoop cluster.
Master node: Master node regulates file access to the client. It maintains and manages the slave nodes. Assign the task to slave node. It executes file system namespace operations like opening, closing files/directories.
Slave node: Slave node is the actual worker node which manages storage of data. Slave node do read-write operations as per the request from the clients. It also perform various operation like Data Block creation, deletion etc. according to instruction from the NameNode.
Client node: Client nodes have Hadoop installed with all the cluster settings. Client node loads the data into the cluster. Then it submit MapReduce job that decides how that data should be processed. When processing is finished it retrieves the results of the job.Follow the link to learn more about Hadoop Cluster
</div>
-
A Cluster is a group of the computer connected together & working together as a single system.
Hadoop Cluster is a special type of computational cluster designed for storing and analyzing the vast amount of unstructured data in a distributed computing environment. These clusters run on low-cost commodity computers.
Hadoop is not bounder by single schema, it is possible to process both structured & unstructured data.
Large Hadoop Clusters are arranged in several racks. Network traffic between different nodes in the same rack is much more desirable than network traffic across the racks.
Hadoop cluster has 3 components:
Client
Master
Slave
-
- You must be logged in to reply to this topic.
