what is the requirements of passwordless SSH during the installation of Hadoop

Free Online Certification Courses – Learn Today. Lead Tomorrow. Forums Apache Hadoop what is the requirements of passwordless SSH during the installation of Hadoop

Viewing 2 reply threads
  • Author
    Posts
    • #5376
      DataFlair TeamDataFlair Team
      Spectator

      When we install and configure Hadoop, we need to setup passwordless ssh from Master to all the slaves. What is the requirements to setup password-less ssh ?

    • #5377
      DataFlair TeamDataFlair Team
      Spectator

      When setting up the clusters, nodes may communicate frequently among each other. Normal SSH gateway requires password to be entered each time when a service tries to connect to any node. This will slow down the process to a great extent. This is the need of Password-less SSH during the installation of Hadoop.

      Follow the link to learn more about Hadoop Installation

    • #5378
      DataFlair TeamDataFlair Team
      Spectator

      Usually Passwordless ssh is getting setup in distributed technology, where always node to node communication must be faster.

      As we know that Hadoop is fully distributed technology. All data getting store in multiple commodity hardware, so there must be the faster communication with each other.
      Actually hadoop is working on the Master-Slave architecture. When client need to store or access the data from HDFS, then its submit request to Master node then the master node distributing the request to multiple Slave nodes. Mean if we are not doing Passwordless ssh setup then for every client request Master will need to login slaves via credentials. Is this really feasible for faster data processing ? Of course No.

      That’s why we need the Passwordless ssh setup in hadoop to make it feasible. Master will not need to login the slaves, it will directly go to the slave address and will fetch or store the require data.

Viewing 2 reply threads
  • You must be logged in to reply to this topic.