{"id":411,"date":"2016-06-13T12:53:36","date_gmt":"2016-06-13T12:53:36","guid":{"rendered":"http:\/\/data-flair.training\/blogs\/?p=411"},"modified":"2018-11-19T16:13:51","modified_gmt":"2018-11-19T10:43:51","slug":"setup-hadoop-cdh3-on-ubuntu-single-node-cluster","status":"publish","type":"post","link":"https:\/\/data-flair.training\/blogs\/setup-hadoop-cdh3-on-ubuntu-single-node-cluster\/","title":{"rendered":"Setup Hadoop CDH3 on Ubuntu (Single-Node-Cluster)"},"content":{"rendered":"

1.\u00a0Objective<\/h1>\n

This is a Step By Step Guide to Deploy Cloudera Hadoop (CDH3) on Ubuntu. In this tutorial, We will discuss setup and configuration of Cloudera Hadoop CDH3 on Ubuntu through virtual machine\u00a0in Windows. Alternatively you can watch below\u00a0Video tutorial “Setup Hadoop 1.x on Single Node Cluster on Ubuntu”<\/p>\n

If you are looking to install Hadoop 2.x or Cloudera CDH5 follow this tutorial:\u00a0Install Cloudera Hadoop CDH5 on Ubuntu<\/a><\/p>\n

\"Setup<\/a>

Setup Hadoop CDH3 on Ubuntu (Single-Node-Cluster)<\/p><\/div>\n

2. What is Hadoop<\/h1>\n
\"Apache<\/a>

Apache Hadoop<\/p><\/div>\n

Hadoop is a framework that allows distributed processing of large\u00a0data sets across clusters of computers using Map-Reduce programming models<\/a>. It is designed to scale up from single servers to thousand of machines, each offering local computing and storage. Hadoop is 100% open source, and pioneered a fundamentally new way of storing and processing data. Instead of relying on expensive, proprietary hardware and different systems to store and process data, Hadoop enables distributed parallel processing of huge amounts of data across inexpensive, industry-standard servers that both store and process the data, and can scale without limits. With Hadoop, no data is too big.
\nIn this tutorial we are going to discus the installation of hadoop CDH3 in Pseudo-Distributed Mode:<\/p>\n

3. Prerequisites<\/h2>\n

The prerequisites for this tutorial is that you should have the latest Virtual Box (Oracle or VMWare) installed. We will be using the Ubuntu, so firstly we need to install Virtual machine on Windows\u00a0and then install Ubuntu on virtual machine<\/a>.<\/p>\n

3.1. Virtual Machine creation (Optional)<\/h2>\n

This step is optional if you have Ubuntu machine \/ virtual machine ready, you can skip this step.
\nCreate the reference virtual machine, with the following parameters. This configuration is according to VMWare virtual machine :
\nStandard x86-compatible or x86-64-compatible personal computer 500 MHz or faster CPU minimum (500 MHz recommended) Compatible processors include<\/p>\n

3.1.1. Download Virtual environment<\/h3>\n

Download virtual machine environment setup. It is open source that means available freely VMware non commercial setup from Official Website of vmware by doing formal registration. Download\u00a0link: https:\/\/my.vmware.com\/web\/vmware\/downloads<\/a><\/p>\n

3.1.2. Installation of Virtual Machine :<\/h3>\n

We can Install\u00a0vmware setup in our\u00a0windows machine, create VM and install Ubuntu<\/a><\/p>\n

3.1.3. Compatible processors include<\/h3>\n

Intel: Celeron, Pentium II, Pentium III, Pentium 4, Pentium M (including computers with Centrino\u2122 mobile technology), Xeon\u2122 (including “Prestonia”), EM64T\u00a0AMD\u2122: Athlon\u2122, Athlon MP, Athlon XP, Athlon 64, Duron\u2122, Opteron\u2122, Turion\u2122 6<\/p>\n

3.1.4. Multiprocessor systems supported<\/h3>\n

AMD Opteron, AMD Athlon 64, AMD Turion 64, AMD Sempron, Intel EM64T; support for 64-bit guest operating systems is available only on the following specific versions of these processors:
\nAMD Athlon 64, revision D or later AMD Opteron, revision E or later AMD Turion 64, revision E or later AMD Sempron, 64-bit-capable revision D or later (experimental support) Intel EM64T VT-capable processors (experimental support)<\/p>\n

3.1.5. Memory<\/h3>\n

512 MB minimum (for leaning purpose (in the production it needs much higher RAM))\u00a0You must have enough memory to run the host operating system, application on host OS, and memory required for guest OS.<\/p>\n

3.1.6. Disk Drives<\/h3>\n

Guest operating systems can reside on physical disk partitions or in virtual disk files. In the production environment it is recommended that you should have more number of disk mount points using JBOD.<\/p>\n

3.1.7. Hard Disk<\/h3>\n

IDE and SCSI hard drives supported, up to 950GB capacity At least 1GB free disk space recommended for each guest operating system and the application software used with it; if you use a default setup, the actual disk space needs are approximately the same as those for installing and running the guest operating system and applications on a physical computer.<\/p>\n

3.1.8. Host Operating System<\/h3>\n

Vmware Workstation \/ Virtual Box is available for both Windows and Linux host operating systems.\u00a0Windows Host Operating Systems (32Bit) \/\u00a0Windows Host Operating Systems (64Bit).\u00a0Linux Host Operating Systems (32-Bit) \/ Linux Host Operating Systems (64-Bit)<\/p>\n

3.2. Install Ubuntu:<\/h2>\n

Now Virtual machine environment is ready now we can proceed to install Ubuntu in virtual machine<\/p>\n

3.2.1. Download Ubuntu<\/h3>\n

Download Ubuntu Disc Image setup. It is open source so we can download it. (Ubuntu 14.04)
\nhttp:\/\/releases.ubuntu.com\/14.04.2\/ubuntu-14.04.2-desktop-i386.iso<\/a><\/p>\n

3.2.2. Ubuntu Installation on Virtual Machine :<\/h3>\n

You are just few step away from Ubuntu working in your virtual machine. Now follow the steps:<\/p>\n