http:\/\/flink.apache.org\/downloads.html<\/a><\/p>\nb. Untar the file<\/h5>\n
In order to extract all the contents of compressed Apache Flink file package, use the below command:
\n[php]dataflair@ubuntu:~$ tar xzf flink-1.1.3-bin-hadoop26-scala_2.11.tgz[\/php]<\/p>\n
c. Rename the directory<\/h5>\n
[php]dataflair@ubuntu:~$ mv flink-1.1.3\/ flink [\/php]<\/p>\n
d. Setup Configuration<\/h5>\ni.\u00a0Go to Flink conf\u00a0directory<\/h6>\n
[php]dataflair@ubuntu:~$ cd flink[\/php]
\n[php]dataflair@ubuntu:~\/flink$ cd conf [\/php]<\/p>\n
ii. Add the entry of Master<\/h6>\n
Choose a master node (JobManager) and set the jobmanager.rpc.address in conf\/flink-conf.yaml to its IP or hostname. Make sure that all nodes in your cluster have the same jobmanager.rpc.address configured.
\n[php]dataflair@ubuntu:~\/flink\/conf$ nano flink-conf.yaml
\nAdd this line: jobmanager.rpc.address: 192.168.1.3[\/php]<\/p>\n
iii. Add the entry of all the\u00a0Slaves<\/h6>\n
Add the IPs or hostnames (one per line) of all worker nodes (TaskManager) to the slaves files in conf\/slaves. To configure file use the following command.
\n[php]dataflair@ubuntu:~\/flink\/conf$ nano slaves [\/php]
\nEnter ip addresses like this \u2013
\n192.168.1.4
\n192.168.1.5<\/p>\n
II. Install Flink on\u00a0Slaves<\/h4>\na. Copy configured setup from master to all the slaves<\/h5>\n
We will create a tar\u00a0of configured Flink setup and copy it on all the slaves.<\/p>\n
i. Create tar-ball of configured setup:<\/h6>\n
[php] $ tar czf flink.tar.gz flink [\/php]
\nNOTE: Run this command on Master<\/em><\/p>\nii. Copy the configured tar-ball on all the slaves<\/h6>\n
[php] $ scp flink.tar.gz 192.168.1.4:~
\n$ scp flink.tar.gz 192.168.1.5:~[\/php]
\nNOTE: Run this command on Master<\/em><\/p>\niii. Un-tar configured hadoop setup on all the slaves<\/h6>\n
[php] $ tar xzf flink.tar.gz [\/php]
\nNOTE: Run this command on all the slaves<\/em><\/p>\n2.4. Start that Flink Cluster<\/h3>\nI. Start the cluster<\/h4>\n
To start\u00a0the cluster run below script, it will start\u00a0all the daemons running on master as well as slaves.
\n[php]dataflair@ubuntu:~\/flink\/$ bin\/start-cluster.sh[\/php]
\nNOTE: Run this command on Master<\/em><\/p>\nII. Check whether services have been started<\/h4>\na. Check daemons on Master<\/h5>\n
[php] $ jps
\nJobManager [\/php]<\/p>\n
b. Check daemons on\u00a0Slaves<\/h5>\n
[php] $ jps
\nTaskManager [\/php]
\nNow the cluster has been setup successfully, you can play with the cluster..!!<\/p>\n
III. Stop the cluster<\/h4>\n
To stop the cluster run below script, it will stop all the daemons running on master as well as slaves
\n[php]dataflair@ubuntu:~\/flink\/$ bin\/stop-cluster.sh[\/php]
\nFollow this tutorial for real life use-case of Apache Flink.<\/p>\n
Spark or Flink which will be the successor of Hadoop-MapReduce, Refer Spark vs Flink comparison Guide<\/span><\/p>\n","protected":false},"excerpt":{"rendered":"In this blog, we will learn how to install Apache Flink in cluster mode on Ubuntu 14.04. Setup\u00a0of Flink on multiple nodes is also called Flink in Distributed mode. This blog provides step by...<\/p>\n","protected":false},"author":6,"featured_media":42893,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[8],"tags":[138,750,1907,3760,4738,4747,4752,4768,4785,4846,6761,6763,6766],"class_list":["post-499","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-flink","tag-4g-of-big-data","tag-apache-flink","tag-big-data","tag-deploy-flink","tag-flink","tag-flink-cluster","tag-flink-configuration","tag-flink-installation","tag-flink-standalone-mode","tag-flunk-cluster-setup","tag-install-flink","tag-install-flink-cluster","tag-install-flink-ubuntu"],"yoast_head":"\n
Install & Run Apache Flink on Multi-node Cluster - DataFlair<\/title>\n<meta name=\"description\" content=\"Steps to install Apache Flink on multi-node cluster on Ubuntu. Learn prerequisites for flink setup, how to install flink in cluster mode,start-stop flink.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/data-flair.training\/blogs\/install-run-flink-multi-node-cluster\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Install & Run Apache Flink on Multi-node Cluster - DataFlair\" \/>\n<meta property=\"og:description\" content=\"Steps to install Apache Flink on multi-node cluster on Ubuntu. Learn prerequisites for flink setup, how to install flink in cluster mode,start-stop flink.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/data-flair.training\/blogs\/install-run-flink-multi-node-cluster\/\" \/>\n<meta property=\"og:site_name\" content=\"DataFlair\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/DataFlairWS\/\" \/>\n<meta property=\"article:published_time\" content=\"2016-06-29T13:47:21+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2021-05-09T07:53:53+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/data-flair.training\/blogs\/wp-content\/uploads\/sites\/2\/2016\/06\/Apache-Flink-Install-Run-on-Multi-Node-Cluster-01.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1200\" \/>\n\t<meta property=\"og:image:height\" content=\"628\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"DataFlair Team\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@DataFlairWS\" \/>\n<meta name=\"twitter:site\" content=\"@DataFlairWS\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"DataFlair Team\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"4 minutes\" \/>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Install & Run Apache Flink on Multi-node Cluster - DataFlair","description":"Steps to install Apache Flink on multi-node cluster on Ubuntu. Learn prerequisites for flink setup, how to install flink in cluster mode,start-stop flink.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/data-flair.training\/blogs\/install-run-flink-multi-node-cluster\/","og_locale":"en_US","og_type":"article","og_title":"Install & Run Apache Flink on Multi-node Cluster - DataFlair","og_description":"Steps to install Apache Flink on multi-node cluster on Ubuntu. Learn prerequisites for flink setup, how to install flink in cluster mode,start-stop flink.","og_url":"https:\/\/data-flair.training\/blogs\/install-run-flink-multi-node-cluster\/","og_site_name":"DataFlair","article_publisher":"https:\/\/www.facebook.com\/DataFlairWS\/","article_published_time":"2016-06-29T13:47:21+00:00","article_modified_time":"2021-05-09T07:53:53+00:00","og_image":[{"width":1200,"height":628,"url":"https:\/\/data-flair.training\/blogs\/wp-content\/uploads\/sites\/2\/2016\/06\/Apache-Flink-Install-Run-on-Multi-Node-Cluster-01.jpg","type":"image\/jpeg"}],"author":"DataFlair Team","twitter_card":"summary_large_image","twitter_creator":"@DataFlairWS","twitter_site":"@DataFlairWS","twitter_misc":{"Written by":"DataFlair Team","Est. reading time":"4 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/data-flair.training\/blogs\/install-run-flink-multi-node-cluster\/#article","isPartOf":{"@id":"https:\/\/data-flair.training\/blogs\/install-run-flink-multi-node-cluster\/"},"author":{"name":"DataFlair Team","@id":"https:\/\/data-flair.training\/blogs\/#\/schema\/person\/2c58ecb4f73a39f0ef993f1ddfcd7b89"},"headline":"Install & Run Apache Flink on Multi-node Cluster","datePublished":"2016-06-29T13:47:21+00:00","dateModified":"2021-05-09T07:53:53+00:00","mainEntityOfPage":{"@id":"https:\/\/data-flair.training\/blogs\/install-run-flink-multi-node-cluster\/"},"wordCount":983,"commentCount":3,"publisher":{"@id":"https:\/\/data-flair.training\/blogs\/#organization"},"image":{"@id":"https:\/\/data-flair.training\/blogs\/install-run-flink-multi-node-cluster\/#primaryimage"},"thumbnailUrl":"https:\/\/data-flair.training\/blogs\/wp-content\/uploads\/sites\/2\/2016\/06\/Apache-Flink-Install-Run-on-Multi-Node-Cluster-01.jpg","keywords":["4g of big data","apache flink","big data","deploy flink","flink","flink cluster","flink configuration","flink installation","flink standalone mode","flunk cluster setup","install flink","install flink cluster","install flink ubuntu"],"articleSection":["Apache Flink Tutorials"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/data-flair.training\/blogs\/install-run-flink-multi-node-cluster\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/data-flair.training\/blogs\/install-run-flink-multi-node-cluster\/","url":"https:\/\/data-flair.training\/blogs\/install-run-flink-multi-node-cluster\/","name":"Install & Run Apache Flink on Multi-node Cluster - DataFlair","isPartOf":{"@id":"https:\/\/data-flair.training\/blogs\/#website"},"primaryImageOfPage":{"@id":"https:\/\/data-flair.training\/blogs\/install-run-flink-multi-node-cluster\/#primaryimage"},"image":{"@id":"https:\/\/data-flair.training\/blogs\/install-run-flink-multi-node-cluster\/#primaryimage"},"thumbnailUrl":"https:\/\/data-flair.training\/blogs\/wp-content\/uploads\/sites\/2\/2016\/06\/Apache-Flink-Install-Run-on-Multi-Node-Cluster-01.jpg","datePublished":"2016-06-29T13:47:21+00:00","dateModified":"2021-05-09T07:53:53+00:00","description":"Steps to install Apache Flink on multi-node cluster on Ubuntu. Learn prerequisites for flink setup, how to install flink in cluster mode,start-stop flink.","breadcrumb":{"@id":"https:\/\/data-flair.training\/blogs\/install-run-flink-multi-node-cluster\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/data-flair.training\/blogs\/install-run-flink-multi-node-cluster\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/data-flair.training\/blogs\/install-run-flink-multi-node-cluster\/#primaryimage","url":"https:\/\/data-flair.training\/blogs\/wp-content\/uploads\/sites\/2\/2016\/06\/Apache-Flink-Install-Run-on-Multi-Node-Cluster-01.jpg","contentUrl":"https:\/\/data-flair.training\/blogs\/wp-content\/uploads\/sites\/2\/2016\/06\/Apache-Flink-Install-Run-on-Multi-Node-Cluster-01.jpg","width":1200,"height":628,"caption":"Install & Run Apache Flink on Multi-node Cluster"},{"@type":"BreadcrumbList","@id":"https:\/\/data-flair.training\/blogs\/install-run-flink-multi-node-cluster\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Blog Home","item":"https:\/\/data-flair.training\/blogs\/"},{"@type":"ListItem","position":2,"name":"Apache Flink Tutorials","item":"https:\/\/data-flair.training\/blogs\/category\/flink\/"},{"@type":"ListItem","position":3,"name":"Install & Run Apache Flink on Multi-node Cluster"}]},{"@type":"WebSite","@id":"https:\/\/data-flair.training\/blogs\/#website","url":"https:\/\/data-flair.training\/blogs\/","name":"DataFlair","description":"Learn Today. Lead Tomorrow.","publisher":{"@id":"https:\/\/data-flair.training\/blogs\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/data-flair.training\/blogs\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/data-flair.training\/blogs\/#organization","name":"DataFlair","url":"https:\/\/data-flair.training\/blogs\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/data-flair.training\/blogs\/#\/schema\/logo\/image\/","url":"https:\/\/data-flair.training\/blogs\/wp-content\/uploads\/sites\/2\/2016\/07\/Data-Flair.png","contentUrl":"https:\/\/data-flair.training\/blogs\/wp-content\/uploads\/sites\/2\/2016\/07\/Data-Flair.png","width":106,"height":48,"caption":"DataFlair"},"image":{"@id":"https:\/\/data-flair.training\/blogs\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/DataFlairWS\/","https:\/\/x.com\/DataFlairWS","https:\/\/www.linkedin.com\/company\/dataflair-web-services-pvt-ltd\/","https:\/\/www.youtube.com\/user\/DataFlairWS"]},{"@type":"Person","@id":"https:\/\/data-flair.training\/blogs\/#\/schema\/person\/2c58ecb4f73a39f0ef993f1ddfcd7b89","name":"DataFlair Team","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/1ce4a0e3e542444fc73bbebf83e89e8b73e2d95ccb1fcee64da9945f078b97c5?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/1ce4a0e3e542444fc73bbebf83e89e8b73e2d95ccb1fcee64da9945f078b97c5?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/1ce4a0e3e542444fc73bbebf83e89e8b73e2d95ccb1fcee64da9945f078b97c5?s=96&d=mm&r=g","caption":"DataFlair Team"},"description":"The DataFlair Team provides industry-driven content on programming, Java, Python, C++, DSA, AI, ML, data Science, Android, Flutter, MERN, Web Development, and technology. Our expert educators focus on delivering value-packed, easy-to-follow resources for tech enthusiasts and professionals.","url":"https:\/\/data-flair.training\/blogs\/author\/dfteam2\/"}]}},"amp_enabled":true,"_links":{"self":[{"href":"https:\/\/data-flair.training\/blogs\/wp-json\/wp\/v2\/posts\/499","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/data-flair.training\/blogs\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/data-flair.training\/blogs\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/data-flair.training\/blogs\/wp-json\/wp\/v2\/users\/6"}],"replies":[{"embeddable":true,"href":"https:\/\/data-flair.training\/blogs\/wp-json\/wp\/v2\/comments?post=499"}],"version-history":[{"count":1,"href":"https:\/\/data-flair.training\/blogs\/wp-json\/wp\/v2\/posts\/499\/revisions"}],"predecessor-version":[{"id":94133,"href":"https:\/\/data-flair.training\/blogs\/wp-json\/wp\/v2\/posts\/499\/revisions\/94133"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/data-flair.training\/blogs\/wp-json\/wp\/v2\/media\/42893"}],"wp:attachment":[{"href":"https:\/\/data-flair.training\/blogs\/wp-json\/wp\/v2\/media?parent=499"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/data-flair.training\/blogs\/wp-json\/wp\/v2\/categories?post=499"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/data-flair.training\/blogs\/wp-json\/wp\/v2\/tags?post=499"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}