{"id":564,"date":"2016-07-26T11:35:53","date_gmt":"2016-07-26T11:35:53","guid":{"rendered":"http:\/\/data-flair.training\/blogs\/?p=564"},"modified":"2021-05-09T13:23:52","modified_gmt":"2021-05-09T07:53:52","slug":"apache-flink-wordcount-program","status":"publish","type":"post","link":"https:\/\/data-flair.training\/blogs\/apache-flink-wordcount-program\/","title":{"rendered":"Run Apache Flink Wordcount Program in Eclipse"},"content":{"rendered":"<p>In our previous guides, we discussed\u00a0how to install Apache Flink on ubuntu. In this tutorial, we will understand how to develop and run\u00a0Apache Flink\u00a0wordcount program in Java in eclipse.<\/p>\n<p>We can also use Scala language to write wordcount program in Apache Flink. To learn Scala get the best Scala Books from here.<\/p>\n<h2>Platform<\/h2>\n<ol>\n<li>Operating system: You can run the code in Windows \/ Mac \/ Linux<\/li>\n<li>Java 7.x or higher<\/li>\n<li>Eclipse &#8211; Latest version<\/li>\n<\/ol>\n<h2>Steps to make project<\/h2>\n<ol>\n<li>Make a new java project<\/li>\n<li>Add the following JAR in the build path. You can find the jar\u00a0files in the lib directory in Flink home:<br \/>\nflink-dist_2.11-1.0.3<br \/>\nflink-python_2.11-1.0.3<br \/>\nlog4j-1.2.17<br \/>\nslf4j-log4j12-1.7.7<\/li>\n<\/ol>\n<h2>Apache Flink Wordcount program<\/h2>\n<p>[php]<br \/>\nimport org.apache.flink.api.common.functions.FlatMapFunction;<br \/>\nimport org.apache.flink.api.java.DataSet;<br \/>\nimport org.apache.flink.api.java.ExecutionEnvironment;<br \/>\nimport org.apache.flink.api.java.tuple.Tuple2;<br \/>\nimport org.apache.flink.util.Collector;<br \/>\npublic class FlinkProgram {<br \/>\npublic static void main(String[] args) throws Exception {<br \/>\nfinal ExecutionEnvironment env = ExecutionEnvironment.getExecutionEnvironment();<br \/>\nDataSet&lt;String&gt; rawdata = env.readTextFile(&#8220;E:\\\\readme.txt&#8221;); \/\/change path with your filepath of text file<br \/>\nDataSet &lt;Tuple2&lt;String, Integer&gt;&gt; result = rawdata<br \/>\n.flatMap(new Splitter())<br \/>\n.groupBy(0)<br \/>\n.sum(1);<br \/>\n\/\/To print result we can call print method<br \/>\nresult.print();<br \/>\n}<br \/>\npublic static class Splitter implements FlatMapFunction&lt;String, Tuple2&lt;String, Integer&gt;&gt; {<br \/>\n@Override<br \/>\npublic void flatMap(String line, Collector&lt;Tuple2&lt;String, Integer&gt;&gt; out) {<br \/>\nfor (String wordToken : line.split(&#8221; &#8220;)) {<br \/>\nout.collect(new Tuple2&lt;String, Integer&gt;(wordToken, 1));<br \/>\n}<br \/>\n}<br \/>\n}<br \/>\n}<br \/>\n[\/php]<\/p>\n<p>The execution environment provides methods to control the job execution and to access the data from other Environment.<\/p>\n<p>DataSet represents the collection of elements of a specific type. The type can be String, Integer, Long and tuple like:<\/p>\n<pre class=\"EnlighterJSRAW\" data-enlighter-language=\"null\">&lt;Tuple2&lt;String, Integer&gt;&gt;<\/pre>\n<p>In this Apache Flink wordcount program, we are using FlatMap APIs. In the flatMap function, we can write our custom business logic. It takes one element as an input and produces zero, one or more elements.<\/p>\n<p>We have seen the practical implementation of Wordcount program in Apache Flink using eclipse IDE. You can run this program directly in eclipse using run option. You can also refer this link to understand What is Apache Flink?<\/p>\n<h2>Conclusion<\/h2>\n<p>Hence, in this Apache Flink tutorial, we have discussed the Apache Flink Wordcount program. Moreover, we saw the steps and platform to make the project. Still, if you have any problem in running the Apache Flink Wordcount Program, ask in the comment tab.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>In our previous guides, we discussed\u00a0how to install Apache Flink on ubuntu. In this tutorial, we will understand how to develop and run\u00a0Apache Flink\u00a0wordcount program in Java in eclipse. We can also use Scala&#46;&#46;&#46;<\/p>\n","protected":false},"author":6,"featured_media":34406,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[8],"tags":[750,4740,4758,4770,4772,4773,4777,4788,4789,4794,16585,16586],"class_list":["post-564","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-flink","tag-apache-flink","tag-flink-application","tag-flink-eclipse","tag-flink-java","tag-flink-linux","tag-flink-mac","tag-flink-program","tag-flink-training","tag-flink-tutorial","tag-flink-windows","tag-flink-wordcount","tag-flink-wordcount-example"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.4 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Run Apache Flink Wordcount Program in Eclipse - DataFlair<\/title>\n<meta name=\"description\" content=\"Apache Flink-4G of Big Data. Learn Flink installation and how to run Apache Flink wordcount program in Java to understand Flink programming and learn Flink.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/data-flair.training\/blogs\/apache-flink-wordcount-program\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Run Apache Flink Wordcount Program in Eclipse - DataFlair\" \/>\n<meta property=\"og:description\" content=\"Apache Flink-4G of Big Data. Learn Flink installation and how to run Apache Flink wordcount program in Java to understand Flink programming and learn Flink.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/data-flair.training\/blogs\/apache-flink-wordcount-program\/\" \/>\n<meta property=\"og:site_name\" content=\"DataFlair\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/DataFlairWS\/\" \/>\n<meta property=\"article:published_time\" content=\"2016-07-26T11:35:53+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2021-05-09T07:53:52+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/data-flair.training\/blogs\/wp-content\/uploads\/sites\/2\/2016\/07\/Run-Apache-Flink-Wordcount-Program-in-Eclipse.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1200\" \/>\n\t<meta property=\"og:image:height\" content=\"628\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"DataFlair Team\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@DataFlairWS\" \/>\n<meta name=\"twitter:site\" content=\"@DataFlairWS\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"DataFlair Team\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Run Apache Flink Wordcount Program in Eclipse - DataFlair","description":"Apache Flink-4G of Big Data. Learn Flink installation and how to run Apache Flink wordcount program in Java to understand Flink programming and learn Flink.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/data-flair.training\/blogs\/apache-flink-wordcount-program\/","og_locale":"en_US","og_type":"article","og_title":"Run Apache Flink Wordcount Program in Eclipse - DataFlair","og_description":"Apache Flink-4G of Big Data. Learn Flink installation and how to run Apache Flink wordcount program in Java to understand Flink programming and learn Flink.","og_url":"https:\/\/data-flair.training\/blogs\/apache-flink-wordcount-program\/","og_site_name":"DataFlair","article_publisher":"https:\/\/www.facebook.com\/DataFlairWS\/","article_published_time":"2016-07-26T11:35:53+00:00","article_modified_time":"2021-05-09T07:53:52+00:00","og_image":[{"width":1200,"height":628,"url":"https:\/\/data-flair.training\/blogs\/wp-content\/uploads\/sites\/2\/2016\/07\/Run-Apache-Flink-Wordcount-Program-in-Eclipse.jpg","type":"image\/jpeg"}],"author":"DataFlair Team","twitter_card":"summary_large_image","twitter_creator":"@DataFlairWS","twitter_site":"@DataFlairWS","twitter_misc":{"Written by":"DataFlair Team","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/data-flair.training\/blogs\/apache-flink-wordcount-program\/#article","isPartOf":{"@id":"https:\/\/data-flair.training\/blogs\/apache-flink-wordcount-program\/"},"author":{"name":"DataFlair Team","@id":"https:\/\/data-flair.training\/blogs\/#\/schema\/person\/2c58ecb4f73a39f0ef993f1ddfcd7b89"},"headline":"Run Apache Flink Wordcount Program in Eclipse","datePublished":"2016-07-26T11:35:53+00:00","dateModified":"2021-05-09T07:53:52+00:00","mainEntityOfPage":{"@id":"https:\/\/data-flair.training\/blogs\/apache-flink-wordcount-program\/"},"wordCount":422,"commentCount":1,"publisher":{"@id":"https:\/\/data-flair.training\/blogs\/#organization"},"image":{"@id":"https:\/\/data-flair.training\/blogs\/apache-flink-wordcount-program\/#primaryimage"},"thumbnailUrl":"https:\/\/data-flair.training\/blogs\/wp-content\/uploads\/sites\/2\/2016\/07\/Run-Apache-Flink-Wordcount-Program-in-Eclipse.jpg","keywords":["apache flink","flink application","flink eclipse","flink java","flink linux","flink mac","flink program","flink training","flink tutorial","flink windows","Flink WordCount","Flink Wordcount Example"],"articleSection":["Apache Flink Tutorials"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/data-flair.training\/blogs\/apache-flink-wordcount-program\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/data-flair.training\/blogs\/apache-flink-wordcount-program\/","url":"https:\/\/data-flair.training\/blogs\/apache-flink-wordcount-program\/","name":"Run Apache Flink Wordcount Program in Eclipse - DataFlair","isPartOf":{"@id":"https:\/\/data-flair.training\/blogs\/#website"},"primaryImageOfPage":{"@id":"https:\/\/data-flair.training\/blogs\/apache-flink-wordcount-program\/#primaryimage"},"image":{"@id":"https:\/\/data-flair.training\/blogs\/apache-flink-wordcount-program\/#primaryimage"},"thumbnailUrl":"https:\/\/data-flair.training\/blogs\/wp-content\/uploads\/sites\/2\/2016\/07\/Run-Apache-Flink-Wordcount-Program-in-Eclipse.jpg","datePublished":"2016-07-26T11:35:53+00:00","dateModified":"2021-05-09T07:53:52+00:00","description":"Apache Flink-4G of Big Data. Learn Flink installation and how to run Apache Flink wordcount program in Java to understand Flink programming and learn Flink.","breadcrumb":{"@id":"https:\/\/data-flair.training\/blogs\/apache-flink-wordcount-program\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/data-flair.training\/blogs\/apache-flink-wordcount-program\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/data-flair.training\/blogs\/apache-flink-wordcount-program\/#primaryimage","url":"https:\/\/data-flair.training\/blogs\/wp-content\/uploads\/sites\/2\/2016\/07\/Run-Apache-Flink-Wordcount-Program-in-Eclipse.jpg","contentUrl":"https:\/\/data-flair.training\/blogs\/wp-content\/uploads\/sites\/2\/2016\/07\/Run-Apache-Flink-Wordcount-Program-in-Eclipse.jpg","width":1200,"height":628,"caption":"Run Apache Flink Wordcount Program in Eclipse"},{"@type":"BreadcrumbList","@id":"https:\/\/data-flair.training\/blogs\/apache-flink-wordcount-program\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Blog Home","item":"https:\/\/data-flair.training\/blogs\/"},{"@type":"ListItem","position":2,"name":"Apache Flink Tutorials","item":"https:\/\/data-flair.training\/blogs\/category\/flink\/"},{"@type":"ListItem","position":3,"name":"Run Apache Flink Wordcount Program in Eclipse"}]},{"@type":"WebSite","@id":"https:\/\/data-flair.training\/blogs\/#website","url":"https:\/\/data-flair.training\/blogs\/","name":"DataFlair","description":"Learn Today. Lead Tomorrow.","publisher":{"@id":"https:\/\/data-flair.training\/blogs\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/data-flair.training\/blogs\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/data-flair.training\/blogs\/#organization","name":"DataFlair","url":"https:\/\/data-flair.training\/blogs\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/data-flair.training\/blogs\/#\/schema\/logo\/image\/","url":"https:\/\/data-flair.training\/blogs\/wp-content\/uploads\/sites\/2\/2016\/07\/Data-Flair.png","contentUrl":"https:\/\/data-flair.training\/blogs\/wp-content\/uploads\/sites\/2\/2016\/07\/Data-Flair.png","width":106,"height":48,"caption":"DataFlair"},"image":{"@id":"https:\/\/data-flair.training\/blogs\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/DataFlairWS\/","https:\/\/x.com\/DataFlairWS","https:\/\/www.linkedin.com\/company\/dataflair-web-services-pvt-ltd\/","https:\/\/www.youtube.com\/user\/DataFlairWS"]},{"@type":"Person","@id":"https:\/\/data-flair.training\/blogs\/#\/schema\/person\/2c58ecb4f73a39f0ef993f1ddfcd7b89","name":"DataFlair Team","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/1ce4a0e3e542444fc73bbebf83e89e8b73e2d95ccb1fcee64da9945f078b97c5?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/1ce4a0e3e542444fc73bbebf83e89e8b73e2d95ccb1fcee64da9945f078b97c5?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/1ce4a0e3e542444fc73bbebf83e89e8b73e2d95ccb1fcee64da9945f078b97c5?s=96&d=mm&r=g","caption":"DataFlair Team"},"description":"The DataFlair Team provides industry-driven content on programming, Java, Python, C++, DSA, AI, ML, data Science, Android, Flutter, MERN, Web Development, and technology. Our expert educators focus on delivering value-packed, easy-to-follow resources for tech enthusiasts and professionals.","url":"https:\/\/data-flair.training\/blogs\/author\/dfteam2\/"}]}},"amp_enabled":true,"_links":{"self":[{"href":"https:\/\/data-flair.training\/blogs\/wp-json\/wp\/v2\/posts\/564","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/data-flair.training\/blogs\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/data-flair.training\/blogs\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/data-flair.training\/blogs\/wp-json\/wp\/v2\/users\/6"}],"replies":[{"embeddable":true,"href":"https:\/\/data-flair.training\/blogs\/wp-json\/wp\/v2\/comments?post=564"}],"version-history":[{"count":1,"href":"https:\/\/data-flair.training\/blogs\/wp-json\/wp\/v2\/posts\/564\/revisions"}],"predecessor-version":[{"id":94131,"href":"https:\/\/data-flair.training\/blogs\/wp-json\/wp\/v2\/posts\/564\/revisions\/94131"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/data-flair.training\/blogs\/wp-json\/wp\/v2\/media\/34406"}],"wp:attachment":[{"href":"https:\/\/data-flair.training\/blogs\/wp-json\/wp\/v2\/media?parent=564"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/data-flair.training\/blogs\/wp-json\/wp\/v2\/categories?post=564"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/data-flair.training\/blogs\/wp-json\/wp\/v2\/tags?post=564"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}