

{"id":1644,"date":"2017-02-19T12:54:25","date_gmt":"2017-02-19T12:54:25","guid":{"rendered":"http:\/\/data-flair.training\/blogs\/?p=1644"},"modified":"2018-12-17T11:43:25","modified_gmt":"2018-12-17T06:13:25","slug":"apache-spark-terminologies-concepts-you-must-know","status":"publish","type":"post","link":"https:\/\/data-flair.training\/blogs\/apache-spark-terminologies-concepts-you-must-know\/","title":{"rendered":"Apache Spark Terminologies and Concepts You Must Know"},"content":{"rendered":"<h2>1. Objective<\/h2>\n<p>Here you will learn some of the important Apache Spark Terminologies and Apache Spark Key terms that are being used in the\u00a0Spark industry. It will help you in learning <a href=\"http:\/\/data-flair.training\/blogs\/apache-spark-introduction-comprehensive-tutorial-guide-beginners\/\">what is Apache Spark<\/a>, what does spark engine do, partition in Apache Spark, what does MLlib do, worker node in Spark, <a href=\"http:\/\/data-flair.training\/blogs\/introduction-to-apache-spark-sql-tutorial\/\">Spark SQL<\/a> and <a href=\"http:\/\/data-flair.training\/blogs\/resilient-distributed-datasets-rdd-apache-spark\/\">Pair RDD<\/a> definition, what is lazy evaluation in Spark, Spark Driver and Action in Spark.<\/p>\n<div id=\"attachment_43115\" style=\"width: 1210px\" class=\"wp-caption aligncenter\"><a href=\"https:\/\/data-flair.training\/blogs\/wp-content\/uploads\/sites\/2\/2017\/02\/Spark-Terminologies-Flash-Cards-01.jpg\"><img loading=\"lazy\" decoding=\"async\" aria-describedby=\"caption-attachment-43115\" class=\"size-full wp-image-43115\" src=\"https:\/\/data-flair.training\/blogs\/wp-content\/uploads\/sites\/2\/2017\/02\/Spark-Terminologies-Flash-Cards-01.jpg\" alt=\"Apache Spark Terminologies and Concepts You Must Know\" width=\"1200\" height=\"628\" srcset=\"https:\/\/data-flair.training\/blogs\/wp-content\/uploads\/sites\/2\/2017\/02\/Spark-Terminologies-Flash-Cards-01.jpg 1200w, https:\/\/data-flair.training\/blogs\/wp-content\/uploads\/sites\/2\/2017\/02\/Spark-Terminologies-Flash-Cards-01-150x79.jpg 150w, https:\/\/data-flair.training\/blogs\/wp-content\/uploads\/sites\/2\/2017\/02\/Spark-Terminologies-Flash-Cards-01-300x157.jpg 300w, https:\/\/data-flair.training\/blogs\/wp-content\/uploads\/sites\/2\/2017\/02\/Spark-Terminologies-Flash-Cards-01-768x402.jpg 768w, https:\/\/data-flair.training\/blogs\/wp-content\/uploads\/sites\/2\/2017\/02\/Spark-Terminologies-Flash-Cards-01-1024x536.jpg 1024w, https:\/\/data-flair.training\/blogs\/wp-content\/uploads\/sites\/2\/2017\/02\/Spark-Terminologies-Flash-Cards-01-520x272.jpg 520w\" sizes=\"auto, (max-width: 1200px) 100vw, 1200px\" \/><\/a><p id=\"caption-attachment-43115\" class=\"wp-caption-text\">Apache Spark Terminologies and Concepts You Must Know<\/p><\/div>\n<h2>2. Introduction to Apache Spark\u00a0Terminologies<\/h2>\n<p>Before we start with testing the knowledge, let us revise our <a href=\"http:\/\/data-flair.training\/blogs\/introduction-spark-tutorial-quickstart\/\">Spark key concepts<\/a> and understand <a href=\"http:\/\/data-flair.training\/blogs\/comparison-between-apache-spark-vs-hadoop-mapreduce\/\">how Apache Spark is better than<\/a>\u00a0<a href=\"http:\/\/data-flair.training\/blogs\/comparison-between-apache-spark-vs-hadoop-mapreduce\/\">Hadoop MapReduce<\/a> in terms of usage and performance.<br \/>\nNow here you go!!!!<br \/>\n<img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-40332\" src=\"https:\/\/data-flair.training\/blogs\/wp-content\/uploads\/sites\/2\/2017\/08\/under-construction.gif\" alt=\"under construction\" width=\"243\" height=\"125\" \/><\/p>\n","protected":false},"excerpt":{"rendered":"<p>1. Objective Here you will learn some of the important Apache Spark Terminologies and Apache Spark Key terms that are being used in the\u00a0Spark industry. It will help you in learning what is Apache&#46;&#46;&#46;<\/p>\n","protected":false},"author":6,"featured_media":43115,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[10],"tags":[910,931,956,957],"class_list":["post-1644","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-spark","tag-apache-spark-definitions","tag-apache-spark-key-terms","tag-apache-spark-terminologies","tag-apache-spark-terms"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v28.0 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Apache Spark Terminologies and Concepts You Must Know - DataFlair<\/title>\n<meta name=\"description\" content=\"Apache Spark Key terms &amp; terminologies-Spark engine,Spark MLlib,Spark SQL, Spark Driver,Spark Lazy evaluation,Spark action,Spark partition,Spark worker node\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/data-flair.training\/blogs\/apache-spark-terminologies-concepts-you-must-know\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Apache Spark Terminologies and Concepts You Must Know - DataFlair\" \/>\n<meta property=\"og:description\" content=\"Apache Spark Key terms &amp; terminologies-Spark engine,Spark MLlib,Spark SQL, Spark Driver,Spark Lazy evaluation,Spark action,Spark partition,Spark worker node\" \/>\n<meta property=\"og:url\" content=\"https:\/\/data-flair.training\/blogs\/apache-spark-terminologies-concepts-you-must-know\/\" \/>\n<meta property=\"og:site_name\" content=\"DataFlair\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/DataFlairWS\/\" \/>\n<meta property=\"article:published_time\" content=\"2017-02-19T12:54:25+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2018-12-17T06:13:25+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/data-flair.training\/blogs\/wp-content\/uploads\/sites\/2\/2017\/02\/Spark-Terminologies-Flash-Cards-01.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1200\" \/>\n\t<meta property=\"og:image:height\" content=\"628\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"DataFlair Team\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@DataFlairWS\" \/>\n<meta name=\"twitter:site\" content=\"@DataFlairWS\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"DataFlair Team\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"1 minute\" \/>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Apache Spark Terminologies and Concepts You Must Know - DataFlair","description":"Apache Spark Key terms & terminologies-Spark engine,Spark MLlib,Spark SQL, Spark Driver,Spark Lazy evaluation,Spark action,Spark partition,Spark worker node","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/data-flair.training\/blogs\/apache-spark-terminologies-concepts-you-must-know\/","og_locale":"en_US","og_type":"article","og_title":"Apache Spark Terminologies and Concepts You Must Know - DataFlair","og_description":"Apache Spark Key terms & terminologies-Spark engine,Spark MLlib,Spark SQL, Spark Driver,Spark Lazy evaluation,Spark action,Spark partition,Spark worker node","og_url":"https:\/\/data-flair.training\/blogs\/apache-spark-terminologies-concepts-you-must-know\/","og_site_name":"DataFlair","article_publisher":"https:\/\/www.facebook.com\/DataFlairWS\/","article_published_time":"2017-02-19T12:54:25+00:00","article_modified_time":"2018-12-17T06:13:25+00:00","og_image":[{"width":1200,"height":628,"url":"https:\/\/data-flair.training\/blogs\/wp-content\/uploads\/sites\/2\/2017\/02\/Spark-Terminologies-Flash-Cards-01.jpg","type":"image\/jpeg"}],"author":"DataFlair Team","twitter_card":"summary_large_image","twitter_creator":"@DataFlairWS","twitter_site":"@DataFlairWS","twitter_misc":{"Written by":"DataFlair Team","Est. reading time":"1 minute"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/data-flair.training\/blogs\/apache-spark-terminologies-concepts-you-must-know\/#article","isPartOf":{"@id":"https:\/\/data-flair.training\/blogs\/apache-spark-terminologies-concepts-you-must-know\/"},"author":{"name":"DataFlair Team","@id":"https:\/\/data-flair.training\/blogs\/#\/schema\/person\/2c58ecb4f73a39f0ef993f1ddfcd7b89"},"headline":"Apache Spark Terminologies and Concepts You Must Know","datePublished":"2017-02-19T12:54:25+00:00","dateModified":"2018-12-17T06:13:25+00:00","mainEntityOfPage":{"@id":"https:\/\/data-flair.training\/blogs\/apache-spark-terminologies-concepts-you-must-know\/"},"wordCount":132,"commentCount":1,"publisher":{"@id":"https:\/\/data-flair.training\/blogs\/#organization"},"image":{"@id":"https:\/\/data-flair.training\/blogs\/apache-spark-terminologies-concepts-you-must-know\/#primaryimage"},"thumbnailUrl":"https:\/\/data-flair.training\/blogs\/wp-content\/uploads\/sites\/2\/2017\/02\/Spark-Terminologies-Flash-Cards-01.jpg","keywords":["apache spark definitions","apache spark key terms","apache spark terminologies","apache spark terms"],"articleSection":["Apache Spark Tutorials"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/data-flair.training\/blogs\/apache-spark-terminologies-concepts-you-must-know\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/data-flair.training\/blogs\/apache-spark-terminologies-concepts-you-must-know\/","url":"https:\/\/data-flair.training\/blogs\/apache-spark-terminologies-concepts-you-must-know\/","name":"Apache Spark Terminologies and Concepts You Must Know - DataFlair","isPartOf":{"@id":"https:\/\/data-flair.training\/blogs\/#website"},"primaryImageOfPage":{"@id":"https:\/\/data-flair.training\/blogs\/apache-spark-terminologies-concepts-you-must-know\/#primaryimage"},"image":{"@id":"https:\/\/data-flair.training\/blogs\/apache-spark-terminologies-concepts-you-must-know\/#primaryimage"},"thumbnailUrl":"https:\/\/data-flair.training\/blogs\/wp-content\/uploads\/sites\/2\/2017\/02\/Spark-Terminologies-Flash-Cards-01.jpg","datePublished":"2017-02-19T12:54:25+00:00","dateModified":"2018-12-17T06:13:25+00:00","description":"Apache Spark Key terms & terminologies-Spark engine,Spark MLlib,Spark SQL, Spark Driver,Spark Lazy evaluation,Spark action,Spark partition,Spark worker node","breadcrumb":{"@id":"https:\/\/data-flair.training\/blogs\/apache-spark-terminologies-concepts-you-must-know\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/data-flair.training\/blogs\/apache-spark-terminologies-concepts-you-must-know\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/data-flair.training\/blogs\/apache-spark-terminologies-concepts-you-must-know\/#primaryimage","url":"https:\/\/data-flair.training\/blogs\/wp-content\/uploads\/sites\/2\/2017\/02\/Spark-Terminologies-Flash-Cards-01.jpg","contentUrl":"https:\/\/data-flair.training\/blogs\/wp-content\/uploads\/sites\/2\/2017\/02\/Spark-Terminologies-Flash-Cards-01.jpg","width":1200,"height":628,"caption":"Apache Spark Terminologies and Concepts You Must Know"},{"@type":"BreadcrumbList","@id":"https:\/\/data-flair.training\/blogs\/apache-spark-terminologies-concepts-you-must-know\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Blog Home","item":"https:\/\/data-flair.training\/blogs\/"},{"@type":"ListItem","position":2,"name":"Apache Spark Tutorials","item":"https:\/\/data-flair.training\/blogs\/category\/spark\/"},{"@type":"ListItem","position":3,"name":"Apache Spark Terminologies and Concepts You Must Know"}]},{"@type":"WebSite","@id":"https:\/\/data-flair.training\/blogs\/#website","url":"https:\/\/data-flair.training\/blogs\/","name":"DataFlair","description":"Learn Today. Lead Tomorrow.","publisher":{"@id":"https:\/\/data-flair.training\/blogs\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/data-flair.training\/blogs\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/data-flair.training\/blogs\/#organization","name":"DataFlair","url":"https:\/\/data-flair.training\/blogs\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/data-flair.training\/blogs\/#\/schema\/logo\/image\/","url":"https:\/\/data-flair.training\/blogs\/wp-content\/uploads\/sites\/2\/2016\/07\/Data-Flair.png","contentUrl":"https:\/\/data-flair.training\/blogs\/wp-content\/uploads\/sites\/2\/2016\/07\/Data-Flair.png","width":106,"height":48,"caption":"DataFlair"},"image":{"@id":"https:\/\/data-flair.training\/blogs\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/DataFlairWS\/","https:\/\/x.com\/DataFlairWS","https:\/\/www.linkedin.com\/company\/dataflair-web-services-pvt-ltd\/","https:\/\/www.youtube.com\/user\/DataFlairWS"]},{"@type":"Person","@id":"https:\/\/data-flair.training\/blogs\/#\/schema\/person\/2c58ecb4f73a39f0ef993f1ddfcd7b89","name":"DataFlair Team","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/1ce4a0e3e542444fc73bbebf83e89e8b73e2d95ccb1fcee64da9945f078b97c5?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/1ce4a0e3e542444fc73bbebf83e89e8b73e2d95ccb1fcee64da9945f078b97c5?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/1ce4a0e3e542444fc73bbebf83e89e8b73e2d95ccb1fcee64da9945f078b97c5?s=96&d=mm&r=g","caption":"DataFlair Team"},"description":"The DataFlair Team provides industry-driven content on programming, Java, Python, C++, DSA, AI, ML, data Science, Android, Flutter, MERN, Web Development, and technology. Our expert educators focus on delivering value-packed, easy-to-follow resources for tech enthusiasts and professionals.","url":"https:\/\/data-flair.training\/blogs\/author\/dfteam2\/"}]}},"amp_enabled":true,"_links":{"self":[{"href":"https:\/\/data-flair.training\/blogs\/wp-json\/wp\/v2\/posts\/1644","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/data-flair.training\/blogs\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/data-flair.training\/blogs\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/data-flair.training\/blogs\/wp-json\/wp\/v2\/users\/6"}],"replies":[{"embeddable":true,"href":"https:\/\/data-flair.training\/blogs\/wp-json\/wp\/v2\/comments?post=1644"}],"version-history":[{"count":7,"href":"https:\/\/data-flair.training\/blogs\/wp-json\/wp\/v2\/posts\/1644\/revisions"}],"predecessor-version":[{"id":45798,"href":"https:\/\/data-flair.training\/blogs\/wp-json\/wp\/v2\/posts\/1644\/revisions\/45798"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/data-flair.training\/blogs\/wp-json\/wp\/v2\/media\/43115"}],"wp:attachment":[{"href":"https:\/\/data-flair.training\/blogs\/wp-json\/wp\/v2\/media?parent=1644"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/data-flair.training\/blogs\/wp-json\/wp\/v2\/categories?post=1644"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/data-flair.training\/blogs\/wp-json\/wp\/v2\/tags?post=1644"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}