{"id":5557,"date":"2018-01-19T11:45:59","date_gmt":"2018-01-19T11:45:59","guid":{"rendered":"https:\/\/data-flair.training\/blogs\/?p=5557"},"modified":"2018-09-17T16:01:17","modified_gmt":"2018-09-17T10:31:17","slug":"apache-spark-graphx-features","status":"publish","type":"post","link":"https:\/\/data-flair.training\/blogs\/apache-spark-graphx-features\/","title":{"rendered":"Spark GraphX Features – An Introductory Guide"},"content":{"rendered":"

1. Objective<\/h2>\n

There are several features of Spark GraphX which enhances its qualities. Hence, in this blog, we will learn GraphX features in Apache Spark<\/strong><\/a>. Before Spark GraphX features, we will start with the brief introduction of GraphX. Afterward, we will learn all features in detail.<\/span><\/p>\n

So, let’s start to spark GraphX features in detail.<\/p>\n

\"Spark<\/a>

Spark GraphX Features – An Introductory Guide<\/p><\/div>\n

2. What is Spark GraphX?<\/h2>\n

For graphs and graph-parallel computation, we have <\/span>GraphX<\/span><\/i><\/a> API in Spark. It leverages an advantage of growing collection of graph algorithms. \u00a0Also includes Graph builders to simplify graph analytics tasks.<\/span>
\nBasically, it extends the Spark RDD<\/strong><\/a> with a Resilient Distributed Property Graph. In addition, the property graph is a directed multigraph. It has multiple edges in parallel. Here, every vertex and edge have user-defined properties associated with it. Moreover, parallel edges allow multiple relationships between the same vertices.<\/span><\/p>\n

3. Spark GraphX Features<\/h2>\n

The features of Spark GraphX \u00a0are as follows:<\/span><\/p>\n

a. Flexibility<\/h3>\n

We can work with both graphs and computations with Spark GraphX. It includes exploratory analysis, ETL (Extract, Transform & Load), as well as iterative graph. It is possible to view the same data as both graphs, collections, transform and join graphs with RDDs. Also using the Pregel API it is possible to write custom iterative graph algorithms.<\/span><\/p>\n

b. Speed<\/h3>\n

Speed is one of the best features of GraphX. It provides comparable performance to the fastest specialized graph processing systems. It is fastest on comparing with the other graph systems. Even while retaining Spark\u2019s flexibility, fault tolerance and ease of use.<\/p>\n

You must read\u00a0SparkR DataFrame and DataFrame Operations<\/a><\/strong><\/p>\n

c. Growing Algorithm Library<\/h3>\n

Basically,\u00a0we have a growing library of graph algorithms that Spark GraphX offers. We can choose from it. Some of the popular algorithms such as \u00a0PageRank, connected components, label propagation. Also includes SVD++, strongly<\/span> connected components, and triangle count. Let\u2019s learn them in detail:<\/span><\/p>\n

i. PageRank Algorithm<\/h4>\n

To measure the\u00a0importance of each vertex in a graph we use\u00a0PageRank. Basically<\/span>, it measures by assuming an edge from u to v represents an endorsement of v\u2019s importance by u.<\/span> We can understand this with a \u00a0scenario. For example, if a \u00a0person uses Twitter, and have many followers, then that user will have\u00a0the high rank.<\/p>\n

ii. Connected components Algorithm<\/h4>\n

Basically, this algorithm helps to label each connected component of the graph. Hence, it labels with the ID of its lowest-numbered vertex.<\/span><\/p>\n

iii. Label propagation Algorithm<\/h4>\n

It is a semi-supervised algorithm that assigns labels to previously<\/span> unlabeled data points.<\/span> That is what we call as Label Propagation. Initially<\/span>, a (generally small) subset of the data points has labels. Afterwards, those labels propagate to further unlabeled points throughout the algorithm.<\/p>\n

Have a look at\u00a0Apache Spark featurization<\/a><\/strong><\/p>\n

iv. SVD++<\/h4>\n

Singular refers to Singular value decomposition. It takes a rectangular matrix of gene expression data in which the n rows represent the genes while p columns represent the experimental conditions<\/span><\/p>\n

v. Strongly connected components<\/h4>\n

If there is a path between all pairs of vertices, a directed graph is strongly connected. That strongly connected component (SCC) of a directed graph is a maximal strongly connected subgraph.<\/span><\/p>\n

vi. Triangle count<\/h4>\n

When it has two adjacent vertices with an edge between them, it is a vertex as part of a triangle. Basically, in the TriangleCount object GraphX implements a triangle counting algorithm. Moreover, that helps to determine the number of triangles passing through each vertex. Also, provides a measure of clustering.<\/span><\/p>\n

You must read about\u00a0Spark paired RDD<\/a><\/strong><\/p>\n

d. Community<\/h3>\n

As part of the Apache Spark project, GraphX is also developed.\u00a0Hence it gets tested and updated with each Spark release.<\/p>\n

4. Conclusion<\/h2>\n

As a result, we have learned all the Apache Spark GraphX features. We have also seen how these features enhance the uses of GraphX. Although, if you fell any query regarding, ask freely in the comment section.<\/p>\n

See also –\u00a0<\/strong><\/p>\n

GraphX API in Apache Spark<\/a><\/strong><\/p>\n

Reference for Spark<\/a><\/strong>

1. Objective There are several features of Spark GraphX which enhances its qualities. Hence, in this blog, we will learn GraphX features in Apache Spark. Before Spark GraphX features, we will start with the...<\/p>\n","protected":false},"author":6,"featured_media":34382,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[10],"tags":[339,924,4594,5154,5155],"class_list":["post-5557","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-spark","tag-advantages-of-graphx","tag-apache-spark-graphx-features","tag-features-of-graphx-apache-spark","tag-graphx-features","tag-graphx-features-in-apache-spark"],"yoast_head":"\nSpark GraphX Features - An Introductory Guide - DataFlair<\/title>\n<meta name=\"description\" content=\"In this blog, we will learn all GraphX features in Apache Spark. Before Features, we will start with the brief introduction of GraphX.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/data-flair.training\/blogs\/apache-spark-graphx-features\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Spark GraphX Features - An Introductory Guide - DataFlair\" \/>\n<meta property=\"og:description\" content=\"In this blog, we will learn all GraphX features in Apache Spark. Before Features, we will start with the brief introduction of GraphX.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/data-flair.training\/blogs\/apache-spark-graphx-features\/\" \/>\n<meta property=\"og:site_name\" content=\"DataFlair\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/DataFlairWS\/\" \/>\n<meta property=\"article:published_time\" content=\"2018-01-19T11:45:59+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2018-09-17T10:31:17+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/data-flair.training\/blogs\/wp-content\/uploads\/sites\/2\/2018\/01\/Features-of-GraphX-Spark-01.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"802\" \/>\n\t<meta property=\"og:image:height\" content=\"420\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"DataFlair Team\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@DataFlairWS\" \/>\n<meta name=\"twitter:site\" content=\"@DataFlairWS\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"DataFlair Team\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Spark GraphX Features - An Introductory Guide - DataFlair","description":"In this blog, we will learn all GraphX features in Apache Spark. Before Features, we will start with the brief introduction of GraphX.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/data-flair.training\/blogs\/apache-spark-graphx-features\/","og_locale":"en_US","og_type":"article","og_title":"Spark GraphX Features - An Introductory Guide - DataFlair","og_description":"In this blog, we will learn all GraphX features in Apache Spark. Before Features, we will start with the brief introduction of GraphX.","og_url":"https:\/\/data-flair.training\/blogs\/apache-spark-graphx-features\/","og_site_name":"DataFlair","article_publisher":"https:\/\/www.facebook.com\/DataFlairWS\/","article_published_time":"2018-01-19T11:45:59+00:00","article_modified_time":"2018-09-17T10:31:17+00:00","og_image":[{"width":802,"height":420,"url":"https:\/\/data-flair.training\/blogs\/wp-content\/uploads\/sites\/2\/2018\/01\/Features-of-GraphX-Spark-01.jpg","type":"image\/jpeg"}],"author":"DataFlair Team","twitter_card":"summary_large_image","twitter_creator":"@DataFlairWS","twitter_site":"@DataFlairWS","twitter_misc":{"Written by":"DataFlair Team","Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/data-flair.training\/blogs\/apache-spark-graphx-features\/#article","isPartOf":{"@id":"https:\/\/data-flair.training\/blogs\/apache-spark-graphx-features\/"},"author":{"name":"DataFlair Team","@id":"https:\/\/data-flair.training\/blogs\/#\/schema\/person\/2c58ecb4f73a39f0ef993f1ddfcd7b89"},"headline":"Spark GraphX Features – An Introductory Guide","datePublished":"2018-01-19T11:45:59+00:00","dateModified":"2018-09-17T10:31:17+00:00","mainEntityOfPage":{"@id":"https:\/\/data-flair.training\/blogs\/apache-spark-graphx-features\/"},"wordCount":670,"commentCount":0,"publisher":{"@id":"https:\/\/data-flair.training\/blogs\/#organization"},"image":{"@id":"https:\/\/data-flair.training\/blogs\/apache-spark-graphx-features\/#primaryimage"},"thumbnailUrl":"https:\/\/data-flair.training\/blogs\/wp-content\/uploads\/sites\/2\/2018\/01\/Features-of-GraphX-Spark-01.jpg","keywords":["advantages of GraphX","Apache Spark GraphX features","features of GraphX Apache Spark","GraphX features","GraphX features in Apache Spark"],"articleSection":["Apache Spark Tutorials"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/data-flair.training\/blogs\/apache-spark-graphx-features\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/data-flair.training\/blogs\/apache-spark-graphx-features\/","url":"https:\/\/data-flair.training\/blogs\/apache-spark-graphx-features\/","name":"Spark GraphX Features - An Introductory Guide - DataFlair","isPartOf":{"@id":"https:\/\/data-flair.training\/blogs\/#website"},"primaryImageOfPage":{"@id":"https:\/\/data-flair.training\/blogs\/apache-spark-graphx-features\/#primaryimage"},"image":{"@id":"https:\/\/data-flair.training\/blogs\/apache-spark-graphx-features\/#primaryimage"},"thumbnailUrl":"https:\/\/data-flair.training\/blogs\/wp-content\/uploads\/sites\/2\/2018\/01\/Features-of-GraphX-Spark-01.jpg","datePublished":"2018-01-19T11:45:59+00:00","dateModified":"2018-09-17T10:31:17+00:00","description":"In this blog, we will learn all GraphX features in Apache Spark. Before Features, we will start with the brief introduction of GraphX.","breadcrumb":{"@id":"https:\/\/data-flair.training\/blogs\/apache-spark-graphx-features\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/data-flair.training\/blogs\/apache-spark-graphx-features\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/data-flair.training\/blogs\/apache-spark-graphx-features\/#primaryimage","url":"https:\/\/data-flair.training\/blogs\/wp-content\/uploads\/sites\/2\/2018\/01\/Features-of-GraphX-Spark-01.jpg","contentUrl":"https:\/\/data-flair.training\/blogs\/wp-content\/uploads\/sites\/2\/2018\/01\/Features-of-GraphX-Spark-01.jpg","width":802,"height":420,"caption":"Spark GraphX Features - An Introductory Guide"},{"@type":"BreadcrumbList","@id":"https:\/\/data-flair.training\/blogs\/apache-spark-graphx-features\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Blog Home","item":"https:\/\/data-flair.training\/blogs\/"},{"@type":"ListItem","position":2,"name":"Apache Spark Tutorials","item":"https:\/\/data-flair.training\/blogs\/category\/spark\/"},{"@type":"ListItem","position":3,"name":"Spark GraphX Features – An Introductory Guide"}]},{"@type":"WebSite","@id":"https:\/\/data-flair.training\/blogs\/#website","url":"https:\/\/data-flair.training\/blogs\/","name":"DataFlair","description":"Learn Today. Lead Tomorrow.","publisher":{"@id":"https:\/\/data-flair.training\/blogs\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/data-flair.training\/blogs\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/data-flair.training\/blogs\/#organization","name":"DataFlair","url":"https:\/\/data-flair.training\/blogs\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/data-flair.training\/blogs\/#\/schema\/logo\/image\/","url":"https:\/\/data-flair.training\/blogs\/wp-content\/uploads\/sites\/2\/2016\/07\/Data-Flair.png","contentUrl":"https:\/\/data-flair.training\/blogs\/wp-content\/uploads\/sites\/2\/2016\/07\/Data-Flair.png","width":106,"height":48,"caption":"DataFlair"},"image":{"@id":"https:\/\/data-flair.training\/blogs\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/DataFlairWS\/","https:\/\/x.com\/DataFlairWS","https:\/\/www.linkedin.com\/company\/dataflair-web-services-pvt-ltd\/","https:\/\/www.youtube.com\/user\/DataFlairWS"]},{"@type":"Person","@id":"https:\/\/data-flair.training\/blogs\/#\/schema\/person\/2c58ecb4f73a39f0ef993f1ddfcd7b89","name":"DataFlair Team","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/1ce4a0e3e542444fc73bbebf83e89e8b73e2d95ccb1fcee64da9945f078b97c5?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/1ce4a0e3e542444fc73bbebf83e89e8b73e2d95ccb1fcee64da9945f078b97c5?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/1ce4a0e3e542444fc73bbebf83e89e8b73e2d95ccb1fcee64da9945f078b97c5?s=96&d=mm&r=g","caption":"DataFlair Team"},"description":"The DataFlair Team provides industry-driven content on programming, Java, Python, C++, DSA, AI, ML, data Science, Android, Flutter, MERN, Web Development, and technology. Our expert educators focus on delivering value-packed, easy-to-follow resources for tech enthusiasts and professionals.","url":"https:\/\/data-flair.training\/blogs\/author\/dfteam2\/"}]}},"amp_enabled":true,"_links":{"self":[{"href":"https:\/\/data-flair.training\/blogs\/wp-json\/wp\/v2\/posts\/5557","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/data-flair.training\/blogs\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/data-flair.training\/blogs\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/data-flair.training\/blogs\/wp-json\/wp\/v2\/users\/6"}],"replies":[{"embeddable":true,"href":"https:\/\/data-flair.training\/blogs\/wp-json\/wp\/v2\/comments?post=5557"}],"version-history":[{"count":5,"href":"https:\/\/data-flair.training\/blogs\/wp-json\/wp\/v2\/posts\/5557\/revisions"}],"predecessor-version":[{"id":34383,"href":"https:\/\/data-flair.training\/blogs\/wp-json\/wp\/v2\/posts\/5557\/revisions\/34383"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/data-flair.training\/blogs\/wp-json\/wp\/v2\/media\/34382"}],"wp:attachment":[{"href":"https:\/\/data-flair.training\/blogs\/wp-json\/wp\/v2\/media?parent=5557"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/data-flair.training\/blogs\/wp-json\/wp\/v2\/categories?post=5557"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/data-flair.training\/blogs\/wp-json\/wp\/v2\/tags?post=5557"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}