RDD lineage in Spark: ToDebugString Method
1. Objective Basically, in Spark all the dependencies between the RDDs will be logged in a graph, despite the actual data. This is what we call as a lineage graph in Spark. This document holds the...
Apache Spark Tutorials
Top 100 Apache Spark Interview Questions and Answers
1. Spark Interview Questions As we know Apache Spark is a booming technology nowadays. Hence it is very important to know each and every aspect of Apache Spark as well as Spark Interview Questions....
Spark GraphX Features – An Introductory Guide
1. Objective There are several features of Spark GraphX which enhances its qualities. Hence, in this blog, we will learn GraphX features in Apache Spark. Before Spark GraphX features, we will start with the...
GraphX API in Apache Spark: An Introductory Guide
1. Objective – Spark GraphX API For graphs and graph-parallel computation, Apache Spark has an additional API, GraphX. In this blog, we will learn the whole concept of GraphX API in Spark. We will...
Spark Tutorial – Learn Spark Programming
1. Objective – Spark Tutorial In this Spark Tutorial, we will see an overview of Spark in Big Data. We will start with an introduction to Apache Spark Programming. Then we will move to know...
SparkR DataFrame and DataFrame Operations
1. Objective In this article, we will learn the whole concept of SparkR DataFrame. Further, we will also learn SparkR DataFrame Operations and how to run SQL queries from SparkR. You must test your...
Featurization in Apache Spark MLlib Algorithms
1. Objective In this blog, we will learn a tool Featurization in Apache Spark MLlib. We will also learn spark Machine Learning Algorithms to understand well. 2. Featurization in Apache Spark MLlib Apache Spark MLlib includes algorithms...
Apache Spark Executor for Executing Spark Tasks
1. Objective In Apache Spark, some distributed agent is responsible for executing tasks, this agent is what we call Spark Executor. This document aims the whole concept of Apache Spark Executor. Also, we will...
Spark Stage- An Introduction to Physical Execution plan
A stage is nothing but a step in a physical execution plan. It is basically a physical unit of the execution plan. This blog aims at explaining the whole concept of Apache Spark Stage....
Introduction to Apache Spark Paired RDD
1. Objective In Apache Spark, key-value pairs are what we call as paired RDD. This Spark Paired RDD tutorial aims the information on what are paired RDDs in Spark. We will also learn following...
