Explain sum(), max(), min() operation in Apache Spark.

[DataFlair Team]

Explain sum(), max(), min() operation in Apache Spark.

[DataFlair Team]

sum() :

> It adds up the value in an RDD.
> It is an package org.apache.spark.rdd.DoubleRDDFunctions.
> Its return type is Double

Example:

val rdd1 = sc.parallelize(1 to 20)
rdd1.sum

Output:
Double = 210.0

max() :

> It returns a max value from RDD element defined by implicit ordering (element order)
> It is an package org.apache.spark.rdd

Example:

val rdd1 = sc.parallelize(List(1,5,9,0,23,56,99,87))
rdd1.max

Output:
Int = 99

min() :

> It returns a min value from RDD element defined by implicit ordering (element order)
> It is an package org.apache.spark.rdd

Example:

val rdd1 = sc.parallelize(List(1,5,9,0,23,56,99,87))
rdd1.min

Output:
Int = 0

For more operations on RDD read Spark RDD Operations.

[Author]

Posts