Write a Word Count program using Scala language (Don't use Spark Core or SQL)

Free Online Certification Courses – Learn Today. Lead Tomorrow. Forums Apache Hadoop Write a Word Count program using Scala language (Don't use Spark Core or SQL)

Viewing 0 reply threads
  • Author
    Posts
    • #5033
      DataFlair TeamDataFlair Team
      Spectator

      WordCount program using scala language (Without using Spark-Core and SQL)

      val list = List(“Anish is working on BigData Technologies”,”Hello Anish”,”BigData”)
      val words = list.flatMap(line => line.split(” “))
      val keyData = words.map(word => (word,1))
      val groupedData = keyData.groupBy(_._1)
      val result = groupedData.mapValues(list=>{
      list.map(_._2).sum
      })
      result.foreach(println)

      Output:
      scala> result.foreach(println)
      (working,1)
      (BigData,2)
      (is,1)
      (Technologies,1)
      (Anish,2)
      (on,1)
      (Hello,1)

Viewing 0 reply threads
  • You must be logged in to reply to this topic.