Load hive table into spark using Scala
Requirement Assume you have the hive table named as reports. It is required to process this dataset in spark. OnceRead more.
Join in spark using scala with example
Requirement You have two table named as A and B. and you want to perform all types of join inRead more.
How to create spark application in IntelliJ
Requirement In spark-shell, it creates an instance of spark context as sc. Also, we don’t require to resolve dependency whileRead more.
How to get partition record in Spark Using Scala
Requirement Suppose we are having a text format data file which contains employees basic details. When we load this fileRead more.
Read CSV file in Spark Scala
Requirement Suppose we have a dataset which is in CSV format. We want to read the file in spark usingRead more.
How to calculate Rank in dataframe using scala with example
Requirement : You have marks of all the students of class and you want to find ranks of students usingRead more.
Calculate percentage in spark using scala
Requirement You have marks of all the students of a class with roll number in CSV file, It is neededRead more.
Find max value in Spark RDD using Scala
Requirement Suppose we are having a source file, which contains basic information about Employees like employee number, employee name, designation,Read more.