Spark Quiz -2

To Shuffle data for joins or aggregations,which of the following is the default number of partitions in spark?

Which of the following will return all the elements of the dataset as an array at the driver program?

How will you control the number of partitions in spark dataframe across the application ?

Which of the following will give max value of a column “id” in dataframe “df” ?

Which of the following will give the current date in data frame column ?

In Scala Which of the following will give the unixtimestamp in variable “a” (dataType:String) ?

Which of the following will persist the data in to disk only?

How would you set number of executors(say 5) of any spark application ?

Say you have dataframe “df”,how would you add a new column which will have current timestamp ?

Which of the following function will avoid full shuffle in spark if partitions are set to be decreased.