Requirement : To Load application properties from text file. In this tutorial we will learn how to load properties or configs for any spark application. Solution : Step 1 : Preparation of required configs Many times parameters for any application vary from environment to environment. Or two run multiple instanceRead More →
1. Let’s say a Hive table is created as an external table. If we drop the table, will the data be accessible? Answer: The data will be accessible even if the table gets dropped. We can get the data from the table’s HDFS location. 2. A Hive table is createdRead More →
Suppose you have a spark dataframe which contains millions of records. You need to perform multiple actions on it. How will you minimize the execution time? Answer : You can use cache or persist. For eg say you have dataframe df and if you use df1=df.cache() ,then df1 will beRead More →
