Remove Header of CSV File in hive
Requirement You have one CSV file which is present at Hdfs location, and you want to create a hive layerRead more.
Load CSV file in hive
Requirement If you have comma separated file and you want to create a table in the hive on top ofRead more.
Split one column into multiple columns in hive
Requirement You have one table in hive with one column and you want to split this column into multiple columnsRead more.
Parse XML data in Hive
Requirement Suppose you are having an XML formatted data file. This source file contains some empty tag. The requirement isRead more.
Partitioning in Hive
Requirement Suppose there is a source data, which is required to store in hive partition table. So our requirement isRead more.
Load JSON Data in Hive non-partitioned table using Spark
Requirement Suppose there is a source data which is in JSON format. The requirement is to load JSON data inRead more.
Export hive data into file
Requirement You have one hive table named as infostore which is present in bdp schema.one more application is connected toRead more.
Load CSV file into hive ORC table
Requirement You have comma separated file and you want to create an ORC formatted table in hive on top ofRead more.
String to Date conversion in hive
Requirement: Generally we receive data from different sources which usually have different types of date formats. When we create aRead more.
Pass variables from shell script to hive script
Requirement You have one hive script which is expecting some variables which need to be passed from a shell script.SayRead more.
Load JSON Data into Hive Partitioned table using PySpark
Requirement In the last post, we have demonstrated how to load JSON data in Hive non-partitioned table. This time havingRead more.
Load Text file into Hive Table Using Spark
Requirement Suppose the source data is in a file. The file format is a text format. The requirement is toRead more.
Load hive table into pig
Requirement You have one table in hive, and it is needed to process the data of that hive table usingRead more.
Load multi character delimited file into hive
Requirement You have a file which is delimited by multiple characters (%$) and you want to create a table inRead more.
Calculate percentage in hive
Requirement You have marks of all the students of a class with roll number in CSV file, It is neededRead more.
Data migration from Hive to HBase
Requirement Suppose we have data in Hive table. We want the same data into HBase table. So, our requirement isRead more.
Find max value of a row in Hive
Requirement Suppose we are having some data in a hive table. The table contains information about company’s quarterly wise profit.Read more.
Load files into Hive Partitioned Table
Requirement There are two files which contain employee’s basic information. One file store employee’s details who have joined in theRead more.
Drop multiple partitions in Hive
Requirement Suppose we are having a hive partition table. This table is partitioned by the year of joining. Our requirementRead more.
__hive_default_partition__ in Hive
Requirement In this post, we are going to understand what is hive_default_partition in hive and why it gets created. ComponentsRead more.
Exclude Column(s) From Select Query in Hive
Requirement There is an uncertain number of columns present in the hive table. Sometimes a table can have many numbersRead more.
Bucketing in Hive
Requirement In this post, we will go through the concept of Bucketing in Hive. This post will cover the below-followingRead more.
Analytics Functions in Hive
Requirement In this post, we are going to explore analytics functions in Hive. These are the following analytics function availableRead more.
Windowing Functions in Hive
Requirement In this post, we are going to explore windowing functions in Hive. These are the windowing functions: LEAD LADRead more.
Hive tips and shortcuts
#execute a query in Silent(S)Mode hive -S -e "your hive query" #execute a query hive -eRead more.
Join in hive with example
Requirement You have two table named as A and B. and you want to perform all types of join inRead more.
Load CSV file into hive PARQUET table
Requirement You have comma separated(CSV) file and you want to create Parquet table in hive on top of it, thenRead more.
Load CSV file into hive AVRO table
Requirement You have comma separated(CSV) file and you want to create Avro table in hive on top of it, thenRead more.