Projects

PROJECT 1. Calculate Second Toppers of school using hadoop.

  • Pig
  • Hdfs
  • Linux
  • Hive
To calculate second topper of each class using Apache Pig.It will help you to understand second maximum in Pig.
Technology: Hadoop

Don't Miss Below Tutorials

Remove Header of CSV File in hive

Requirement You have one CSV file which is present at Hdfs location, and you want to create a hive layer ...
Read More
/ csv, Hive, hive, remove header

Load CSV file in hive

Requirement If you have comma separated file and you want to create a table in the hive on top of ...
Read More
/ Hive

Load csv file in pig

Requirement Assume that you want to load CSV file in pig and output of pig should be pipe delimited and ...
Read More
/ csv file, load, Pig, pig

Split one column into multiple columns in hive

Requirement You have one table in hive with one column and you want to split this column into multiple columns ...
Read More
/ Hive, hive, hive columns, split

Parse XML data in Hive

Requirement Suppose you are having an XML formatted data file. This source file contains some empty tag. The requirement is ...
Read More
/ Hive, hive, load xml, parse xml

Partitioning in Hive

Requirement Suppose there is a source data, which is required to store in hive partition table. So our requirement is ...
Read More

Load JSON Data in Hive non-partitioned table using Spark

Requirement Suppose there is a source data which is in JSON format. The requirement is to load JSON data in ...
Read More
/ Hive, hive, json, pyspark, Spark, spark with python

Export hive data into file

Requirement You have one hive table named as infostore which is present in bdp schema.one more application is connected to ...
Read More
/ export, Hive, hive

Load CSV file into hive ORC table

Requirement You have comma separated file and you want to create an ORC formatted table in hive on top of ...
Read More
/ Hive

Join in pig

Requirement You have two table named as A and B. and you want to perform all types of join in ...
Read More
/ join, Pig, pig

String to Date conversion in hive

Requirement: Generally we receive data from different sources which usually have different types of date formats. When we create a ...
Read More
/ date conversion, Hive, hive

Filter records in pig

Requirement: In source data, you have user's information of mobile connection type and Id.You have four type of possible connection ...
Read More
/ filter, Pig, pig