Requirement Suppose you have received a data set. It is in a CSV format. Now, you want to analyze this data using spark in databricks. In this post, we will see how to import data into DBFS (Databricks File System) from a local system for analysis. Solution Let’s take theRead More →
Requirement In this post, we are having data in a CSV file. This file contains basic information about Employees. We want to import CSV data into HBase table. Components Involved HDFS HBASE Sample Data Our sample data looks like below: 7369,SMITH,CLERK,7902,12/17/1980,800,20 7499,ALLEN,SALESMAN,7698,2/20/1981,1600,30 7521,WARD,SALESMAN,7698,2/22/1981,1250,30 7566,TURNER,MANAGER,7839,4/2/1981,2975,20 7654,MARTIN,SALESMAN,7698,9/28/1981,1250,30 7698,MILLER,MANAGER,7839,5/1/1981,2850,30 7782,CLARK,MANAGER,7839,6/9/1981,2450,10 7788,SCOTT,ANALYST,7566,12/9/1982,3000,20 7839,KING,PRESIDENT,NULL,11/17/1981,5000,10 7844,TURNER,SALESMAN,7698,9/8/1981,1500,30Read More →
Requirement Suppose, we have data in a table EMPLOYEE in MySQL database. We want to ingest same data in NoSQL HBase table. So, the requirement is to import data from MySQL to HBase using Sqoop. Components Involved Following components are involved in this requirement MySQL – Source for the Ingestion.Read More →
Requirement You have one table in hive, and it is needed to process the data of that hive table using pig. To load data directly from the file we generally use PigStorage(), but to load data from hive table we need different loading function. Let’s go into detail step byRead More →
