Mount Archives - BIG DATA PROGRAMMERS

Read file from Azure Data Lake Gen2 using Python

Tagged: ADLS, Azure, Azure Data Lake Gen2 storage, Azure Databricks, cloud, data lake storage, databricks, Mount, pyspark, python

Requirement Let’s say there is a system which used to extract the data from any source (can be Databases, Rest API, etc.) and dumping into Azure Data Lake Storage aka. ADLS Gen2 storage. Now, we want to access and read these files in Spark for further processing for our businessRead More →

Create Mount Point in Azure Databricks Using Service Principal and OAuth

Tagged: Azure, cloud, databricks, key vault, Mount, mount in databricks, OAuth, Secret Scope, Spark, SPN

Requirement In this post, we are going to create a mount point in Azure Databricks to access the Azure Datalake data. This is a one-time activity. Once we create the mount point of blob storage, we can directly use this mount point to access the files. Earlier, in one ofRead More →