Section 1:Introduction to Azure Databricks

• Lecture 1:Introduction to Databricks
• Lecture 2:Azure Databricks Architecture
• Lecture 3:Azure Databricks Main Concepts

Section 2:Azure Databricks Account Creation

• Lecture 4:Azure Free Account and Free Subscription For Azure Databricks
• Lecture 5:How to Create Databricks Community __ Azure Databricks

Section 3:Databricks Cluster Types and Notebook Options

• Lecture 6:Creating and configuring clusters in Azure Databricks
• Lecture 7:How to create Databricks Cluster, Notebook & quick tour on notebook options

Section 4:Databricks Integration with Hive

• Lecture 8:Azure Databricks Databases and Hive Tables
• Lecture 8.1:Azure Databricks Databases and Tables

Section 5:Databricks Utilities and Notebook Parameters

• Lecture 9:dbutils commands on files, directories, notebooks and libraries
• Lecture 10:Databricks Variables, Widget Types, Databricks notebook parameters

Section 6:Databricks CLI

• Lecture 11:Azure Databricks CLI Installation
• Lecture 12:Databricks CLI - DBFS, Libraries and Jobs

Section 7:Databricks Integration with Azure Blob Storage

• Lecture 13:Read data from Blob Storage and Creating Blob mount point in Azure Databricks

Section 8:Databricks Integration with Azure Data Lake Storage Gen2

• Lecture 14:Reading files from Azure Data Lake Storage Gen2

Section 9:Databricks Integration with Azure Data Lake Storage Gen1

• Lecture 15:Reading Files from data lake storage Gen1

Section 10:Reading and Writing CSV files in Databricks

• Lecture 16:Azure Databricks __ Read CSV Files efficiently in Spark
• Lecture 17:Read TSV Files and PIPE Seperated CSV Files
• Lecture 18:Read CSV Files with multiple delimiter in spark 2 and spark 3
• Lecture 19:Reading different position Multidelimiter CSV file from blob using hadoop configuration

Section 11:Reading and Writing Parquet files in Databricks

• Lecture 20:Read Parquet files from Data Lake Storage Gen2
• Lecture 21:Reading and Creating Partition files in Spark

Section 12:Installing Libraries on Databricks Cluster -Read and Write EXCEL & XML files

• Lecture 22:Reading and Writing Excel Files & Installing the libraries on Cluster
• Lecture 23:Reading and Writing XML Files

Section 13:Parsing Complex Json Files

• Lecture 24:Reading and Writing JSON Files
• Lecture 25:Reading, Transforming and Writing Complex JSON files in databricks

Section 14:Reading and Writing ORC and Avro Files

• Lecture 26:Reading and Writing ORC and Avro Files

Section 15:Databricks Integration with Azure SQL Database

• Lecture 28:Reading and Writing data from Azure SQL Database

Section 16:Databricks Integration with Azure SQL DW(Azure Synapse) using polybase

• Lecture 29:Reading and Writing Azure Synapse data from Azure Databricks

Section 17:Databricks Integration with Amazon Redshift(Redshift) using polybase

• Lecture 30:Read and Write data from Redshift using databricks

Section 18:Databricks Integration with Snowflake

• Lecture 31:Reading and Writing data from Snowflake

Section 19:Databricks Integration with CosmosDB SQL API

• Lecture 32:Reading and Writing data from Azure CosmosDB Account

Section 20:Python Introduction

• Lecture 39:Python Introduction, Installation and setup
• Lecture 40:Python Data Types for Azure Databricks

Section 21:Python Data Types

• Lecture 41:Deep dive into String Data Types in Python for Azure Databricks
• Lecture 42:Deep dive into python collection list and tuple
• Lecture 43:Deep dive on set and dict data types in python

Section 22:Python Functions and Arguments

• Lecture 44:Python Functions and Arguments, Lambda Functions

Section 23:Python Modules and Packages

• Lecture 45:Python Modules and Packages , Special Variable __name__

Section 24:Python Flow Control

• Lecture 46:Python Flow Control

Section 25:Python File Handling

• Lecture 47:Python File Handling

Section 26:Python Logging Module

• Lecture 48:Python Logging Module

Section 27:Python Exception Handling

• Lecture 49:Python Exception Handling

Section 28:Pyspark Introduction

• Lecture 50:Pyspark Introduction
• Lecture 51:Pyspark Components and Features

Section 29:Spark Architecture and Internals

• Lecture 52: Apache Spark Internal architecture jobs stages and tasks __ Spark Cluster Architecture Explained

Section 30:Spark RDD

• Lecture 53: Azure Databricks__ Different Ways to create RDD in Databricks
• Lecture 54: Azure Databricks__ Spark Lazy Evaluation Internals & Word Count Program
• Lecture 55: Azure Databricks__RDD Transformations in Databricks & coalesce vs repartition
• Lecture 56: RDD Transformation and Use Cases

Section 31:Spark SQL

• Lecture 57: Spark SQL Introduction and Different ways to create DataFrames

Section 32:Spark SQL Intenals

• Lecture 58: Catalyst Optimizer and Spark SQL Execution Plan
• Lecture 59: Deep dive on Sparksession vs sparkcontext & spark SQL Basics part-1

Section 33:Spark SQL Basics

• Lecture 60: Spark SQL Basics Part-2
• Lecture 61: Joins in Spark SQL and Joins scenarios for Interview Questions

Section 34:Spark SQL Functions and UDFs

• Lecture 62: Spark SQL Functions part-1
• Lecture 63: Spark SQL Functions part-2
• Lecture 64: Spark SQL Functions Part-3
• Lecture 65: Spark SQL UDFs and Spark SQL Temp tables and Joins

Section 35:Databricks Delta and Implementing Dimensions SCD1 and SCD2

• Lecture 66: Implementing SCD Type1 and Apache Spark Databricks Delta
• Lecture 67: Delta Lake in Azure Databricks
• Lecture 68: Implementing SCD Type with and without Databricks Delta

Section 36:Databricks Integration with Azure Data Factory

• Lecture 69: Azure Data Factory Integration with Azure Databricks

Section 37:Databricks Streaming

• Lecture 70:Delta Streaming in Azure Databricks

Section 38:Azure Databricks Projects

• Lecture 71: Azure Databricks Project-1
• Lecture 72: Azure Databricks Project-2

Section 39:Databricks Integration with Azure Devops

• Lecture 73: Azure Databricks CICD Pipelines

Section 40:Databricks Interview Question and Answers

• Lecture 74: Azure Databricks Interview Question and Answers