Section 1 : Introduction

• Lecture 1: Big Data Introduction
• Lecture 2: Azure Data Factory Introduction
• Lecture 3: Azure Data Factory __ Important Concepts in Azure Data Factory
• Lecture 4: Azure Data Factory __ Create Azure Free Account for Azure Data Factory

Section 2: Integration Runtime and Types

• Lecture 5: Azure Data Factory __ Integration runtime in azure data factory __ Azure IR

Section 3: Azure Data Factory - Real Time Use case1

• Lecture 6: ADF Lab1__ Create Your First Azure Data Factory
• Lecture 7: ADF Lab2__ Create Your First Pipeline in Azure Data Factory

Section 4: Azure Storage Account Integration with Azure Data Factory

• Lecture 8: ADF Lab3__ Copy multiple files from blob to blob
• Lecture 9: ADF Lab4_ Filter activity __ Dynamic Copy Activity
• Lecture 10: ADF Lab5__ Get File Names from Folder Dynamically

Section 5: Deep dive into Copy Activity in Azure Data Factory

• Lecture 11: ADF Lab6__ Copy Activity Behavior in Azure Data Factory
• Lecture 12: ADF Lab7__ Copy Activity Performance Tuning in Azure Data Factory

Section 6: Validation in Azure Data Factory

• Lecture 13: ADF Lab8__ Get Count of files from folder in azure data factory
• Lecture 14: ADF Lab9__ Validate copied data between source and sink in Azure Data Factory

Section 7: Azure SQL Database integration with Azure Data Factory

• Lecture 15: Azure SQL Databases - Introduction __ Relational databases in Azure
• Lecture 16: Creating Your First Azure SQL Database _Deployment Models __Purchasing Modes
• Lecture 17: ADF Lab10__ Overwrite and Append Modes in Copy Activity in Azure Data Factory

Section 8: Full Load in Azure Data Factory

• Lecture 18: ADF Lab11__ Copy Data from Azure SQL Database to BLOB in Azure Data Factory
• Lecture 19: ADF Lab12__ Copy multiple tables in Bulk with Lookup & ForEach in Data Factory

Section 9: Logging and Notification __ Azure Logic Apps

• Lecture 20: ADF Lab13__ Log Pipeline Executions to SQL Table using Azure Data Factory
• Lecture 21: ADF Lab14 _ Custom Email Notifications _ Send Error notification with logic app
• Lecture 22: ADF Lab15 __ Use Foreach loop activity to copy multiple Tables- Step by Step Explanation

Section 10: Incremental Load in Azure Data Factory

• Lecture 23: ADF Lab16 __Incremental Load or Delta load from SQL to Blob Storage in Azure Data factory
• Lecture 24: ADF Lab17 __ Multi Table Incremental Load or Delta load from SQL to Blob Storage
• Lecture 25: ADF Lab18 __Incrementally copy new and changed files based on Last Modified Date

Section 11: Azure Key Vault integration with Azure Data Factory

• Lecture 26: ADF Lab19 __ Azure Key Vault, Secure secrets, keys & certificates in Azure Data

Section 12: Azure Data Factory Triggers

• Lecture 27: Azure Data Factory __ Event Based Trigger in Azure Data Factory
• Lecture 28: ADF Lab21 __ Tumbling window trigger dependency & parameters
• Lecture 29: ADF Lab22 __ Schedule Trigger in Azure Data Factory

Section 13: Self Hosted Integration Runtime

• Lecture 30: ADF Lab23- Copying On Premise data using Azure Self Hosted integration Runtime

Section 14: Data Migration from On premise SQL Server to cloud using Azure Data Factory

• Lecture 31: ADF Lab24 - Load data from on premise sql server to Azure SQL DB

Section 15: Data Migration with polybase and Bulk insert

• Lecture 32: ADF Lab25 -Copy Data from sql server to Azure SQL DW with polybase & Bulk Insert

Section 16: Data Migration from On premise File System to cloud using Azure Data Factory

• Lecture 33: ADF Lab26 - Copy Data from on-premise File System to ADLS Gen2

Section 17: Copying data from REST API using Azure Data Factory

• Lecture 34: ADF Lab27 -Loop through REST API copy data 2 ADLS Gen2 Linked Service Parameters

Section 18: Salesforce Integration with Azure Data Factory

• Lecture 35: ADF Lab28 _Copy data from Salesforce to ADLS Gen2 using ForEach & Copy in ADF V2

Section 19: AWS S3 integration with Azure Data Factory

• Lecture 36: ADF Lab29 -Migrate Data from AWS S3 Buckets to ADLS Gen2 using ADF (v2)

Section 20: Activities in Azure Data Factory

• Lecture 37: ADF Lab30 -Switch Activity In Azure Data Factory __Copy, Move and delete data
• Lecture 38: ADF Lab31 _Until Activity in Azure Data Factory __ Parameters & Variables
• Lecture 39: ADF Lab32 -Copy Recent Files From Blob input to Blob Output folder without LPV

Section 21: Snowflake integration with Azure Data Factory

• Lecture 40: ADF Lab33 -Copy data from Azure Snowflake to ADLS Gen2& ADLS Gen2 to Snowflake

Section 22: Azure CosmosDB integration with Azure Data Factory

• Lecture 41: ADF Lab34-Copy data from Azure SQLDB to CosmosDB_Copy data from blob to cosmosDB

Section 23: Advanced Concepts in Azure Data Factory

• Lecture 42: ADF Lab35 -Nested ForEach in ADF _ pass parameters from Master to child pipeline
• Lecture 43: ADF Lab36 -High Availability of Self Hosted IR &Sharing IR with other ADF

Section 24: Data Flows Introduction

• Lecture 44: Azure Data Flows Introduction __ Setup Integration Runtime for Data Flows
• Lecture 45: Azure Data Flows __ Basics of SQL Joins for Azure Data Flows

Section 25: Joins in Data Flows

• Lecture 46: ADF Lab37 -Aggregations and Derive Column Transformations
• Lecture 47: ADF Lab38 _Joins in Azure DataFlows
• Lecture 48: ADF Lab39 -Advanced Join Transformations with filter and Conditional Split

Section 26: Data Flows - Data processing use case1

• Lecture 49: ADF Lab40 -Restart data processing from failure
• Lecture 50: ADF Lab41 -Remove Duplicate Rows &Store Summary Credit Stats __ Azure Data Flows
• Lecture 51: ADF Lab42 -Difference Between Join vs.Lookup Transformation& Merge Functionality

Section 27: Dimensions in Data Flows

• Lecture 52: ADF Lab43 -Slowly Changing Dimension Type1 (SCD1) with HashKey Function
• Lecture 53: ADF Lab44 -Slowly Changing Dimension Type(SCD1) with SurrogateKey Transformation
• Lecture 54: ADF Lab45 -Slowly Changing Dimension Type2 (SCD2)

Section 28: Data Flows - Data processing use case2

• Lecture 55: ADF Lab46 - Flatten Transformation and Rank, Dense_Rank Transformatios
• Lecture 56: ADF Lab47 -Data Flows Performance Metrics and Data Flow Parameters
• Lecture 57: ADF Lab48 -How to use pivot and unpivot Transformations
• Lecture 58: ADF Lab49 -Data Quality Checks and Logging using Data Flows

Section 29: Batch Account Integration with Azure Data Factory

• Lecture 59: ADF Lab50 - Custom Activity in Azure Data Factory

Section 30: Azure Functions Integration with Azure Data Factory

• Lecture 60: ADF Lab51 - Azure Functions Integration with Azure Data Factory

Section 31: Azure HDInsight Integration with Azure Data Factory

• Lecture 61: ADF Lab52 -Azure HDInsight with Spark Cluster

Section 32: Azure Databricks Integration with Azure Data Factory

• Lecture 62: ADF Lab53 -Azure Data Factory Integration with Azure Databricks

Section 33: Azure Data Lake Analytics with Azure Data Factory

• Lecture 63: ADF Lab54 -Azure Data Lake Analytics integration with Azure Data Factory

Section 34: Azure Machine Learning

• Lecture 64: ADF Lab55 -Azure Machine Learning

Section 35: Azure Automation Integration with Azure Data Factory

• Lecture 65: Auto Termination of server with Automation Account

Section 36: Azure Devops - CICD

• Lecture 66: ADF Lab56 -Azure Data Factory CICD Pipeline

Section 37: Azure Data Factory Projects

• Lecture 67: ADF Lab57 -Azure Data Factory project-1
• Lecture 68: ADF Lab58 -Azure Data Factory project-2

Section 38: Azure Data Factory Interview Question and Answers

• Lecture 69: BI Master Program Interview Question and Answers

Section 39: Additional Content

• Lecture 70: Python Basics
• Lecture 71: Python Data Types
• Lecture 72: Python Functions
• Lecture 73: Python Modules and packages
• Lecture 74: Python File handling
• Lecture 75: Python Exception Handling

Section 40: Additional Content

• Lecture 76: Spark Architecture
• Lecture 77: Spark RDD
• Lecture 78: Spark SQL
• Lecture 79: Spark SQL Functions
• Lecture 80: Spark SQL Advanced