Azure Data Factory Master Program [Real time scenarios+Labs]

Azure Data Factory Main Concepts




What you'll learn
Who want to learn Azure Data Factory
Requirements
No
Description
What is Big Data

Different domains which generates Big Data

Real-time use case - finance

Real-time use case - Retail

Real-time use case - Travel

Real-time use case - Health Care

Scenario

What is azure data factory

Code Free ETL as a Service

Why Azure Data Factory

Linked Services

Datasets

Activity

Pipeline

Triggers

Parameters

Azure data factory v2 data flow architecture

Prerequisites to create Free Subscription in azure

How to create Azure Free Subscription

How to login Into Azure Portal

A Quick tour on azure portal

What is subscription

What is resource group

What is location/region

What is integration runtime

What are the different types of Integration Runtimes(IR)

What is Azure IR

What is Self-Hosted IR

What is SSIS IR

Which integration runtime should I use?

Integration runtime location

What is auto-resolve integration runtime

Determining which IR to use

Overview Diagram

What is Storage Account

What is File, Queue and Table in Storage Account

What is Blob Storage and Types

Storage tiers

Storage performance Tier

Data Redundancy

Demo

Create Storage Account

Upload data into Storage Account

Create Azure Data Factory V2 through UI

Create Azure Data Factory V2 through powershell

Azure Blob Storage containers

CSV File Overview

Data flow diagram

Estimations

Debugging Functionality in Azure Data Factory

Prerequisites

Required Resources

Naming convensions

Demo

Create Storage Account

Upload file into Storage Account

Create Azure Data Factory V2

Create Linked Service for blob storage using Integration Runtime

Create Source Data Reference

Create Sink Data Reference

Create Pipeline

Debug Pipeline

Run Pipeline

Monitor Pipeline

Copy multiple csv files from inputcsv container to outputcsv container as csv file

Copy specific extension files from input container to output container as specified file format.

Copy two types of files json and csv from inputcsvjson container to outputcsvjson container as source format

Dynamic Copy Activity

Copy files based on filenames from input container to output container as csv format

Copy selected file based on filename from input container to output container as source format

Copy two types of files json and csv from input container to output container as csv files

Copy two types of files json and csv from input container to output container as csv files

How to add timestamp for files while copying from input container to output container

Copy Json and CSV files from input container to jsoncontainer and csvcontainer.

Who this course is for:
Software Engineers
University Students