Loading...

Microsoft Azure Data Factory

Course Content

  • What is Data.
  • How many types of data bases(OLTP&OLAP)
  • Types Cloud Vendors
  • What is on premises and what is cloud
  • Differences between on premises and cloud
  • what is Cloud computing
  • what are services offering Microsoft azure
  • Advantages of cloud computing
  • Typesof cloud deployments
  • Types of cloud Services
  • Microsoft Azure vs AWS
  • How to Create Azure Account
  • Azure Architecture & Services
  • How to Create Resources and Resource Groups in Microsoft Azure
  • How to create VirtualMachine
  • How to create SQL in virtual machines

  • Containers/Blob Storages
  • File
  • Queues
  • Tables

  • Blob Storage vs Data Lake
  • What is Data Lake
  • Date Lake Gen1 Vs Gen2
  • How to store Data into data lake
  • How to Query data from data lake to SQL Server.
  • Introduction to Azure Data Lake U-SQL Batch Job
  • Data Lake Analytics
  • How to Schedule Data Lake Analytics Jobs using Data Factory
  • Azure Blob to Data Lake Gen 2 using Data Factory
  • What is HD-insigh

  • Azure SQL
  • Dedicated SQL Pool Formerly known as DW
  • SQL VM’s
  • SQL Managed Instances
  • Azure Synapse Warehouse
  • Access keys
  • Connection strings
  • IAM/RBAC
  • Share Access Signatures (SAS Tokens)
  • Service Principal Identity Mechanism(Tenant ID,Client ID,Secret Key)

  • Compare SQL Database vs Azure Data Warehouse
  • How to Create Azure Data Warehouse
  • How to cross query data in Data Warehouse
  • Poly base using Azure Data warehouse
  • How to Query Azure SQL Data Warehouse from On-premises SSMS and Cloud
  • How to Load Data to Azure Data Warehouse using data Factory from Azure SQL
  • How to Load Data from on premises to Cloud SQL DW using data factory

  • What is AzureData Factory vs SSIS
  • What is Linked Services
  • What is Data Sets
  • What is Pipelines
  • Parameters vs Variables
  • Copy Data
  • Monitoring pipelines using different approaches
  • Different kinds of integration runtimes
  • How to create pipelines from template
  • How to do Transformations using Data Flows
  • How to configure different Integration Runtimes
  • Azure Integration runtime
  • Auto resolve Integration runtime
  • Azure self Hosted Integration Runtime
  • SSIS Integration runtime
  • Triggering the Pipelines by using 3 types of Triggers
  • Move & transform
  • Copy Data
  • General activities
  • Web Activity
  • Execute Pipeline
  • Execute SSIS Package
  • Get Metadata
  • Lookup
  • Stored procedure
  • Set Variable
  • Delete
  • Wait
  • Until
  • Iteration & Conditionals
  • Filter
  • For Each
  • If Condition
  • Until
  • Source
  • Lookup
  • Derived Column
  • Alter Row
  • Conditional Split
  • Sink
  • What are ARM Templates using for Deployment
  • How to Deploy Data Factory Pipelines DEV, Test, Prod
  • Environment
  • Version Control and Code Repository in Azure Devops
  • Debugging and Monitoring Pipelines
  • Error handling and Logging error records
  • Lift and Shift SSIS packages in to Azure Data Factory

  • What is Logic Apps
  • How to Create Workflow using Logic Apps in Azure
  • How to Send Mail using Logic app in Azure Data Factory
  • REST API’S
  • What is REST APIS and how to transfer the data from JSON format into Azure SQL Tables.
  • Azure Event Hub’s
  • How to create Event hubs and using streaming Analytics how to get the streaming data and send it to Blob storages By Using Logic Apps.

  • What is Databricks
  • How to Create Data Bricks Free Account
  • What is Workspace in Data Bricks
  • Different Kind of Clusters in Data Bricks
  • Basics of Spark
  • What is Note Books
  • How to Mount Data take to data bricks using Scala
  • Reading data From Blob storage and Writing into Azure sqL
  • Reading data From Data Lake storage and Writing into Azure
  • SQL
  • using spark sql
  • Explore, Analyze, Clean, Transform and Load Data in Data bricks using SqL
  • Python vs scata vs SQL
  • Configure data bricks
  • Schedule and Run Notebooks in Azure Data Factory with the realtime notebooks

  • Access Keys
  • Shared Access Signature
  • Azure Active Directory
  • How to register App in Azure Active Directory
  • Role Based Access Control
  • Azure Key Vaults

  • Will cover end to end flow of a project
  • How will get the requirements
  • What kind of requirements will get?
  • Documentation
  • End to end implementation
  • Unit test cases preparation
  • DMR and FS Documents
  • Will Conduct Mockup Interviews

  • what is power BI
  • How to create Reports in Power BI desktop Using Azure Data sources
  • Publish Reports into power BI cloud