Data Engineering 

Module 1   Introduction to Cloud

• Cloud Architecture
• Introduction to Cloud Computing
• Introduction to Microsoft Azure
• Introduction to AWS
• Cloud Security
• Kubernetes on AWS and Microsoft Azure

Module 2   Explore core data concepts.

• Explore core data concepts
• Explore roles and responsibilities in the world of data
• Describe concepts of relational data
• Explore concepts of non-relational data
• Explore concepts of data analytics

Module 3: Explore relational data in Azure

• Explore relational data services in Azure
• Explore provisioning and deploying relational database services in Azure
• Query relational data in Azure

Module 4: Explore non-relational data in Azure

• Explore non-relational data services in Azure
• Explore provisioning and deploying non-relational data services on Azure
• Manage non-relational data stores in Azure

Module 5: Explore modern data warehouse analytics in Azure

• Examine components of a modern data warehouse
• Explore data ingestion in Azure
• Explore data storage and processing in Azure
• Get started building with Power BI

Module 6: The Role of the Azure Database Administrator

• Azure Data Platform Roles
• Azure Database Platforms and Options
• SQL Server Compatibility Levels
• Azure Preview Features

Module 7: Plan and Implement Data Platform Resources

• Deploying SQL Server using IaaS
• Deploying SQL Server using PaaS
• Deploying Open Source Database Solutions on Azure

Module 8: Implement a Secure Environment

• Configure Database Authentication
• Configure Database Authorization
• Implement Security for Data at Rest
• Implement Security for Data in Transit
• Implement Compliance Controls for Sensitive Data

Module 9: Plan and Implement a High Availability and Disaster Recovery Environment

• High Availability and Disaster Recovery Strategies
• IaaS Platform and Database Tools for HADR
• PaaS Platform and Database Tools for HADR
• Database Backup and Recovery

Module 10: Plan and Implement a High Availability and Disaster Recovery Environment

• Extending SQL Server Integration Services (SSIS)
• Using Custom Components in SSIS
• Using Scripting in SSIS
• Deploying and Configuring SSIS Packages
• Overview of SSIS Deployment
• Deploying SSIS Projects

MODULE 11: EXPLORE COMPUTE AND STORAGE OPTIONS FOR DATA ENGINEERING WORKLOADS

• INTRODUCTION TO AZURE SYNAPSE ANALYTICS
• DESCRIBE AZURE DATABRICKS
• INTRODUCTION TO AZURE DATA LAKE STORAGE
• DESCRIBE DELTA LAKE ARCHITECTURE
• WORK WITH DATA STREAMS BY USING AZURE STREAM ANALYTICS

MODULE 12: RUN INTERACTIVE QUERIES USING AZURE SYNAPSE ANALYTICS SERVERLESS SQL POOLS

• EXPLORE AZURE SYNAPSE SERVERLESS SQL POOLS CAPABILITIES
• QUERY DATA IN THE LAKE USING AZURE SYNAPSE SERVERLESS SQL POOLS
• CREATE METADATA OBJECTS IN AZURE SYNAPSE SERVERLESS SQL POOLS
• SECURE DATA AND MANAGE USERS IN AZURE SYNAPSE SERVERLESS SQL POOLS

MODULE 13: DATA EXPLORATION AND TRANSFORMATION IN AZURE DATABRICKS

• DESCRIBE AZURE DATABRICKS
• READ AND WRITE DATA IN AZURE DATABRICKS
• WORK WITH DATAFRAMES IN AZURE DATABRICKS
• WORK WITH DATAFRAMES ADVANCED METHODS IN AZURE DATABRICKS
• WORK WITH DATAFRAMES
• WORK WITH DATAFRAMES ADVANCED METHODS

MODULE 14: EXPLORE, TRANSFORM, AND LOAD DATA INTO THE DATA WAREHOUSE USING APACHE SPARK

• UNDERSTAND BIG DATA ENGINEERING WITH APACHE SPARK IN AZURE SYNAPSE ANALYTICS
• INGEST DATA WITH APACHE SPARK NOTEBOOKS IN AZURE SYNAPSE ANALYTICS
• TRANSFORM DATA WITH DATAFRAMES IN APACHE SPARK POOLS IN AZURE SYNAPSE ANALYTICS
• INTEGRATE SQL AND APACHE SPARK POOLS IN AZURE SYNAPSE ANALYTICS

MODULE 15: INGEST AND LOAD DATA INTO THE DATA WAREHOUSE

• USE DATA LOADING BEST PRACTICES IN AZURE SYNAPSE ANALYTICS
• PETABYTE-SCALE INGESTION WITH AZURE DATA FACTORY

MODULE1 6: TRANSFORM DATA WITH AZURE DATA FACTORY OR AZURE SYNAPSE PIPELINES

• DATA INTEGRATION WITH AZURE DATA FACTORY OR AZURE SYNAPSE PIPELINES
• CODE-FREE TRANSFORMATION AT SCALE WITH AZURE DATA FACTORY OR AZURE SYNAPSE PIPELINES

MODULE 17: ORCHESTRATE DATA MOVEMENT AND TRANSFORMATION IN AZURE SYNAPSE PIPELINES

• ORCHESTRATE DATA MOVEMENT AND TRANSFORMATION IN AZURE DATA FACTORY

MODULE 18: END-TO-END SECURITY WITH AZURE SYNAPSE ANALYTICS

• SECURE A DATA WAREHOUSE IN AZURE SYNAPSE ANALYTICS
• CONFIGURE AND MANAGE SECRETS IN AZURE KEY VAULT
• IMPLEMENT COMPLIANCE CONTROLS FOR SENSITIVE DATA

MODULE 19: SUPPORT HYBRID TRANSACTIONAL ANALYTICAL PROCESSING (HTAP) WITH AZURE SYNAPSE LINK

• DESIGN HYBRID TRANSACTIONAL AND ANALYTICAL PROCESSING USING AZURE SYNAPSE ANALYTICS
• CONFIGURE AZURE SYNAPSE LINK WITH AZURE COSMOS DB
• QUERY AZURE COSMOS DB WITH APACHE SPARK POOLS
• QUERY AZURE COSMOS DB WITH SERVERLESS SQL POOLS

MODULE 20: REAL-TIME STREAM PROCESSING WITH STREAM ANALYTICS

• ENABLE RELIABLE MESSAGING FOR BIG DATA APPLICATIONS USING AZURE EVENT HUBS
• WORK WITH DATA STREAMS BY USING AZURE STREAM ANALYTICS
• INGEST DATA STREAMS WITH AZURE STREAM ANALYTICS

MODULE 21: CREATE A STREAM PROCESSING SOLUTION WITH EVENT HUBS AND AZURE DATABRICKS

• PROCESS STREAMING DATA WITH AZURE DATABRICKS STRUCTURED STREAMING