Microsoft DP-3027: Implement a data engineering solution with Azure Databricks

This course teaches you how to harness the power of Apache Spark and the high-capacity clusters in the platform. Azure Databricks to run complex data engineering tasks in cloudYou will explore streaming processing architectures, implement automated processes, and understand how to optimize performance using Delta Live Tables. In addition, you will learn to orchestrate and monitor data processes through Azure Databricks Jobs, apply governance and security measures to data and integrate Databricks with other services Azure.

The course is recommended for:

• Data Engineers who develop large-scale data processing solutions.
• Data Scientists who need to use Azure Databricks for preparing and processing large data sets.
• ELT Developers who implement complex data flows in cloud.
• Professionals who want to learn how to orchestrate, secure, and optimize data processes in Azure Databricks.

After completing the course, you will know how to:

• Implement incremental processes using Spark Structured Streaming.
• Develop streaming architectures with Delta Live Tables.
• Optimize the performance of data workloads in Spark and Delta Live Tables.
• Create and manage CI/CD workflows in Azure Databricks.
• Automate and orchestrate data flows through Azure Databricks Jobs and Azure Data Factory.
• Manage data security, privacy, and governance with Unity Catalog.
• You use SQL Warehouses in Azure Databricks for relational queries.
• run Azure Databricks Notebooks in Azure Data Factory to scale data engineering processes.

There are no prerequisites.