Learn how to harness the power of Apache Spark and powerful clusters running on the Azure Databricks platform to run large data engineering workloads in the cloud.
Please note: This course is due to be released on June 26, 2025.
After completing this course, students will be able to:
Understand Spark structured streaming
Set up real-time-sources for incremental processing
Use Event driven architectures with Delta Live Tables
Achieve Data consistency and reliability
Use serverless compute and parallelism with Delta live tables
Perform cost-based optimisation and query performance
Implement version control and Git integration
Implement rollback and roll-forward strategies
Implement job scheduling and automation
Optimise workflows with parameters
Implement data encryption techniques
Roll out governance automation
Create and configure SQL Warehouses in Azure Databricks
Create an Azure Data Factory linked service for Azure Databricks
Pass parameters to a notebook
As part of Lumify Group, Lumify Work has skilled more people in Microsoft technologies than any other organisation in Australia and New Zealand. We have a campus in the Philippines, too. We offer the broadest range of instructor-led training courses, from end user to architect level. We are proud to be the winner of the Microsoft MCT Superstars Award for FY24, which formally recognises us as having the highest quality Microsoft Certified Trainers in ANZ.
Data Engineers
Fundamental knowledge of data analytics concepts
The supply of this course by Lumify Work is governed by the booking terms and conditions. Please read the terms and conditions carefully before enrolling in this course, as enrolment in the course is conditional on acceptance of these terms and conditions.
