Azure Data Services

The Azure Data Services course is designed to offer participants a comprehensive understanding of the various data services available within Microsoft Azure, both relational (e.g., Azure SQL Database, PostgreSQL) and non-relational (e.g., Blob Storage, Cosmos DB, Event Hub). Modules cover storage architecture, management, replication, and specific use cases for each service type. Additionally, the course includes practical instruction on using Azure Data Factory to automate and streamline data transfer between different services, enabling participants to design robust data integration pipelines. This training is ideal for backend developers, DBAs, data engineers, and architects aiming to leverage Azure’s diverse data services for efficient data management.

The course begins with an introduction to Azure Data Services and their architectures, followed by an overview of certification paths, pricing, and monitoring. Participants then dive into the specifics of relational storages like Azure SQL Database and PostgreSQL, where they explore data operations, partitioning, replication, and best practices for various use cases.

For non-relational storage, modules cover Blob Storage, Azure Data Lake Storage (ADLS) Gen 1/2, and Cosmos DB, along with caching solutions such as Redis. Each module introduces core functionalities, including read/write operations, replication, and integration scenarios. Participants also learn about Azure Event Hub for real-time data streaming and utilize Azure Data Factory to automate data flows between relational and non-relational storages. Practical exercises reinforce these concepts, helping participants master the diverse capabilities of Azure Data Services.

Upon completion, participants will be able to:

• Understand the architectures, pricing, and monitoring options for Azure Data Services.
• Efficiently use Azure relational databases (e.g., Azure SQL Database, PostgreSQL) for structured data management.
• Work with non-relational storages like Blob Storage, ADLS, Cosmos DB, and Event Hub, covering use cases and data integration.
• Set up and execute data transfer pipelines using Azure Data Factory for seamless data integration across multiple storage solutions.

The course is structured with 60% theory and 40% hands-on practice. Labs focus on configuring storage solutions, performing data operations, and designing integration workflows with Azure Data Factory, ensuring practical application of each Azure data service.

• Understand Azure Data Services Certification processes and gain knowledge of Azure Data Services overview, architecture, pricing, monitoring, and integration capabilities.
• Develop proficiency in relational storages, specifically Azure Database for PostgreSQL and Azure SQL Database, covering topics such as accessing, SQL language, read/write paths, partitioning, replication, and use cases.
• Gain expertise in non-relational storages like Azure Blob Storage, Azure ADLS Gen 1/2, Azure Event Hub, Azure Cosmos DB with Cassandra API, and other storages such as Azure Redis Cache, Azure Table Storage, and Azure File Storage.
• Learn how to start, access, and perform operations like file upload/download, reading/writing, plus understanding replication and use cases for each storage solution.
• Learn how to effectively copy data between Relational and Non-Relational Data Services services using Azure Data Factory, enabling them to efficiently manage and integrate data across different storage solutions.

• Module 1: Intro and certification motivation. Theory 60% Practice 40%, 2 hours.

- Azure Data Services Certification

- Azure Data Services Overview

- Azure Data Services Architecture

- Azure Data Services Pricing

- Azure Data Services Monitoring

- Azure Data Services Integration

• Module 2: Relational storages. Azure Database for PostgreSQL. Theory 60% Practice 40%, 2 hours.

- Starting with Azure Database for PostgreSQL

- Accessing Azure Database for PostgreSQL

- DDL (Data Definition Language) and DML (Data Manipulation Language) with SQL

- Read path

- Write path

- Partitioning

- Replication

- Use cases

• Module 3: Azure Relational storages. Managed SQL Database and SQL Managed Instance Theory 60% Practice 40%, 2 hours.

- Starting with Azure SQL Database

- Accessing Azure SQL Database

- DDL (Data Definition Language) and DML (Data Manipulation Language) with SQL

- Read path

- Write path

- Partitioning

- Replication

- Use cases

• Module 4: Non-Relational. Azure Blob Storage. Theory 60% Practice 40%, 2 hours.

- Starting with Azure Blob Storage

- Accessing Azure Blob Storage

- Upload/Download files

- Read path

- Write path

- Replication

- Use cases

• Module 5: Non-Relational. Azure ADLS Gen 1/2. Theory 60% Practice 40%, 2 hours.

- Why we need Azure ADLS Gen 1/2

- Starting with Azure ADLS Gen 1/2

- Accessing Azure ADLS Gen 1/2

- Upload/Download files

- Read path

- Write path

- Partitioning

- Replication

• Module 6: Ingestion with Data Factory. RDBMS => ADSL. Theory 60% Practice 40%, 2 hours.

- Starting with Azure Data Factory

- Accessing Azure Data Factory

- Creating a pipeline

- Creating a dataset

- Creating a linked service

- Creating a trigger

• Module 7: Non-Relational. Event Hub. Theory 60% Practice 40%, 2 hours.

- Starting with Azure Event Hub

- Accessing Azure Event Hub

- Creating a topic

- Writing to a topic

- Reading from a topic

- Replication

- Use cases

• Module 8: Ingestion with Data Factory. Event Hub => ADSL Gen 2. Theory 60% Practice 40%, 2 hours.

- Starting with Azure Data Factory

- Accessing Azure Data Factory

- Creating a pipeline

• Module 9: Non-Relational. Cosmos DB. Cassandra API. Theory 60% Practice 40%, 2 hours.

- Starting with Azure Cosmos DB

- Accessing Azure Cosmos DB

- Creating a database

- Creating a table

- Writing to a table

- Reading from a table

- Replication

- Use cases

• Module 10: Non-Relational. Other storages: Redis Cache, Table Storage, File Storage. Theory 60% Practice 40%, 2 hours.

- Starting and accessing with Azure Redis Cache

- Creating, Writing and Reading a cache

- Replication

- Use cases

- Starting and accessing with Azure Table Storage

- Creating, Writing and Reading a table

- Replication

- Use cases

- Starting and accessing with Azure File Storage

- Creating, Writing and Reading a file

- Replication

- Use cases