top of page

Data Lakes with Microsoft Azure

Roman Echeverria
Jul 7, 2021
2 min read

Updated: Jul 8, 2021

Start Date: 4/Oct/2021

Seats: 20

Language: Spanish

Location: Remote (Zoom)

Duration: 12 hours


Description:

In this course you will learn all the concepts related to Microsoft Azure, from begginer to expert. By The end of the course you will feel confident to start building Azure Data Lake architectures for your organization.


Some of the concepts we will review through the course are: Microsoft Azure Data Lake

,Different tools and scenarios to ingest data in to Data Lake, Data Lifecycle and Architecture around Data Lake, Use Azure Databricks and HDInsight to process data in ADLS, Five layers of security to protect Data Lake, Monitor the performance of your Data lake, Data Lake optimization Strategy.



Course content:


1.Azure Cloud Computing


Azure free subscription

Azure Portal Overview

Azure Services Overview

Resource Management group and Subscription

Resource Groups

Tagging


2.Azure Data Lake


What is Data Lake

Data Lake vs Hadoop

How Data Lake Gen 2 evolved

Azure Data Lake vs Azure Blob storage

Provision Azure Data Lake Gen2 Account

Azure Data Lake Gen 2 account overview

Hierarchical namespace

Other Features


3.Data Ingestion


Tools to Ingest Data in Data Lake

Azure Blob storage to Data Lake Gen2 using Data Factory

SQL Server to Data Lake Gen2 using Data Factory

Amazon S3 to Data Lake Gen2 using Data Factory


4.Azure Data Lake and Databricks


Overview

Provision Databricks, Clusters and workbook

Mount Data Lake to Databricks DBFS

Explore, Analyze, Clean, Transform and Load Data


5.Data flow around Data Lake


Data flow around Data Lake

Data Lake and Transient clusters


6.Azure Data Lake and HDInsight


Overview

Create Azure Data Lake Storage Gen 2 (source) and SQL Server (destination)

What is Managed Identity

Add Managed Identity to Gen2 and Database accounts

Create HDInsight Interactive Query Cluster

Ambari overview and UI

Ingest dataset in to DataLake storage

Data Extraction with Hive

Data transformation with Hive

Data Export using Sqoop


7.Data Lake Monitoring and Optimization


Activity Log

Demo Activity Logs

Metrics

Insights

Alerts

Diagnostic settings

Optimization


8.Security Layers in Data Lake


Introduction

Storage Access Keys

SAS - Shared Access Signature

Azure Active Directory

Access Control List (ACL)

Firewalls and Virtual Networks

Encryption in Transit

Encryption at Rest

Advanced threat protection

 
 
 

Comments


Commenting on this post isn't available anymore. Contact the site owner for more info.
Data Creed - Black Background.png

©2027 Data Creed

bottom of page