Azure Data Lake Storage Gen2 Training Course
Azure Data Lake Storage Gen2 is a comprehensive and highly scalable data storage service offered by Microsoft Azure that provides a platform for analytics workloads.
This instructor-led, live training (online or onsite) is aimed at intermediate-level data engineers who wish to learn how to use Azure Data Lake Storage Gen2 for effective data analytics solutions.
By the end of this training, participants will be able to:
- Understand the architecture and key features of Azure Data Lake Storage Gen2.
- Optimize data storage and access for cost and performance.
- Integrate Azure Data Lake Storage Gen2 with other Azure services for analytics and data processing.
- Develop solutions using the Azure Data Lake Storage Gen2 API.
- Troubleshoot common issues and optimize storage strategies.
Format of the Course
- Interactive lecture and discussion.
- Lots of exercises and practice.
- Hands-on implementation in a live-lab environment.
Course Customization Options
- To request a customized training for this course, please contact us to arrange.
Course Outline
Introduction to Azure Data Lake Storage Gen2
- Overview of Azure Data Lake Storage Gen2
- Key features and benefits
- Azure Data Lake Storage Gen1 vs. Azure Blob Storage
Setting up Azure Data Lake Storage Gen2
- Account creation and configuration
- Understanding the hierarchical namespace
- Data import and export strategies
Security and Access Control
- Implementing authentication and authorization
- Managing access with Azure Active Directory (Azure AD)
- Data encryption methods and best practices
Managing Data and Cost Optimization
- Data lifecycle management with storage tiers
- Performance tuning and optimization
- Cost management and optimization strategies
Integrating with Analytics Services
- Introduction to analytics frameworks compatible with Azure Data Lake Storage Gen2
- Use cases with Azure Databricks, Azure HDInsight, and Azure Synapse Analytics
- Building ETL pipelines using Azure Data Factory
Developer Tools and APIs
- Overview of available APIs and SDKs
- Developing applications using the Azure Data Lake Storage Gen2 API
- Automation and orchestration of tasks
Monitoring, Troubleshooting, and Best Practices
- Tools and techniques for monitoring storage and access patterns
- Troubleshooting common issues
- Best practices for managing and scaling Azure Data Lake Storage Gen2
Summary and Next Steps
Requirements
- Basic understanding of cloud computing principles
- Fundamental knowledge of data storage solutions and databases
Audience
- Data engineers
- Cloud professionals
- Data scientists
Need help picking the right course?
Azure Data Lake Storage Gen2 Training Course - Enquiry
Testimonials (5)
the instructor :)
Jakub - Elsta sp. z o.o.
Course - AZ-900T00 Microsoft Azure Fundamentals
Assimilable form of classes
Marek - Uniwersytet Szczecinski
Course - AZ-104T00-A: Microsoft Azure Administrator
The Exercises
Khaled Altawallbeh - Accenture Industrial SS
Course - Azure Machine Learning (AML)
very friendly and helpful
Aktar Hossain - Unit4
Course - Building Microservices with Microsoft Azure Service Fabric (ASF)
how the trainor shows his knowledge in the subject he's teachign
john ernesto ii fernandez - Philippine AXA Life Insurance Corporation
Course - Data Vault: Building a Scalable Data Warehouse
Upcoming Courses
Related Courses
MS-20487: Developing Microsoft Azure and Web Services (authorized training course)
35 HoursAbout This Course
In this course, students will learn how to design and develop services that access local and remote data from various sources. Students will also learn how to develop and deploy services to hybrid environments, including on-premises servers and Microsoft Azure.
Audience Profile
Primary: .NET developers who want to learn how to develop services and deploy them to hybrid environments.
Secondary: .NET developers with Web application development experience who are exploring developing new applications or porting existing applications to Microsoft Azure.
At Course Completion
After completing this course, students will be able to:
- Describe the basic concepts of service development and data access strategies using the .NET platform.
- Describe the Microsoft Azure cloud platform and its compute, data, and application hosting offerings.
- Design and develop a data-centric application using Visual Studio 2017 and Entity Framework Core.
- Design, implement, and consume HTTP services using ASP.NET Core.
- Extend HTTP services using ASP.NET Core.
- Host services on-premises and in Microsoft Azure.
- Deploy services to both on-premises and cloud environments and manage the interface and policy for their services.
- Choose a data storage solution, cache, distribute, and synchronize data.
- Monitor, log, and troubleshoot services.
- Describe claim-based identity concepts and standards, and implement authentication and authorization with Azure Active Directory.
- Create scalable service applications.
Designing and Implementing an Azure AI Solution (authorized training course AI 100T01)
21 HoursGain the necessary knowledge for designing Azure AI solution by building a customer support chat Bot using artificial intelligence from the Microsoft Azure platform including language understanding and pre-built AI functionality in the Azure Cognitive Services.
AI-102T00: Designing and Implementing a Microsoft Azure AI Solution
28 HoursAI-102 Designing and Implementing an Azure AI Solution is intended for software developers wanting to build AI infused applications that leverage Azure Cognitive Services, Azure Cognitive Search, and Microsoft Bot Framework. The course will use C# or Python as the programming language.
Audience Profile
Software engineers concerned with building, managing and deploying AI solutions that leverage Azure Cognitive Services, Azure Cognitive Search, and Microsoft Bot Framework. They are familiar with C# or Python and have knowledge on using REST-based APIs to build computer vision, language analysis, knowledge mining, intelligent search, and conversational AI solutions on Azure.
Building AI Cloud Apps with Microsoft Azure
35 HoursThis instructor-led, live training in Tunisia (online or onsite) is aimed at intermediate-level to advanced-level professionals who wish to build and deploy AI-powered cloud applications using Microsoft Azure.
By the end of this training, participants will be able to:
- Develop event-driven and serverless applications using Azure Functions.
- Manage Azure storage solutions and virtual machines.
- Deploy and scale web applications using Azure App Service and Docker containers.
- Integrate AI, machine learning, and natural language processing using Azure AI Services.
- Leverage GitHub Copilot to assist in AI-driven cloud application development.
Azure Machine Learning (AML)
21 HoursThis instructor-led, live training in Tunisia (online or onsite) is aimed at engineers who wish to use Azure ML's drag-and-drop platform to deploy Machine Learning workloads without having to purchase software and hardware and without having to worry about maintenance and deployment.
By the end of this training, participants will be able to:
- Write highly-accurate machine learning models using Python, R, or zero-code tools.
- Leverage Azure's available data sets and algorithms to train and track machine learning and deep-learning models.
- Use Azures interactive workspace to collaboratively develop ML models.
- Choose from different Azure-supported ML frameworks such as PyTorch, TensorFlow, and scikit-learn.
Azure Administration for AWS SysOps (authorized training course AZ 010T00)
14 HoursAbout This Course
This two-day course is designed for AWS Sysops administrators interested in learning how Azure is different from AWS, and how Azure is administered. The workshops main topics are Azure Administration, Azure Networking, Azure Compute, Azure Storage, and Azure Governance. This workshop combines lecture with hands-on practical exercises and discussion/review. During the workshop students will build an end-to-end architecture that demonstrates the main features discussed in the course.
Audience Profile
The audience for this course is an AWS Sysops Administrator Associate or equivalent. This person has one to two years of experience in AWS deployment, management, and operations. Students taking this course are interested in learning how Azure is different from AWS, and how Azure is administered. Students may also be interested in taking the AZ-103 Microsoft Azure Administrator certification exam, or the AZ-900 Azure Fundamentals exam.
AZ-020: Microsoft Azure solutions for AWS developers (authorized training course)
21 HoursAbout This Course
A three-day course designed to teach AWS (Amazon Web Services) developers how to prepare end-to-end solutions in Microsoft Azure. In this course you will construct Azure App Service Web App solutions and Azure Functions, use blob or Cosmos DB storage in solutions, implement secure cloud solutions that include user authentication and authorization, implement API management, and develop event- and message-based solutions, and monitor, troubleshoot, and optimize your Azure solutions. You will learn how developers use Azure services, with additional focus on features and tasks that differ from AWS, and what that means for you as you develop applications that will be hosted by using Azure services.
Audience Profile
Students in this course are experienced AWS developers interested in Azure development.
AZ-104T00-A: Microsoft Azure Administrator
28 HoursThis course teaches IT Professionals how to manage their Azure subscriptions, secure identities, administer the infrastructure, configure virtual networking, connect Azure and on-premises sites, manage network traffic, implement storage solutions, create and scale virtual machines, implement web apps and containers, back up and share data, and monitor your solution.
This course is for Azure Administrators. The Azure Administrator implements manages and monitors identity, governance, storage, compute, and virtual networks in a cloud environment. The Azure Administrator will provision, size, monitor, and adjust resources as appropriate.
Microsoft Azure Architect Technologies
35 HoursThis course teaches Solutions Architects how to translate business requirements into secure, scalable, and reliable solutions. Lessons include virtualization, automation, networking, storage, identity, security, data platform, and application infrastructure. This course outlines how decisions in each of these areas affect an overall solution.
Audience profile
This course is for IT Professionals with expertise in designing and implementing solutions running on Microsoft Azure. They should have broad knowledge of IT operations, including networking, virtualization, identity, security, business continuity, disaster recovery, data platform, budgeting, and governance. Azure Solution Architects use the Azure Portal and as they become more adept they use the Command Line Interface. Candidates must have expert-level skills in Azure administration and have experience with Azure development processes and DevOps processes.
AZ-305T00: Designing Microsoft Azure Infrastructure Solutions
28 HoursSkills gained
- Design a governance solution.
- Design a compute solution.
- Design an application architecture.
- Design storage, non-relational and relational.
- Design data integration solutions.
- Design authentication, authorization, and identity solutions.
- Design network solutions.
- Design backup and disaster recovery solutions.
- Design monitoring solutions.
- Design migration solutions.
AZ-400T00-A: Designing and Implementing Microsoft DevOps solutions
35 HoursThis course provides the knowledge and skills to design and implement DevOps processes and practices. Students will learn how to plan for DevOps, use source control, scale Git for an enterprise, consolidate artifacts, design a dependency management strategy, manage secrets, implement continuous integration, implement a container build strategy, design a release strategy, set up a release management workflow, implement a deployment pattern, and optimize feedback mechanisms.
Audience profile
Students in this course are interested in designing and implementing DevOps processes or in passing the Microsoft Azure DevOps Solutions certification exam.
Job role: DevOps Engineer
Preparation for exam: AZ-400
Skills gained
- Plan for the transformation with shared goals and timelines
- Select a project and identify project metrics and Key Performance Indicators (KPI's)
- Create a team and agile organizational structure
- Design a tool integration strategy
- Design a license management strategy (e.g. Azure DevOps and GitHub users)
- Design a strategy for end-to-end traceability from work items to working software
- Design an authentication and access strategy
- Design a strategy for integrating on-premises and cloud resources
- Describe the benefits of using Source Control
- Describe Azure Repos and GitHub
- Migrate from TFVC to Git
- Manage code quality including technical debt SonarCloud, and other tooling solutions
- Build organizational knowledge on code quality
- Explain how to structure Git repos
- Describe Git branching workflows
- Leverage pull requests for collaboration and code reviews
- Leverage Git hooks for automation
- Use Git to foster inner source across the organization
- Explain the role of Azure Pipelines and its components
- Configure Agents for use in Azure Pipelines
- Explain why continuous integration matters
- Implement continuous integration using Azure Pipelines
- Define Site Reliability Engineering
- Design processes to measure end-user satisfaction and analyze user feedback
- Design processes to automate application analytics
- Manage alerts and reduce meaningless and non-actionable alerts
- Carry out blameless retrospectives and create a just culture
- Define an infrastructure and configuration strategy and appropriate toolset for a release pipeline and application infrastructure
- Implement compliance and security in your application infrastructure
- Describe the potential challenges with integrating open-source software
- Inspect open-source software packages for security and license compliance
- Manage organizational security and compliance policies
- Integrate license and vulnerability scans into build and deployment pipelines
- Configure build pipelines to access package security and license ratings
AZ-500T00-A: Microsoft Azure Security Technologies
28 HoursThis course provides IT Security Professionals with the knowledge and skills needed to implement security controls, maintain an organization’s security posture, and identify and remediate security vulnerabilities. This course includes security for identity and access, platform protection, data and applications, and security operations.
Audience profile
This course is for Azure Security Engineers who are planning to take the associated certification exam, or who are performing security tasks in their day-to-day job. This course would also be helpful to an engineer that wants to specialize in providing security for Azure-based digital platforms and play an integral role in protecting an organization's data.
Skills gained
- Implement enterprise governance strategies including role-based access control, Azure policies, and resource locks.
- Implement an Azure AD infrastructure including users, groups, and multi-factor authentication.
- Implement Azure AD Identity Protection including risk policies, conditional access, and access reviews.
- Implement Azure AD Privileged Identity Management including Azure AD roles and Azure resources.
- Implement Azure AD Connect including authentication methods and on-premises directory synchronization.
- Implement perimeter security strategies including Azure Firewall.
- Implement network security strategies including Network Security Groups and Application Security Groups.
- Implement host security strategies including endpoint protection, remote access management, update management, and disk encryption.
- Implement container security strategies including Azure Container Instances, Azure Container Registry, and Azure Kubernetes.
- Implement Azure Key Vault including certificates, keys, and secretes.
- Implement application security strategies including app registration, managed identities, and service endpoints.
- Implement storage security strategies including shared access signatures, blob retention policies, and Azure Files authentication.
- Implement database security strategies including authentication, data classification, dynamic data masking, and always encrypted.
- Implement Azure Monitor including connected sources, log analytics, and alerts.
- Implement Azure Security Center including policies, recommendations, and just in time virtual machine access.
- Implement Azure Sentinel including workbooks, incidents, and playbooks.
AZ-900T00 Microsoft Azure Fundamentals
7 HoursThis instructor-led, live training in Tunisia (online or onsite) is aimed at beginner-level IT professionals who wish to learn about Microsoft Azure and cloud computing.
By the end of this training, participants will be able to:
- Understand basic cloud concepts.
- Identify core Azure services.
- Describe core solutions and management tools in Azure.
- Understand general security and network security features.
- Understand identity, governance, privacy, and compliance features.
- Understand Azure cost management and Service Level Agreements (SLAs).
Building Microservices with Microsoft Azure Service Fabric (ASF)
21 HoursThis instructor-led, live training in Tunisia (online or onsite) is aimed at developers who wish to learn how to build microservices on Microsoft Azure Service Fabric (ASF).
By the end of this training, participants will be able to:
- Use ASF as a platform for building and managing microservices.
- Understand key microservices programming concepts and models.
- Create a cluster in Azure.
- Deploy microservices on premises or in the cloud.
- Debug and troubleshoot a live microservice application.
Data Vault: Building a Scalable Data Warehouse
28 HoursIn this instructor-led, live training in Tunisia, participants will learn how to build a Data Vault.
By the end of this training, participants will be able to:
- Understand the architecture and design concepts behind Data Vault 2.0, and its interaction with Big Data, NoSQL and AI.
- Use data vaulting techniques to enable auditing, tracing, and inspection of historical data in a data warehouse.
- Develop a consistent and repeatable ETL (Extract, Transform, Load) process.
- Build and deploy highly scalable and repeatable warehouses.