Description:
Learn how to automate ETL (Extract, Transform, Load) testing using Python. This comprehensive course covers all the
fundamental concepts and techniques needed to perform efficient and effective testing on ETL processes. You'll gain
hands-on experience with various automation testing tools and libraries, along with practical examples and real-world scenarios.
Key Highlights:
- Master ETL testing methodologies
- Automate data validation and verification
- Utilize Python libraries for ETL testing
- Apply best practices for testing ETL processes
What you will learn:
- Learning Outcome 1
Understand the fundamental concepts of ETL testing and its importance in the data integration process.
- Learning Outcome 2
Learn how to design and execute test cases for ETL processes to ensure data accuracy, completeness, and reliability.
- Learning Outcome 3
Explore various Python libraries and tools used for automating ETL testing, such as PyTest, Pandas, and SQL Alchemy.
- Learning Outcome 4
Implement data validation techniques and perform comprehensive data checks to identify anomalies or discrepancies in ETL pipelines.
- Learning Outcome 5
Apply best practices and strategies to enhance the efficiency and effectiveness of ETL testing, including error handling, logging, and reporting.
SQL - Intermediate & Advanced - Quick Revision
Group By |
Group By + Having |
Date Functions, |
Agg. Functions, |
Data Type Handling |
Constrations |
Unions |
Sub Query & Co-related Sub Query |
Joins |
Row Number, Rank, Dense Rank |
Common Table Expression |
Case statement |
ETL DWH Testing - Quick Revision
Introduction to ETL Testing |
Advantage of ETL Testing |
Why ETL Testing has open scope in future |
ETL Testing Ojbectives |
ETL Testing Types |
ETL Testing Process |
Common Challenges in ETL Testing |
Best Practices for ETL Testing |
Datawarehouse Concpets and realtime use |
Python
About Python |
Advantage of Python |
Variables & Data Types |
Control Structure
|
Functions |
Data Structure
- Lists,
- Tuples,
- Sets,
- Dictionaries
|
File Handling |
Exception Handling |
Modules & Packages |
Object-Oriented Programming
- Classes,
- Objects,
- Inheritance
|
Standard Libraries |
Data Science and Machine Learning
|
Python Key libraries:
- pandas
- numpy
- sqlalchemy
- pytest
- great_expectations
- unittest
|
ETL Autmation Testing
Test Plan |
Prepare Automation Framework Architecture using PyTest
- Prepare Test Scripts
- Prepare Test Data
- Setup Test Environment
- Data Completeness Testing
- Data Integration Testing
- Sources & Targets - CSV, Database & AWS
- Transformation Rule
- Lookup Rules & Other Calculations
- Data Quality Testing
- Null Check
- Duplicate check
- Checksum check
- Agg. Check
- Data Format Check
- Data Type Validation Check
- Data Consistency Check
- Metadata Testing
- Error Logging
- Error Handling
- Data Cleaning
- Automating
- Scheduling
- Reporting
- Execution Report
- Test Report
|
Sources & Targets Integrated with Framework:
|
Benefits of This Training
Upskilling with Most Demanded Tech. |
You will Get a Smart Salary Increase and lots of opportunities will open for you. |
You will secure your future for next 8-10 years |
You will get a Completion Certificate from FTS |
You will get weekdays Interview Preparation Session |
CV Preparation |
Lifetime recording access |
After successful purchase, this item would be added to your Library.
You can access the library in the following ways :
- From Computer, you can access your library after successful login
- For other devices, you can access your library using this web app through browser of your device.
Review
me
star
star
star
star
star