ETL Automation Testing with Python

Become an expert in automating ETL testing using Python

5.0 (1265 ratings)
Language : English
Validity Period : Lifetime
₹28,500 35% OFF

₹18,500/- Excluding 18% GST

Key Highlights

25 hours on-demand video

Access on mobile, TV & Laptop

12 Sessions

CV Preparation

Mentor Support

Lifetime Free Upgrade

Lifetime Recording Access

Certificate of completion

▶Description:

Part-1: Python From Basic To Advanced (12 Sessions | 24 Hours)

▶ Session-1: Python Environment Setup and Basics of Python

▶ Session-2: Basics of Python

▶ Session-3: Condition Handling & Logical OR / AND in Python

▶Session-4: Loops in Python (While, For, Continue, Break) – Heavy Usage in ETL & Data Analytics

▶Session-5: Data Structures (List, Tuple, Dictionary) - Heavy Usage in ETL & Data Analytics

▶Session-6: Functions - Heavy Usage in ETL & Data Analytics

1. What is a Function? A block of reusable code Improves readability and maintainability Avoids code duplication Core concept for ETL validations Reporting logic Framework utilities
2. How to create a function?
3. Rules to Create a Function
4. Types of Functions Function Without Parameters Function With Parameters Function With Return Value Function With Multiple Return Values
5. Arguments: Required Arguments Keyword Arguments Default Arguments
Class Notes
Assignment

▶ Session-7: File Handling in Python - Heavy Usage in ETL & Data Analytics

▶ Session-8: Exception Handling in Python

1. Introduction to Exception Handling What is an Exception? Why Exception Handling is Required
2. Exception Handling Blocks Try and except Multiple except blocks else and finally
3. Common Built-in Exceptions ZeroDivisionError ValueError TypeError IndexError KeyError
4.Exception Handling with Purpose of with Keyword Context Managers (Basic Concept) File Handling using with How with Automatically Handles Exceptions Difference between with and try–finally
5. Basic Best Practices Handle specific exceptions Avoid empty except Use with for resource management
Class Notes
Assignment

▶ Session-9: Objects & Classes in Python

▶ Session-10: Inheritance in Python

1. What is Inheritance? Concept of Parent and Child Class Benefits of Inheritance Code Reusability
2. Types of Inheritance in Python Overview of Inheritance Types
3. Single Inheritance One Parent → One Child Simple Real-time Example
4. Multilevel Inheritance Parent → Child → Grandchild Inheritance Chain Concept
5. Multiple Inheritance Multiple Parent Classes Multiple Parent → One Child Use of super()
Class Notes
Assignment

▶Session-11: Constructors & Packages in Python

▶Session-12: Built-in Functions & String Formatting (f-Strings)

Part-2: Pandas for ETL Automation & Data Analysis (1 Session | 2 Hours)

▶Session-13: Pandas for ETL Automation

1. Introduction to Pandas
2. Why Pandas is used in ETL Automation?
3. Pandas vs Core Python
4. Reading Data from Files (CSV files, Excel files, JSON files)
5. Data Filtering & Sorting: Filtering rows using conditions Selecting specific columns Sorting data
6. Reading Data from Files (CSV files, Excel files, JSON files) Why joins are required in ETL Types of joins (Inner, Left, Right, Outer)
7. Data Comparison (File vs File / File vs DB)
8. Aggregation Validations
Class Notes
Assignment

Part-3: Logging & Reporting (1 Session | 2 Hours)

▶Session-14: Logging & Validation Reporting for ETL Automation

1. Introduction to Logging
2. Why logging is required in ETL automation
3. Difference between: print() vs logging Importance of logs in Debugging Auditing Production support
4. Python Logging Module Overview of logging module Logging components: (Logger, Handler, Formatter)
5. Log Levels INFO – General execution flow DEBUG – Detailed validation steps ERROR – Failures & exceptions
6. Creating Execution Logs Logging at Framework start & end Validation start & end File read / DB connection Exception handling Log file naming strategy: Date-based Execution-based
Class Notes
Assignment

Part-4: PyTest for ETL Automation & Test Reporting (1 Session | 2 Hours)

▶Session-15: PyTest Framework for ETL Automation

1. Introduction to PyTest
2. PyTest Installation & Project Structure
3. Rules for Using PyTest
4. Test Functions
5. Assertions
6. Fixtures
7. Parameterization Handling
8. Markers
9. Test Execution & Reports
Class Notes
Assignment

Part-5: Create End to End Config Driven Hybrid ETL Automation Testing Framework (5 Sessions, 10 Hours)

▶Session-16 (Framework Day-1): Automate Direct Move Columns & Extract Failures (Single Table)

Objective: Build the foundation of ETL automation using row-level and cell-level validation.
1. Automate Direct Move Columns Row-by-row validation Cell-by-cell data comparison
2. Identify mismatches between Source and Target
3. Capture failures dynamically
4. Generate Excel Failure Report - Not Matched Records From Source & Target
5. Generate Excel Failure Report - Column Level Mismatches From Source & Target
6. Extract only mismatched records
Class Notes
Assignment

▶Session-17 (Framework Day-2) : Extend Framework with All Validations and Extract Colorful Failure Report (Single Table)

Objective: Enhance the framework with industry-standard ETL validations.
1. Direct Move Column Validation Row-by-row Cell-by-cell
2. Record Count Validation
3. Duplicate Records Check
4. Null Value Check
5. Metadata Validation
6. Referential Integrity Validation
7. Transformation Rule-1
8. Transformation Rule-2
9. Data Quality Validations
10. Generate Colorful Excel Failure Report
11. Highlight mismatches in Failure Excel Report
12. Separate validation-wise Failure Report
Class Notes
Assignment

▶Session-18 (Framework Day-3) : Extend Framework for Multiple Tables

Objective: Scale the framework to support multiple tables seamlessly.
1. Apply all validations across multiple tables
2. Direct Move Column Validation
3. Record Count Check
4. Duplicate Check
5. Null Check
6. Metadata Validation
7. Transformation Rule-1
8. Transformation Rule-2
9. Referential Integrity Validation
10. Data Quality Validations
11. Generate Consolidated Colorful Failure Report Table-wise validation results Easy defect analysis
Class Notes
Assignment

▶Session-19 (Framework Day-4 ): Config-Driven Framework for All Data Layers For All Tables

Objective: Introduce configuration-based execution across Data Lake layers.
1. Layer-wise Validations Source → Bronze Bronze → Silver Bronze → Gold
2. Execute all validations across all layers
3. Config File Driven Execution Enable/Disable validations Control execution at Layer level Table level Validation level Generate Excel Failure Report Test Execution Summary Repor
Class Notes
Assignment

▶Session-20 (Framework Day-5): Logging & Modular Hybrid Framework

Objective: Convert the framework into a production-ready hybrid ETL automation framework.
1. Layer-wise Validations: Source → Bronze Bronze → Silver Bronze → Gold
2. Modular & reusable framework design
3. Centralized Logging Track each step of execution Debugging & audit support
4. Fully Config-Driven Execution Control
5. Generate Colorful Excel Failure Report Detailed Test Execution Report Execution status & metrics
Class Notes
Assignment

Part-5: Create End to End Config Driven Hybrid ETL Automation Testing Framework (5 Sessions, 10 Hours)

▶Session-21 : ETL Automation CV Preparation & Interview Alignment

Other Courses

BigData Automation Testing
5.0 (1853 ratings)
Enrolled - 3539

₹25,000 ₹22,000/-

API Testing
5.0 (1265 ratings)
Enrolled - 2743

₹12,000 ₹6,500/-

With 18 years of experience in the IT industry, our team of experts has established itself as a trusted authority in trending technologies.

Important Links

Packages - Live Sessions

Premium Package

ETL Automation Testing with Python

ETL Testing Package

Most Trending Package

Data Analytics

GET IN TOUCH

₹18,500/- Excluding 18% GST

Key Highlights

C-25, Sector 58, Noida
Uttar Pradesh 201301

hr@futuretechskills.in

1. Advantages of Python
2. Environment Setup Download and install Python Download and install PyCharm Verify Python installation Configure Python interpreter in PyCharm
3. Creating Python Project in PyCharm Properties Data Type Check Row Count Option Shared Key Ignorable columns Duplicate Options
4. Creating First Python File
5. Writing First Python Program
6. Execute Python Program – 4 Ways Run from PyCharm Run using Python console Run from Command Prompt Run using terminal
7. Python & PyCharm Software
Class Notes
Assignment

1. Python Indentation
2. Variables & Constants in Python
3. Comments in Python Single-line comments (#) Multi-line comments
4. String Handling Basics String concatenation String methods (basic) Real-time usage examples
5. User Input Handling
6. Type Casting
7. Case Sensitivity in Python
Class Notes
Assignment

1. Loops in Python Why loops are required Importance of loops in ETL Automation
2. While Loop Executes until a condition becomes false Best used when number of iterations is unknown
3. For Loop Used when number of iterations is known For Loop – Final Value For Loop – Starting Value & Final Value For Loop – Start, End & Increment For Loop with Decrement For Loop with List For Loop with Tuple
4. For Loop – continue Skips the current iteration
5. For Loop – break Stops the loop completely
Class Notes
Assignment

1. OOP Concepts in Python
2. Objects & Classes Creating a Class Creating an Object _init_() Constructor Instance Variables vs Class Variables Methods in a Class
3. Python Modules What is a Module? Built-in Modules User-defined Modules
4.Import Statements import module_name from module_name import function/class
Class Notes
Assignment

You may also be interested in

₹18,500/- Excluding 18% GST

Key Highlights

C-25, Sector 58, Noida Uttar Pradesh 201301

hr@futuretechskills.in

C-25, Sector 58, Noida
Uttar Pradesh 201301