Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Course Outline
Enterprise Architecture and Pipeline Design
- Multi-layer ETL architectures
- Creating modular and reusable components
- Hybrid integration approaches across systems
Advanced Performance Engineering
- Step-level optimization
- Strategies for parallelism and threading
- Monitoring high-load pipelines
Automation, Scripting, and Custom Extensions
- Implementing scripts within transformations
- Developing custom plugins
- Extending PDI functionality using Java and JavaScript
Complex Data Processing and Integrations
- Real-time and streaming integrations
- Working with big data platforms
- Advanced processing of files and APIs
Data Governance, Security, and Compliance
- Securing transformations and credentials
- Ensuring data lineage and traceability
- Addressing regulatory and compliance requirements
Enterprise Orchestration and Scheduling
- Managing large job networks
- Designing error recovery and failover mechanisms
- Orchestrating at the environment level
Repository, Version Control, and CI/CD
- Enterprise repository strategies
- Integrating PDI with Git
- Implementing continuous deployment patterns
Deployment, Monitoring, and Production Operations
- Promoting solutions across different environments
- Utilizing operational tooling and dashboards
- Achieving end-to-end production readiness
Summary and Next Steps
Requirements
- Familiarity with ETL pipelines and data modeling concepts
- Practical experience with intermediate PDI transformations
- Strong proficiency in SQL and scripting
Target Audience
- Senior data engineers
- ETL architects
- Professionals handling complex data integration tasks
21 Hours
Testimonials (2)
Very useful in because it helps me understand what we can do with the data in our context. It will also help me
Nicolas NEMORIN - Adecco Groupe France
Course - KNIME Analytics Platform for BI
It's a hands-on session.