Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Course Outline
Day 1: Foundations, Architecture, and In-Depth Comparison (ELK vs. OpenSearch)
Morning Session: Core Concepts & Architecture Overview
- Introduction & History:
- Exploring the origins of the ELK Stack (Elasticsearch, Logstash, Kibana)
- The 2021 fork: Understanding why OpenSearch was created (AWS vs. Elastic licensing changes, Apache 2.0 vs. SSPL/Elastic License) - Under the Hood (Shared DNA):
- The Apache Lucene core engine: Shards, segments, inverted indices, and document storage
- Distributed cluster architecture: Nodes (Master, Data, Coordinator), clusters, and cluster state management
- Fundamentals of Data Ingestion and Processing:
- Logstash pipelines, Beats, and modern alternatives (Fluentbit, OpenTelemetry/Data Prepper)
Afternoon Session: Feature Divergence & Ecosystem Differences
- Security & Enterprise Features Comparison:
- Elasticsearch: Limitations of the free tier security versus paid features (SSO, advanced alerting, machine learning, cross-cluster replication tiers)
- OpenSearch: Out-of-the-box free fine-grained access control, internal user database, SAML/LDAP integration, and security plugins - UI & Query Languages:
- Kibana vs. OpenSearch Dashboards: Interface layouts, management tools, and developer experience
- Query Languages: Elasticsearch's ES|QL versus OpenSearch's PPL (Piped Processing Language) and SQL support - Advanced Workloads (Vector Search & AI):
- HNSW implementations, k-NN search performance, and approaches to machine learning integration.
Day 2: Installation, Migration Strategies, Operations, and Troubleshooting
Morning Session: Installation & Cluster Setup
- Deploying OpenSearch:
- System requirements, kernel parameters (vm.max_map_count), and JVM heap tuning
- Bare-metal/VM installation via tarball and package managers
- Containerized deployment using Docker and Docker Compose
- Multi-node cluster bootstrap and security plugin initialization (opensearch-security-install) - OpenSearch Dashboards Configuration:
- Connecting Dashboards to the OpenSearch cluster
- Configuring SSL/TLS certificates and authentication backends
Afternoon Session: Migration Path, Operations & Best Practices
- Migration Strategies (ELK to OpenSearch):
- Assessing current ES version compatibility (best paths from pre-7.10/7.11 versus newer versions)
- Snapshot & Restore Method: Using shared repository storage (AWS S3, NFS) for seamless data transfer
- Reindex-from-Remote & Logstash Rolling Migrations: Managing live data cutovers with minimal downtime
- API and client SDK adjustments (updating endpoints, connection strings, and client libraries) - Lifecycle Management & Operational Differences:
- Elasticsearch ILM (Index Lifecycle Management) versus OpenSearch ISM (Index State Management) syntax and policies
- Rollover, shrinking, downsampling, and index retention strategies - Monitoring, Backup, and Troubleshooting:
- Cluster health APIs, cluster stats, and tracking shard allocation issues
- Common failure scenarios (circuit breaker exceptions, JVM garbage collection pauses, split-brain mitigation)
Q&A and Wrap-up: Open forum for specific company migration roadblocks and architecture reviews
Practical exercises and Hand-On Labs will be a central focus of the course. Participants will gain hands-on experience with OpenSearch deployment, configuration, data ingestion, security, migration, monitoring, and troubleshooting through realistic, real-world scenarios.
Requirements
Participants are expected to have:
- Fundamental knowledge of Linux command-line operations.
- Familiarity with networking concepts such as TCP/IP, HTTP/HTTPS, and DNS.
- A basic understanding of log management and monitoring principles.
- General awareness of containers (Docker) is advantageous but not mandatory.
- Basic practical experience with Elasticsearch or the ELK Stack.
14 Hours
Testimonials (2)
The content is very helpful, and the trainer makes it more easier to understand
Ibrahim Al mayahi - Vastech SA
Course - Advanced Elasticsearch and Kibana Administration
the profesionalism of the trainer; the way he tried to respond to all the questions; the review questions we had to ask: engaging us in conversations
