Administration of Confluent Apache Kafka Training Course

Module 1: Overview of Confluent Apache Kafka Architecture and Configuration

• The role of Kafka within contemporary data pipelines
• Distinguishing features between Apache Kafka and Confluent Kafka
• Key architectural elements: producers, consumers, brokers, topics, and partitions
• Deployment strategies and scaling factors for Kafka clusters

Module 2: Setting Up the Zookeeper Quorum

• Introduction to Zookeeper
• The function of Zookeeper within a Kafka ecosystem
• Determining appropriate Zookeeper quorum sizes
• Zookeeper parameter configuration
• Establishing SSH connectivity on target servers
• Hands-on: Configuring Zookeeper as a team and as a service
• Utilizing the Zookeeper Command Line Interface (CLI)
• Hands-on: Configuring the Zookeeper Quorum
• The internal file structure of Zookeeper
• Performance variables influencing Zookeeper
• Demonstration of management tools, including Zookeeper and Zoonavigator

Module 3: Configuring the Kafka Cluster

• Fundamental concepts of Kafka
• Core configuration parameters
• Hands-on: Configuring Kafka brokers
• Hands-on: Running Kafka commands
• Hands-on: Setting up a Multi-Broker Kafka Cluster
• Hands-on: Testing Kafka cluster functionality
• Verifying connectivity to the Kafka cluster
• Optimizing the Advertised.listeners setting: a critical parameter
• Topic-specific configuration
• Settings for message ingestion and download within topics
• Hands-on: Demonstrating Kafka resilience
• Performance optimization: I/O operations
• Performance optimization: Network (RED)
• Performance optimization: RAM utilization
• Performance optimization: CPU efficiency
• Performance optimization: Operating System (OS) adjustments
• Performance optimization: Additional factors
• Hands-on: Modifying Kafka broker settings

Module 4: Advanced Kafka Configurations

• Configuring the Landoop Kafka topic UI, Confluent REST Proxy, and Confluent Schema Registry
• Message exchange methods via CLI, Java, and the Spring framework
• Monitoring metrics and utilizing tools such as Confluent Control Center and Elasticsearch
• Managing log files and offset positions
• Strategies for high availability and disaster recovery
• Achieving high availability through data replication
• Optimizing producer and consumer throughput
• Disaster recovery planning
• Controlling failover processes and data restoration
• Configuring Kafka Connectors
• Implementing Kafka Connect
• Enhancing Kafka security features

Conclusion and Recommended Next Steps