Apache Kafka - Administration

This Apache Kafka - Administration training course provides skills to build and manage Kafka clusters using industry best practices developed by the world’s foremost Apache Kafka experts. You will learn how Kafka and the Confluent Platform work, their main subsystems, their functions, how they interact, and how to set up, manage, and tune your cluster.

Objectives:

• Using Kafka’s command-line tools
• Automating configuration
• Using Kafka’s administrative tools
• Tuning Producer and Consumer performance
• Securing the cluster
• Building data pipelines with Kafka Connect

Pre-Requisites:

• Working knowledge of the Kafka architecture.
• Strong knowledge of Linux/Unix and understand basic TCP/IP networking concepts.
• Familiarity with the Java Virtual Machine (JVM) is helpful.

Course Agenda:

• Fundamentals of Apache Kafka
• Kafka as a Distributed Streaming Platform
• The Distributed Log
• Producer and Consumer Basics
• Apache Kafka Architecture
• Kafka’s Commit Log
• Replication for High Availability
• Partitions and Consumer Groups for Scalability
• Security Overview
• Providing Durability
• Data Replication
• Failure Recovery
• Log Files & Offset Management
• Exactly-Once Semantics (EOS)
• Managing a Cluster
• Installing and Running Kafka
• Configuration Management
• Monitoring
• Log Retention and Compaction
• Commissioning and Decommissioning Brokers
• Optimizing Apache Kafka Performance
• Monitoring, Testing, and Tuning Brokers and Kafka Clients
• The Consumer Group Protocol
• Apache Kafka Security
• Transport Encryption
• Authentication
• Securing Apache Kafka
• Migrating to a Secure Cluster
• Data Pipelines with Kafka Connect
• The Motivation for Kafka Connect
• Types of Connectors
• Kafka Connect Implementation
• Standalone and Distributed Modes
• Configuring the Connectors
• Kafka in Production
• Kafka Reference Architecture for Apache Kafka and the Complete Confluent Platform
• Capacity Planning
• Multi Data Center Deployments