Apache Kafka For Developers Training Course

Overview

Apache Kafka is an open-source distributed event streaming platform that provides tools for building real-time streaming data pipelines and applications. This instructor-led, live training (online or onsite) is aimed at intermediate-level developers who wish to develop big data applications with Apache Kafka.

By the end of this training, participants will be able to:

• Develop Kafka producers and consumers to send and read data from Kafka.

• Integrate Kafka with external systems using Kafka Connect.

• Write streaming applications with Kafka Streams & ksqlDB.

• Integrate a Kafka client application with Confluent Cloud for cloud-based Kafka deployments.

• Gain practical experience through hands-on exercises and real-world use cases.

Format Of The Course

• Interactive lecture and discussion.

• Lots of exercises and practice.

• Hands-on implementation in a live-lab environment.

Course Customization Options

• To request a customized training for this course, please contact us to arrange.

Course Outline

Introduction

• Overview of Apache Kafka

• Introduction to event streaming and real-time data processing

• Overview of Apache Kafka and its features

• Use cases and benefits of Kafka in modern application development

Understanding Kafka Architecture and Core Concepts

• Kafka architecture: brokers, topics, partitions, and replicas

• Producers and consumers: publishing and consuming messages

• Understanding the role of ZooKeeper in Kafka

Kafka Topics and Partitions

• Topic creation and configuration

• Understanding partitions and their implications

• Replication and fault-tolerance in Kafka

Kafka Producers

• Creating Kafka producers using various programming languages

• Message serialization and serialization techniques

• Producer configurations and best practices

Kafka Consumers

• Developing Kafka consumers using different programming languages

• Configuring consumer groups and offsets

• Strategies for message processing and delivery guarantees

Integrating Kafka with External Systems using Kafka Connect

• Overview of Kafka Connect and its connectors

• Configuring and using Kafka Connect for data integration

• Integrating Kafka with external systems

Writing Streaming Applications with Kafka Streams & ksqlDB

• Introduction to Kafka Streams and its stream processing capabilities

• Developing stream processing applications with Kafka Streams

• Using ksqlDB for real-time data processing and analytics

Integrating a Kafka Client Application with Confluent Cloud

• Overview of Confluent Cloud and its features

• Configuring and connecting a Kafka client application with Confluent Cloud

Kafka Security

• Introduction to Kafka security features

• Configuring SSL/TLS for secure communication

• Authentication and authorization mechanisms in Kafka

Monitoring and Operations

• Monitoring Kafka using metrics and tools

• Managing Kafka clusters and resources

• Troubleshooting common issues and performance tuning

Best Practices and Real-world Use Cases

• Best practices for designing Kafka-based applications

• Case studies and examples of Kafka implementations in various industries

• Best practices for building scalable and fault-tolerant Kafka architectures

Requirements

• Basic programming knowledge

Audience

• Developers

• Programmers