Training Cloudera

Training goals

code: CLOUDERA-CTAK

This four-day instructor-led course begins by introducing Apache Kafka, explaining its key concepts and architecture, and discussing several common use cases. Building on this foundation, you will learn how to plan a Kafka deployment, and then gain hands-on experience by installing and configuring your own cloud-based, multi-node cluster running Kafka on the Cloudera Data Platform (CDP).

You will then use this cluster during more than 20 hands-on exercises that follow, covering a range of essential skills, starting with how to create Kafka topics, producers, and consumers, then continuing through progressively more challenging aspects of Kafka operations and development, such as those related to scalability, reliability, and performance problems. Throughout the course, you will learn and use Cloudera’s recommended tools for working with Kafka, including Cloudera Manager, Schema Registry, Streams Messaging Manager, and Cruise Control.

What Skills You Will Gain

During this course, you learn how to:

  • Plan, deploy, and operate Kafka clusters
  • Create and manage topics
  • Develop producers and consumers
  • Use replication to improve fault tolerance
  • Use partitioning to improve scalability
  • Troubleshoot common problems and performance issues

Who Should Take this Course?

This course is designed for system administrators, data engineers, and developers. All students are expected to have basic Linux experience, and basic proficiency with the Java programming language is recommended. No prior experience with Apache Kafka is necessary.

Conspect Show list

  • Kafka Overview
    • High-Level Architecture
    • Common Use Cases
    • Cloudera's Distribution of Apache Kafka
  • Deploying Apache Kafka
    • System Requirements and Dependencies
    • Service Roles
    • Planning Your Deployment Deploying Kafka Services
    • Exercise: Preparing the Exercise Environment
    • Exercise: Installing the Kafka Service with Cloudera Manager
    • Exercise (optional): Create Metrics Dashboards
    • Exercise (optional): Using the CM API
  • Kafka Command Line Basics
    • Create and Manage Topics
    • Running Producers and Consumers
  • Using Streams Messaging Manager (SMM)
    • Streams Messaging Manager Overview
    • Producers, Topics, and Consumers
    • Data Explorer
    • Brokers
    • Topic Management
    • Exercise: Managing Topics using the CLI
    • Exercise: Connecting Producers and Consumers from the Command Line
  • Kafka Java API Basics
    • Overview of Kafka's APIs
    • Topic Management from the Java API
    • Exercise (optional): Managing Kafka Topics Using the Java API
    • Using Producers and Consumers from the Java API
    • Exercise: Developing Producers and Consumers with the Java API
  • Improving Availability through Replication
    • Replication
    • Exercise: Observing Downtime Due to Broker Failure
    • Considerations for the Replication Factor
    • Exercise: Adding Replicas to Improve Availability
  • Improving Application Scalability
    • Partitioning
    • How Messages are Partitioned
    • Exercise: Observing How Partitioning Affects Performance
    • Consumer Groups
    • Exercise: Implementing Consumer Groups
    • Consumer Rebalancing
    • Exercise: Using a Key to Control Partition Assignment
  • Improving Application Reliability
    • Delivery Semantics
    • Demonstration (optional): ISRs vs. ACKs
    • Producer Delivery
    • Exercise: Idempotent Producer
    • Transactions
    • Exercise: Transactional Producers and Consumers
    • Handling Consumer Failure
    • Offset Management
    • Exercise: Detecting and Suppressing Duplicate Messages
    • Exercise: Handling Invalid Records
    • Handling Producer Failure
  • Analyzing Kafka Clusters with SMM
    • End-to-End Latency
    • Notifiers
    • Alert Policies
    • Use Cases
  • Monitoring Kafka
    • Monitoring Overview
    • Monitoring using Cloudera Manager
    • Charts and Reports in CM
    • Monitoring Recommendations
    • Metrics for Troubleshooting
    • Diagnosing Service Failure
    • Exercise: Monitoring Kafka
  • Managing Kafka
    • Managing Kafka Topic Storage
    • Demonstration (optional): Message Retention Period
    • Log Cleanup and Collection
    • Rebalancing Partitions
    • Cruise Control
    • Exercise: Installing Cruise Control
    • Exercise: Troubleshooting Kafka Topics
    • Unclean Leader Election
    • Exercise: Unclean Leader Election
    • Adding and Removing Brokers
    • Exercise: Adding and Removing Brokers
    • Best Practices
  • Message Structure, Format, and Versioning
    • Message Structure
    • Schema Registry
    • Defining Schemas
    • Schema Evolution and Versioning
    • Schema Registry Client
    • Exercise: Using an Avro Schema
  • Improving Application Performance
    • Message Size
    • Batching
    • Compression
    • Exercise: Observing How Compression Affects Performance
  • Improving Kafka Service Performance
    • Performance Tuning Strategies for the Administrator
    • Cluster Sizing
    • Exercise: Planning Capacity Needed for a Use Case
  • Securing the Kafka Cluster
    • Encryption
    • Authentication
    • Authorization
    • Auditing
Download conspect training as PDF

Additional information

Prerequisites

This course is designed for system administrators, data engineers, and developers. All students are expected to have basic Linux experience, and basic proficiency with the Java programming language is recommended. No prior experience with Apache Kafka is necessary.
Difficulty level
Duration 4 days
Certificate

The participants will obtain certificates signed by Cloudera (course completion).

Upon completion of the course, attendees are encouraged to continue their study and register for the CDP Data Developer exam https://www.cloudera.com/about/training/certification/cdp-datadev-exam-cdp-3001.html

Certification is a great differentiator. It helps establish you as a leader in the field, providing employers and customers with tangible evidence of your skills and expertise.
Trainer

Certified Cloudera Instructor

Other training Cloudera | Cloudera Data Developer

Cloudera show more courses
Training thematically related

Data Analytics and Databases

AI and Machine Learning | AWS

Data Analytics | AWS

Storage | AWS

Cloudera Administrator | Cloudera

Cloudera Data Analyst | Cloudera

Cloudera Data Developer | Cloudera

Data+ | CompTIA

DataSys+ | CompTIA

Foundations | Google Cloud

Microsoft SQL Server | Microsoft

Data Platform | Microsoft

SharePoint | Microsoft

Contact form

Please fill form below to obtain more info about this training.






* Fields marked with (*) are required !!!

Information on data processing by Compendium - Centrum Edukacyjne Spółka z o.o.

PRICE 3000 EUR

FORM OF TRAINING ?

 

TRAINING MATERIALS ?

 

SELECT TRAINING DATE

  • hybrid training: HYBRID
    • General information
    • Guaranteed dates
    • Last minute (-10%)
    • Language of the training
    • English
  • hybrid training: HYBRID
    • General information
    • Guaranteed dates
    • Last minute (-10%)
    • Language of the training
    • English
  • hybrid training: HYBRID
    • General information
    • Guaranteed dates
    • Last minute (-10%)
    • Language of the training
    • English
  • hybrid training: HYBRID
    • General information
    • Guaranteed dates
    • Last minute (-10%)
    • Language of the training
    • English
  • hybrid training: HYBRID
    • General information
    • Guaranteed dates
    • Last minute (-10%)
    • Language of the training
    • English
  • hybrid training: HYBRID
    • General information
    • Guaranteed dates
    • Last minute (-10%)
    • Language of the training
    • English
  • hybrid training: HYBRID
    • General information
    • Guaranteed dates
    • Last minute (-10%)
    • Language of the training
    • English
  • hybrid training: HYBRID
    • General information
    • Guaranteed dates
    • Last minute (-10%)
    • Language of the training
    • English
  • hybrid training: HYBRID
    • General information
    • Guaranteed dates
    • Last minute (-10%)
    • Language of the training
    • English
  • hybrid training: HYBRID
    • General information
    • Guaranteed dates
    • Last minute (-10%)
    • Language of the training
    • English
  • hybrid training: HYBRID
    • General information
    • Guaranteed dates
    • Last minute (-10%)
    • Language of the training
    • English
  • hybrid training: HYBRID
    • General information
    • Guaranteed dates
    • Last minute (-10%)
    • Language of the training
    • English
Book a training appointment
close

Traditional training

Sessions organised at Compendium CE are usually held in our locations in Kraków and Warsaw, but also in venues designated by the client. The group participating in training meets at a specific place and specific time with a coach and actively participates in laboratory sessions.

Dlearning training

You may participate from at any place in the world. It is sufficient to have a computer (or, actually a tablet, or smartphone) connected to the Internet. Compendium CE provides each Distance Learning training participant with adequate software enabling connection to the Data Center. For more information, please visit dlearning.eu site

close

Paper materials

Traditional materials: The price includes standard materials issued in the form of paper books, printed or other, depending on the arrangements with the manufacturer.

Electronic materials

Electronic materials: These are electronic training materials that are available to you based on your specific application: Skillpipe, eVantage, etc., or as PDF documents.

Ctab materials

Ctab materials: the price includes ctab tablet and electronic training materials or traditional training materials and supplies provided electronically according to manufacturer's specifications (in PDF or EPUB form). The materials provided are adapted for display on ctab tablets. For more information, check out the ctab website.

Upcoming Cloudera training

Training schedule Cloudera