⚙️
Setting Up Cloudera Data Platform(CDP)
  • CDP Overview
  • Why CDP?
  • CDP Services
  • Setting up Google Cloud Platform(GCP) for Cloudera
  • Creating User
  • Configuring Network Settings
  • Configuring Oracle Java
  • Installing Server
  • Configuring MySQL
  • Set Firewall rule on GCP
  • Cloudera Data Platform Installation
  • Working with Cloudera Manager
  • Set Up a Cluster
  • Testing Your Hadoop Installation
  • Installing Hive
  • Hive Validation
  • Deploying Spark 2.4
  • Running Job on Apache Spark2
  • Installing Kafka
  • Kafka Validation
  • Common Warnings and Errors
Powered by GitBook
On this page
  • kafka-console-producer
  • kafka-console-consumer

Kafka Validation

This section describes ways you can use Kafka tools for data capture for analysis.

kafka-topics --create --zookeeper datacouch.training.io:2181/kafka --replication-factor 1 --partitions 1 --topic test

Let's create a topic named "test" with a single partition and only one replica:

kafka-topics --list --zookeeper datacouch.training.io:2181/kafka

kafka-console-producer

Read data from standard output and write it to a Kafka topic. For example:

kafka-console-producer --broker-list datacouch.training.io:9092 --topic test

kafka-console-consumer

Kafka also has a command line consumer that will dump out messages to standard output.

kafka-console-consumer --bootstrap-server datacouch.training.io:9092 --topic test --from-beginning
PreviousInstalling KafkaNextCommon Warnings and Errors

Last updated 3 years ago