Kafka

Kafka Cluster using Containers - p3

April 27, 2023 | Category: Message Brokers | Tags: Kafka

Utilities

These are some applications which I find useful in working with the kafka cluster.
All the containers for these apps are running on the fourth server, kfk234.

The compose files can be run from the same directory or each app compose file can have its own directory.

Zoonavigator

kfk234-zoonavigator.yaml …

Kafka Cluster using Containers - p2

April 26, 2023 | Category: Message Brokers | Tags: Kafka

Kafka Schema Registry and REST API

Will bring these two up first and then kafka connect containers as those depend on the registry.

On kfk234 (the fourth server) within the /data/kafka directory on the second drive.

First, an environment file with passwords for certs (the file is in the same …

Kafka Cluster using Containers - p1

April 25, 2023 | Category: Message Brokers | Tags: Certificates Kafka

Building a Kafka cluster using containers

Environment

Four servers running Debian 11

kfk231.domain.dom - 192.168.122.231 - zookeeper, broker, connect
kfk232.domain.dom - 192.168.122.232 - zookeeper, broker, connect
kfk233.domain.dom - 192.168.122.233 - zookeeper, broker, connect
kfk234.domain.dom - 192.168.122.234 - utilities

Docker 23.0.5

All four servers have a root drive and a second …