Message Brokers

Kafka Cluster using Containers - p3

April 27, 2023 | Category: Message Brokers | Tags: Kafka

Utilities

These are some applications which I find useful in working with the kafka cluster.
All the containers for these apps are running on the fourth server, kfk234.

The compose files can be run from the same directory or each app compose file can have its own directory.

Zoonavigator

kfk234-zoonavigator.yaml …

Kafka Cluster using Containers - p2

April 26, 2023 | Category: Message Brokers | Tags: Kafka

Kafka Schema Registry and REST API

Will bring these two up first and then kafka connect containers as those depend on the registry.

On kfk234 (the fourth server) within the /data/kafka directory on the second drive.

First, an environment file with passwords for certs (the file is in the same …

Kafka Cluster using Containers - p1

April 25, 2023 | Category: Message Brokers | Tags: Certificates Kafka

Building a Kafka cluster using containers

Environment

Four servers running Debian 11

kfk231.domain.dom - 192.168.122.231 - zookeeper, broker, connect
kfk232.domain.dom - 192.168.122.232 - zookeeper, broker, connect
kfk233.domain.dom - 192.168.122.233 - zookeeper, broker, connect
kfk234.domain.dom - 192.168.122.234 - utilities

Docker 23.0.5

All four servers have a root drive and a second …

Building a RabbitMQ server

June 10, 2022 | Category: Message Brokers

Steps for installing on Debian 11 from the Cloudsmith repos

Following the docs here

apt update
apt install curl gnupg apt-transport-https -y

Installing the signing keys

curl -1sLf "https://keys.openpgp.org/vks/v1/by-fingerprint/0A9AF2115F4687BD29803A206B73A36E6026DFCA" | gpg --dearmor | tee /usr/share/keyrings/com.rabbitmq.team.gpg > /dev/null

curl -1sLf https://ppa1.novemberain.com/gpg.E495BB49CC4BBE5B.key | gpg --dearmor | tee /usr/share/keyrings/rabbitmq.E495BB49CC4BBE5B.gpg > /dev/null

curl -1sLf …