All Questions
Tagged with docker-compose apache-kafka
475 questions
0
votes
0
answers
15
views
Incorrect configuration of Kafka in Kraft mode cluster with KAFKA_SASL_MECHANISM_INTER_BROKER_PROTOCOL: SCRAM-SHA-512
Trying to start Kafka in Kraft mode with image: apache/kafka:3.9.0
with next podman compose of config first node:
kafka-1:
hostname: kafka-1
container_name: kafka-1
image: apache/kafka:3....
- 1
0
votes
0
answers
60
views
Issue when attempting to access a container inside and outside Docker environment
I'm having an issue when using the landoop/fast-data-dev image on Docker. I have the following docker-compose file:
version: "3.8"
networks:
minha-rede:
driver: bridge
services:
...
1
vote
1
answer
46
views
Docker connection between Kafka and Bytewax refused
I want to consume a stream from Kafka using Bytewax to perform aggregations. Unfortunately I'm not able to connect to Kafka and the connection is always refused. I assume something with the port setup ...
- 27
0
votes
0
answers
24
views
kafka setup from docker-compose
Hi I'm currently setting up Kafka with Docker. If I mention like below in docker-compose, I am able to expose Kafka container to non-dockerized applications but docker applications are not able to ...
- 171
0
votes
0
answers
35
views
Settings involved for extremely short Kafka log retention
I am running a Kafka controller and broker in a docker container on a physical server and I am trying to set retention period for the messages. My use-case requires the messages to be deleted ...
- 13
0
votes
0
answers
45
views
Error starting Kafka Broker in a Kraft Cluster
I would like to set up 3 Brokers and 3 Controllers with option to expanding.
Here is my Docker Compose file:
services:
# 📌 Controller-1
kafka-controller-1:
image: bitnami/kafka:latest
...
- 31.5k
0
votes
0
answers
119
views
Error configuring Kafka with KRaft mode using only the broker role
I am trying to set up Kafka in KRaft mode. To do this, I am using a docker-compose file with the following content:
services:
kafka:
image: confluentinc/cp-kafka:7.4.0
container_name: kafka
...
1
vote
1
answer
44
views
Is it possible to create kafka topics without additional service in docker-compose?
I want to create and configure kafka topics on startup in docker-compose. I can do it with help of additions service (see init-kafka).
Is it possible to create kafka topics without additional service? ...
- 1,890
0
votes
1
answer
84
views
How docker map env variable to kafka broker variable?
I'm new to Docker, and trying to understand how it works
Reading this Kafka docker Image
https://github.com/conduktor/kafka-stack-docker-compose/blob/master/zk-multiple-kafka-single.yml
Here you can ...
- 600
0
votes
0
answers
33
views
Kafka installation issue while installing Scorpio broker using docker compose
I am trying to install scorpio broker on a Ubuntu machine. Scorpio broker requires supporting applications like Kafka and postgres.
I tried to use the docker compose files provided in the GitHub for ...
0
votes
0
answers
54
views
Docker containers doesnt start after docker-compose - kafka , zookeeper and debezium
Iam new to docker, I have utilized almost 7.7 GB of my 8 GB memory. I have to runkafka-ui , schema registry, kafka , zookeeper , debzium , pyspark for an etl process. I couldnt run all of them ...
0
votes
1
answer
103
views
Docker port mapping: why Kafka doesn't work with local machine port other than 9092?
Windows 10 Pro. Docker v27.4.0.
My C# application works with Kafka message broker. Kafka works in the docker container on my local machine.
If I use 9092 port on my local machine for port mapping (in ...
- 12.5k
1
vote
0
answers
25
views
Spring boot app cannot connect with Kafka within the container
In short
To repeat the issue, you may clone the project from:
https://github.com/ethanalef/event-driven-model
Then build both listener and publisher projects with maven, build the image with ...
- 75
1
vote
0
answers
93
views
AdminClient clientId=adminclient-1 Node 1 disconnected. Apache Kafka y Spark
I'm running a Docker Compose setup with Spark and Kafka, but I'm encountering connectivity issues when Spark tries to connect to Kafka. My docker-compose.yml file includes services for both Kafka and ...
1
vote
0
answers
63
views
Build Aiven's Plugins for Remote Storage into the Bitnami/Kafka Image
I have written this Dockerfile to build a custom Kafka image with remote storage to Minio S3, using Bitnami's Kafka image and Aiven's plugins:
FROM bitnami/kafka:3.9.0
USER root
RUN mkdir -p /opt/...
