1

I have subscribed to a Kafka cluster A with some Kafka engine tables before, and they are working normally. I have created a new Kafka cluster now, but after subscribing to the topics of the new cluster and creating a new Kafka engine table, it cannot work properly.

Kafka cluster A is built in 2.11-2.4.1.

ClickHouse version is 22.1.3.7.

New Kafka cluster is composed of Kafka image. The image is bitnami/kafka:4.0.0.

I'm getting the following error messages:

<Error> StorageKafka (business-topic-name): Consumer error: Local: Required feature not supported by broker.
<Error> StorageKafka (business-topic-name): There were * messages with an error
<Error> StorageKafka (business-topic-name): Only errors left

How can I determine which feature is not supported? I couldn't find anything useful in this error log or in the Kafka broker logs.

Example:

CREATE TABLE IF NOT EXISTS database.table (
    `json` String
)
ENGINE = kafka 
SETTINGS 
    kafka_broker_list = 'host1:port1,host2:port2,host3:port3', 
    kafka_topic_list = 'topic_name',
    kafka_group_name = 'group_name',
    kafka_format='JSONAsString'.

When the table is created and starts working , the error message appears.

1
  • did you look to system.kafka_consumers after table and materialized view creation? Commented Nov 19 at 7:00

0

Start asking to get answers

Find the answer to your question by asking.

Ask question

Explore related questions

See similar questions with these tags.