All Questions
187 questions
1
vote
1
answer
40
views
Early(?) Triggering of Flink's Event Time Windows and Non-Deterministic Results
I'm reading a small sample of data stored in a Kafka but instead of applying watermarks directly to the source I do some processing on the data then extract the event timestamps.
I then apply event ...
- 39
0
votes
1
answer
379
views
Java Flink NoClassDefFoundError org/apache/flink/shaded/guava30/com/google/common/io/Closer
I have a Java 21 application that uses Apache Flink (version 1.20.0) dependencies for filtering kafka stream.
When I try executing my program I get the following error:
[flink-pekko.actor.default-...
- 25
-1
votes
1
answer
39
views
Start Timer on Event and trigger another event after timer in flink, Java
I want to know whether there is a timer in Flink and how I would go about implementing it in this scenario. Currently I am receiving data which contains geolocation, speed etc. from vehicles. For each ...
- 31
0
votes
0
answers
113
views
Apache Beam, Flink Runner, Clickhouse, Kafka, Java - pipeline isn't running
I'm trying to create a pipeline with Apache Beam and FlinkRunner to read messages from Kafka topic and to save them to ClickHouse DB.
When I run program via maven:
mvn exec:java -Dexec.mainClass=com....
- 111
1
vote
1
answer
142
views
org.apache.kafka.common.errors.UnsupportedVersionException
Tried to upgrade Flink version from 1.14.2 to 1.17.1 for an already running application. The application has source and sink as Kafka (different topics same cluster). After upgrading the version the ...
- 11
0
votes
1
answer
74
views
kafka produce message when condition is met in all messages having eventTime between ts to ts -1 min
I want process kafka messages where I receive data in non linear format considering eventTime
I want to produce message to new topic, after receiving message in below JSON format and if I get a ...
-1
votes
1
answer
2k
views
Flink-connector-kafka giving Caused by: java.lang.NoClassDefFoundError: Could not initialize class org.apache.kafka.clients.admin.AdminClientConfig [duplicate]
I am working on project for with flink-kafka-connector and using below dependency in my pom
<dependency>
<groupId>org.apache.flink</groupId>
<artifactId>flink-connector-...
- 539
0
votes
1
answer
645
views
Flink kafka consumer group.id not works
I use apache fink with FlinkKafkaConsumer, I have 2 consumer read 1 topic(1partition). At one time, both consumers read the same event. I expect consumer1 receive event1, consumer2 can not receive ...
- 11
0
votes
2
answers
101
views
How to capture the values of a list inside json using regex
I have a json part of which contains this:
{"tokenType":"email","tokenList":["token1","token2","token3","token4"]}
I have a flink ...
2
votes
2
answers
334
views
Flink job not printing expected output from Kafka Source
I am working on a Flink job that reads data from a Kafka source, processes it using CEP patterns, and prints alerts to the console. However, when I run the Flink job using the following command:
./bin/...
- 346
1
vote
1
answer
885
views
Flink Job ClassNotFoundException: org.apache.flink.connector.kafka.source.KafkaSource
I'm trying to run a Flink job using Apache Flink version 1.16.2, and I'm encountering the following error when executing my job using ./bin/flink run /Users/spartacus/icu-alarm/target/flink-kafka-...
- 346
0
votes
0
answers
29
views
Flink CEP: Import Errors and Type Mismatches in Stroke Risk Alarm Application
I'm working on a project that uses Apache Flink's Complex Event Processing (CEP) to create a stroke risk alarm system. However, I'm encountering several issues in my Java code, and I'm seeking help to ...
- 346
0
votes
0
answers
473
views
Problems with sink on flink
[enter image description here][1] I could do this to try first, this works well this just print the data on another topic I trie to follow the same logic but don get the result
package org.example;
...
- 3
0
votes
1
answer
141
views
Logs of Kafka payload in Table Api connector of Apache Flink
I am using the upsert-kafka table API connector of Apache Flink to consume events from a kafka topic, I want to log the kafka payloads that are consumed , is there a way to log it.
My code looks as ...
- 45
1
vote
1
answer
566
views
Can I use a flink job to split and send data to multiple jobs according to the incoming data via kafka?
I'm new to Flink. So, this is a flink job which consumes data from kafka and split the data according to some keys and values.
This is the SplitJob Class
public class SplitJob {
public static void ...
- 11