7,956 questions
-7
votes
0
answers
34
views
In pyflink ,yarn can not get python level log, only java log. how can I get python level log [closed]
enter image description here
This log is from jobmanager.log.
The log only tells me "Python process exits with code: 1"
I do not know why does the process exit.Where can i find the detailed ...
0
votes
1
answer
46
views
With flink-connector-mongodb, it takes too long to get data
I'm trying to configure a batch process using apach flink connector mongodb.
It takes almost 10 minutes to retrieve one item from mongodb using flink-connector-mongodb.
If no conditions are given in ...
0
votes
2
answers
43
views
collector.collect (not in main thread ) seems to skip data somehow
We put the message to threadpool immediately after current operator recevived it, and pass the collector object to the threadpool. it worked well after flink started, then we found that the next ...
0
votes
0
answers
23
views
Flink SQL TaskExecutor Error: No Allocated Slots Despite Slot and Memory Configurations
I’ve been trying to create a table using the sqlserver-cdc connector in Flink with the following query:
CREATE TABLE files (
Id INT,
FileName STRING,
FileContent STRING,
CreatedAt TIMESTAMP(3),...
0
votes
0
answers
20
views
Over Windows in Batch Mode
In the below minimal working example (executed with Flink v. 1.20), the use over an over_window in batch_mode always yields the following error message, although the time column is TIMESTAMP(3):
org....
0
votes
0
answers
11
views
RabbitMQ Source connector in apache Flink is a bottleneck for our streaming app
We have a flink rmq source connector that is ingesting messages from a queue. We have been facing problems lately with ingestion during peak traffic hours. We have not seen this issue in the past.The ...
0
votes
1
answer
25
views
Using Flink's state as a cache
I'm trying to use state as a cache for my Flink job. I will have a counter stored in the state for each key ( I'm using keyed stream) then I have to validate my event against this counter to decide if ...
- 1
1
vote
1
answer
39
views
Early(?) Triggering of Flink's Event Time Windows and Non-Deterministic Results
I'm reading a small sample of data stored in a Kafka but instead of applying watermarks directly to the source I do some processing on the data then extract the event timestamps.
I then apply event ...
- 39
0
votes
1
answer
57
views
Flink Scheduled JDBC Source
I have the following definition of the JDBC source in Apache Flink.
val jdbcSource = JdbcSource.builder<LoggedInEvent>()
.setDBUrl("jdbc:postgresql://db:5432/postgres")
....
- 4,349
-1
votes
2
answers
88
views
Flink CDC fails to read OceanBase (MySQL mode) binlog: Timeout to receive log messages in LogProxyClient.RecordListener [closed]
I am using Flink CDC to capture binlog changes from OceanBase (Mysql mode), but I encountered the following error after running for a while:
com.oceanbase.clogproxy.client.exception....
0
votes
1
answer
35
views
Flink CDC Task Frequently Failing - has no more allocated slots for job
I'm running a Flink CDC job (version 3.0.0) that synchronizes data from MySQL 8.0.35 to Apache Doris, but it keeps failing with the error Could not allocate the required slot within timeout. Has no ...
1
vote
0
answers
32
views
Get Exception after submit the pyFlink Job
I am a new for pyflink. I try to run submit a simple python to YARN application mode. But I got the error said cannot find the python file word_count.py. Below is my environment and the exception log. ...
- 61
0
votes
0
answers
57
views
Why Flink States in rocksdb are not retaining from checkpoints after a runtime failure?
I am running a Flink job for a use case of joining Adwords info and user events. I need to store those ad specific events in state to join with Adwords data that arrives late.
After a failure , the ...
2
votes
0
answers
35
views
Flink SQL issue with unnest - output is changed by function
I am trying to work with api.countrylayer.com payload which returns a JSON list of countries. The JSON batch list should be split by each country for further processing. Therefore I am using the ...
- 21
0
votes
0
answers
25
views
Type org.apache.flink.streaming.api.graph.StreamGraphGenerator$ContextImpl is not a nest member of StreamGraphGenerator
I am trying to run my flink application in aws managed flink cluster (engine : vera-1.0.6-u1-flink-1.17)
Stuck at this error from past 2 days. Any leads is very much appreciated
My pom.xml is
<?xml ...
