434 questions
2
votes
1
answer
59
views
Deserializing ScalaPB enum from int value and class
I am currently working on a Kryo SerDe for scalaPB (similar to twitter 'chill').
I struggle implementing the read interface
override def read(
kryo: com.esotericsoftware.kryo.Kryo,
input: ...
- 888
0
votes
0
answers
56
views
ehcache 3 - Java config for spring boot with Kryo & Persistence
I tried different approaches but each time getting new errors. I'm trying to
Configure Encache via java
have disk persistance
Effcient serializer like Kryo
Any help appreciated
EhcacheConfig.java
...
0
votes
1
answer
198
views
Error while deserializing null values in Flink application
I am testing a Flink job that reads data from Kafka and writes to files.
When running an integration test with Junit, I get the following error: Caused by: java.lang.IllegalAccessError: class com....
- 3,630
1
vote
1
answer
54
views
nullpointerexception inside java.xml after kryo serialization
I am writing data including some XML nodes (org.w3c.dom.Node) to a spark rdd which results in the data getting serialized and deserialized with kryo. For most nodes that works without issues and I am ...
- 21
1
vote
0
answers
163
views
com.esotericsoftware.kryo.KryoException: java.lang.IllegalArgumentException: Class is not registered: java.util.Collections$UnmodifiableMap
I'm using Kryo 5.6.0 with java 1.8, While serializing with class registration getting below Exception
com.esotericsoftware.kryo.KryoException: java.lang.IllegalArgumentException: Class is not ...
- 11
0
votes
1
answer
105
views
Hive on Tez insert data fail at org.apache.hive.com.esotericsoftware.kryo.KryoException: Encountered unregistered class ID: 95
hive> insert into music values (1,'Faded');
Query ID = hadoopusr_20240625144523_fccb44c9-00e4-4a79-9d81-b5d56517a67d
Total jobs = 1
Launching Job 1 out of 1
Tez session was closed. Reopening...
...
0
votes
0
answers
44
views
How to register trait with KryoSerializer in Spark scala?
I have a trait named as Strategy and then I have multiple scala singleton objects implementing this trait. Can we register the trait Strategy with KryoSerializer?
I tried using this but it doesn't ...
1
vote
0
answers
179
views
How to debug the Kryo fallback in Flink?
I wonder which is the simplest way of troubleshooting/debugging what causes
the Kryo fallback.
Detecting it is just a matter of adding this line to your job:
env.getConfig().disableGenericTypes();
or ...
- 480
0
votes
1
answer
48
views
Flink Stuck on Broadcast
I encountered a problem where Flink gets stuck during broadcast state writing on:
ctx.collect(data）
where ctx is SourceContext
there is no exception thrown and the the tread dump is stuck around, but ...
- 626
0
votes
1
answer
200
views
The Kryo Serializer is consuming more space than the default serializer in EHCache
I am attempting to save an Employee object to the off-heap tier of the EHCache using the Kryo serializer, and it is occupying more space than when I attempted to save it without the Kryo serializer. I ...
1
vote
1
answer
394
views
How can you use a nested Map as a buffer in a Spark Aggregator?
I am trying to implement a Scala Spark Aggregator with a Map containing non-primitive types (for example, Map[String, Set[String]]) as its buffer. It seems like I can use kryo or ExpressionEncoder to ...
- 3,513
-2
votes
1
answer
1k
views
KryoException. Stackoverflow occured because of infinite recursion
I have a project where I use RedissonSpringCacheManager with RedissonClient default configuration.
I am using @Cacheable annotation to cache Entities (unfortunatelly for now I can't cache DTOs instead ...
2
votes
0
answers
159
views
Flink Pojo serializer showing a lot of CPU time spent in KryoException<init>
I used to have a POJO being sent from one vertex to another using a HASH connector, and never noticed anything weird in the Flame Graphs view.
I have now added an AsyncIO step that will do the keyBy ...
- 354
0
votes
1
answer
303
views
Flink: Key serializer used in Java DataSet API incompatible with that used in Scala DataStream API
Our Flink code (currently, using Flink 1.12) is written in Scala and generally contains a bunch of keyed time windows and process functions as operators. We have externalized savepoint storage to ...
- 11
1
vote
1
answer
129
views
Cant create Priority Queue Serializer
Trying to create PQ kryo serialiser in scala 2.12 but its failing with InstantiationException, and cant seem to bypass the error.
Also, tried to create object for instantiation, but still faced the ...
- 11