[
https://issues.apache.org/jira/browse/SPARK-54489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-54489:
-----------------------------------
Labels: pull-request-available (was: )
> Avoid returning corrupted Kryo objects
> --------------------------------------
>
> Key: SPARK-54489
> URL: https://issues.apache.org/jira/browse/SPARK-54489
> Project: Spark
> Issue Type: Bug
> Components: Spark Core
> Affects Versions: 4.2.0
> Reporter: dzcxzl
> Priority: Minor
> Labels: pull-request-available
>
>
> {code:java}
> java.lang.NegativeArraySizeException: -2147483645
> at
> com.esotericsoftware.kryo.util.IdentityObjectIntMap.resize(IdentityObjectIntMap.java:542)
> at
> com.esotericsoftware.kryo.util.IdentityObjectIntMap.putStash(IdentityObjectIntMap.java:306)
> at
> com.esotericsoftware.kryo.util.IdentityObjectIntMap.push(IdentityObjectIntMap.java:300)
> at
> com.esotericsoftware.kryo.util.IdentityObjectIntMap.put(IdentityObjectIntMap.java:162)
> at
> com.esotericsoftware.kryo.util.IdentityObjectIntMap.putStash(IdentityObjectIntMap.java:307)
> at
> com.esotericsoftware.kryo.util.IdentityObjectIntMap.push(IdentityObjectIntMap.java:300)
> at
> com.esotericsoftware.kryo.util.IdentityObjectIntMap.put(IdentityObjectIntMap.java:162)
> at
> com.esotericsoftware.kryo.util.MapReferenceResolver.addWrittenObject(MapReferenceResolver.java:41)
> at com.esotericsoftware.kryo.Kryo.writeReferenceOrNull(Kryo.java:681)
> at com.esotericsoftware.kryo.Kryo.writeClassAndObject(Kryo.java:646)
> at
> com.esotericsoftware.kryo.serializers.DefaultArraySerializers$ObjectArraySerializer.write(DefaultArraySerializers.java:361)
> at
> com.esotericsoftware.kryo.serializers.DefaultArraySerializers$ObjectArraySerializer.write(DefaultArraySerializers.java:302)
> at com.esotericsoftware.kryo.Kryo.writeClassAndObject(Kryo.java:651)
> at
> org.apache.spark.serializer.KryoSerializationStream.writeObject(KryoSerializer.scala:269)
> at
> org.apache.spark.broadcast.TorrentBroadcast$.$anonfun$blockifyObject$4(TorrentBroadcast.scala:358)
> at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1510)
> at
> org.apache.spark.broadcast.TorrentBroadcast$.blockifyObject(TorrentBroadcast.scala:360)
> {code}
> {code:java}
> java.lang.ArrayIndexOutOfBoundsException: Index 688291177 out of bounds for
> length 3
> at
> com.esotericsoftware.kryo.util.IdentityObjectIntMap.get(IdentityObjectIntMap.java:322)
> at
> com.esotericsoftware.kryo.util.MapReferenceResolver.getWrittenId(MapReferenceResolver.java:46)
> at com.esotericsoftware.kryo.Kryo.writeReferenceOrNull(Kryo.java:671)
> at com.esotericsoftware.kryo.Kryo.writeClassAndObject(Kryo.java:646)
> at
> org.apache.spark.serializer.KryoSerializationStream.writeObject(KryoSerializer.scala:269)
> at
> org.apache.spark.broadcast.TorrentBroadcast$.$anonfun$blockifyObject$4(TorrentBroadcast.scala:358)
> at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1510)
> at
> org.apache.spark.broadcast.TorrentBroadcast$.blockifyObject(TorrentBroadcast.scala:360)
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
