Re: Spark 3.0 ArrayIndexOutOfBoundsException at RDDOperationScope.toJson

2020-10-21 Thread constantin 
I also had a java.lang.ArrayIndexOutOfBoundsException: 28499, very similar,
after migrating to Spark 3.0.1 from 2.4.3, when performing a count,
countApprox or rdd operation on Spark datasets.

For me, this solution worked:

https://programmersought.com/article/35311239379/

Basically I added this dependency:

   
com.thoughtworks.paranamer
paranamer
2.8




--
Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/

-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org

Re: Spark 3.0 ArrayIndexOutOfBoundsException at RDDOperationScope.toJson

2020-06-29 Thread taegeonum 
I've found the problem. 
I've removed guava14.0 from the extraClassPath in my spark job, and there is
no exception. 




--
Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/

-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org