Re: What options do I have to handle third party classes that are not serializable?

2020-02-25 Thread Jeff Evans
Did you try this?  https://stackoverflow.com/a/2114387/375670


On Tue, Feb 25, 2020 at 10:23 AM yeikel valdes  wrote:

> I am currently using a third party library(Lucene) with Spark that is not
> serializable. Due to that reason, it generates the following exception  :
>
> Job aborted due to stage failure: Task 144.0 in stage 25.0 (TID 2122) had a 
> not serializable result: org.apache.lucene.facet.FacetsConfig Serialization 
> stack: - object not serializable (class: 
> org.apache.lucene.facet.FacetsConfig, value: 
> org.apache.lucene.facet.FacetsConfg
>
> While it would be ideal if this class was serializable, there is really 
> nothing I can do to change this third party library in order to add 
> serialization to it.
>
> What options do I have, and what's the recommended option to handle this 
> problem?
>
> Thank you!
>
>
>


What options do I have to handle third party classes that are not serializable?

2020-02-25 Thread yeikel valdes
I am currently using a third party library(Lucene) with Spark that is not 
serializable. Due to that reason, it generates the following exception  :


Job aborted due to stage failure: Task 144.0 in stage 25.0 (TID 2122) had a not 
serializable result: org.apache.lucene.facet.FacetsConfig Serialization stack: 
- object not serializable (class: org.apache.lucene.facet.FacetsConfig, value: 
org.apache.lucene.facet.FacetsConfg
While it would be ideal if this class was serializable, there is really nothing 
I can do to change this third party library in order to add serialization to it.
What options do I have, and what's the recommended option to handle this 
problem?
Thank you!