Hey all,
When my streaming application is restarting from failure (from checkpoint) I
am receiving strange error:
java.lang.ClassCastException:
org.apache.spark.util.SerializableConfiguration cannot be cast to
com.example.sender.MyClassReporter.
Instance of B class is created on driver side
Hi all,
I am wondering whether there is way to ensure that two consecutive maps
inside mapPartition will not be chained together.
To illustrate my question I prepared short example:
rdd.mapPartitions(it => {
it.map(x => foo(x)).map(y => y.getResult)
}
I would like to ensure that foo
rflow.com/questions/33027851/spark-issue-with-the-class-generated-from-avro-schema>
What is more I created minimal working example, thanks to which it will be
easy to reproduce problem.
link <https://github.com/alberskib/spark-avro-serialization-issue>
How I can solve this problem
