i confirmed that an Encoder[Array[Int]] is no longer serializable, and with
my spark build from march 7 it was.
i believe the issue is commit 295747e59739ee8a697ac3eba485d3439e4a04c3 and
i send wenchen an email about it.
On Wed, Apr 12, 2017 at 4:31 PM, Koert Kuipers wrote:
> i believe the erro
i believe the error is related to an
org.apache.spark.sql.expressions.Aggregator where the buffer type (BUF) is
Array[Int]
On Wed, Apr 12, 2017 at 4:19 PM, Koert Kuipers wrote:
> hey all,
> today i tried upgrading the spark version we use internally by creating a
> new internal release from the
hey all,
today i tried upgrading the spark version we use internally by creating a
new internal release from the spark master branch. last time i did this was
march 7.
with this updated spark i am seeing some serialization errors in the unit
tests for our own libraries. looks like a scala reflecti