Hi Koert, Thanks for the tips. I tried to do that but the column's type is now Binary. Do I get the Set[X] back in the Dataset?
Best Regards, Jerry On Tue, Jan 31, 2017 at 8:04 PM, Koert Kuipers <ko...@tresata.com> wrote: > set is currently not supported. you can use kryo encoder. there is no > other work around that i know of. > > import org.apache.spark.sql.{ Encoder, Encoders } > implicit def setEncoder[X]: Encoder[Set[X]] = Encoders.kryo[Set[X]] > > On Tue, Jan 31, 2017 at 7:33 PM, Jerry Lam <chiling...@gmail.com> wrote: > >> Hi guys, >> >> I got an exception like the following, when I tried to implement a user >> defined aggregation function. >> >> Exception in thread "main" java.lang.UnsupportedOperationException: No >> Encoder found for Set[(scala.Long, scala.Long)] >> >> The Set[(Long, Long)] is a field in the case class which is the output >> type for the aggregation. >> >> Is there a workaround for this? >> >> Best Regards, >> >> Jerry >> > >