Reynold Xin created SPARK-11802:
-----------------------------------
Summary: Kryo-based encoder for opaque types
Key: SPARK-11802
URL: https://issues.apache.org/jira/browse/SPARK-11802
Project: Spark
Issue Type: Sub-task
Components: SQL
Reporter: Reynold Xin
Assignee: Reynold Xin
Users of Spark SQL Datasets should be able to use objects that we don't
understand (i.e. today not primitives or case classes) in Spark Datasets. To
allow this, lets add a default encoder that uses kryo to store the class as
bytes and presents it as a single field {{value}}.
For now, lets require the user to explicitly pass the encoder, but as a bonus
we can explore the option to use this as a fallback automatically.
This encoder should be usable in:
- as
- map/flatMap, etc
- Custom Aggregators
- Scala/Java
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
