[
https://issues.apache.org/jira/browse/SPARK-18746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Weiqing Yang updated SPARK-18746:
---------------------------------
Description:
Run the code below in spark-shell, there will be an error:
{code}
scala> spark.createDataset(Seq(new java.math.BigDecimal(10)))
<console>:24: error: Unable to find encoder for type stored in a Dataset.
Primitive types (Int, String, etc) and Product types (case classes) are
supported by importing spark.implicits._ Support for serializing other types
will be added in future releases.
spark.createDataset(Seq(new java.math.BigDecimal(10)))
^
scala>
{code}
In this pR, implicit encoders for java.math.BigDecimal will be added in the PR.
Also, timestamp and date
was:
Run the code below in spark-shell, there will be an error:
{code}
scala> spark.createDataset(Seq(new java.math.BigDecimal(10)))
<console>:24: error: Unable to find encoder for type stored in a Dataset.
Primitive types (Int, String, etc) and Product types (case classes) are
supported by importing spark.implicits._ Support for serializing other types
will be added in future releases.
spark.createDataset(Seq(new java.math.BigDecimal(10)))
^
scala>
{code}
To fix the error above, an implicit encoder for java.math.BigDecimal will be
added in the PR. Also,
> Add implicit encoders for BigDecimal, timestamp and date
> --------------------------------------------------------
>
> Key: SPARK-18746
> URL: https://issues.apache.org/jira/browse/SPARK-18746
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Reporter: Weiqing Yang
>
> Run the code below in spark-shell, there will be an error:
> {code}
> scala> spark.createDataset(Seq(new java.math.BigDecimal(10)))
> <console>:24: error: Unable to find encoder for type stored in a Dataset.
> Primitive types (Int, String, etc) and Product types (case classes) are
> supported by importing spark.implicits._ Support for serializing other types
> will be added in future releases.
> spark.createDataset(Seq(new java.math.BigDecimal(10)))
> ^
> scala>
> {code}
> In this pR, implicit encoders for java.math.BigDecimal will be added in the
> PR. Also, timestamp and date
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
