Re: spark-sql jdbc dataframe mysql data type issue

2016-06-25 Thread Mich Talebzadeh
select 10 sample rows for columns id, ctime from each (MySQL and spark) tables and post the output please. HTH Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw

spark-sql jdbc dataframe mysql data type issue

2016-06-25 Thread 刘虓
Hi, I came across this strange behavior of Apache Spark 1.6.1: when I was reading mysql table into spark dataframe ,a column of data type float got mapped into double. dataframe schema: root |-- id: long (nullable = true) |-- ctime: double (nullable = true) |-- atime: double (nullable =