...@gmail.com]
Sent: Wednesday, July 1, 2015 3:09 PM
To: Hafiz Mujadid
Cc: user@spark.apache.orgmailto:user@spark.apache.org
Subject: Re: making dataframe for different types using spark-csv
· use .cast(...).alias('...') after the DataFrame is read.
· sql.functions.udf for any domain-specific conversions
*To:* Hafiz Mujadid
*Cc:* user@spark.apache.org
*Subject:* Re: making dataframe for different types using spark-csv
· use .cast(...).alias('...') after the DataFrame is read.
· sql.functions.udf for any domain-specific conversions.
Cheers
k/
On Wed, Jul 1, 2015 at 11:03 AM, Hafiz Mujadid
@spark.apache.org
*Subject:* Re: making dataframe for different types using spark-csv
· use .cast(...).alias('...') after the DataFrame is read.
· sql.functions.udf for any domain-specific conversions.
Cheers
k/
On Wed, Jul 1, 2015 at 11:03 AM, Hafiz Mujadid hafizmujadi...@gmail.com
wrote
Mohammed
From: Krishna Sankar [mailto:ksanka...@gmail.com]
Sent: Wednesday, July 1, 2015 3:09 PM
To: Hafiz Mujadid
Cc: user@spark.apache.org
Subject: Re: making dataframe for different types using spark-csv
· use .cast(...).alias('...') after the DataFrame is read.
· sql.functions.udf for any
- use .cast(...).alias('...') after the DataFrame is read.
- sql.functions.udf for any domain-specific conversions.
Cheers
k/
On Wed, Jul 1, 2015 at 11:03 AM, Hafiz Mujadid hafizmujadi...@gmail.com
wrote:
Hi experts!
I am using spark-csv to lead csv data into dataframe. By default it