Re: making dataframe for different types using spark-csv

2015-07-02 Thread Kohler, Curt E (ELS-STL)
...@gmail.com] Sent: Wednesday, July 1, 2015 3:09 PM To: Hafiz Mujadid Cc: user@spark.apache.orgmailto:user@spark.apache.org Subject: Re: making dataframe for different types using spark-csv · use .cast(...).alias('...') after the DataFrame is read. · sql.functions.udf for any domain-specific conversions

Re: making dataframe for different types using spark-csv

2015-07-02 Thread Hafiz Mujadid
*To:* Hafiz Mujadid *Cc:* user@spark.apache.org *Subject:* Re: making dataframe for different types using spark-csv · use .cast(...).alias('...') after the DataFrame is read. · sql.functions.udf for any domain-specific conversions. Cheers k/ On Wed, Jul 1, 2015 at 11:03 AM, Hafiz Mujadid

Re: making dataframe for different types using spark-csv

2015-07-01 Thread Hafiz Mujadid
@spark.apache.org *Subject:* Re: making dataframe for different types using spark-csv · use .cast(...).alias('...') after the DataFrame is read. · sql.functions.udf for any domain-specific conversions. Cheers k/ On Wed, Jul 1, 2015 at 11:03 AM, Hafiz Mujadid hafizmujadi...@gmail.com wrote

RE: making dataframe for different types using spark-csv

2015-07-01 Thread Mohammed Guller
Mohammed From: Krishna Sankar [mailto:ksanka...@gmail.com] Sent: Wednesday, July 1, 2015 3:09 PM To: Hafiz Mujadid Cc: user@spark.apache.org Subject: Re: making dataframe for different types using spark-csv · use .cast(...).alias('...') after the DataFrame is read. · sql.functions.udf for any

Re: making dataframe for different types using spark-csv

2015-07-01 Thread Krishna Sankar
- use .cast(...).alias('...') after the DataFrame is read. - sql.functions.udf for any domain-specific conversions. Cheers k/ On Wed, Jul 1, 2015 at 11:03 AM, Hafiz Mujadid hafizmujadi...@gmail.com wrote: Hi experts! I am using spark-csv to lead csv data into dataframe. By default it