I think you can try dataFrame create api that takes RDD[Row] and Struct type... On Aug 11, 2015 4:28 PM, "Jyun-Fan Tsai" <jft...@appier.com> wrote:
> Hi all, > I'm using Spark 1.4.1. I create a DataFrame from json file. There is > a column C that all values are null in the json file. I found that > the datatype of column C in the created DataFrame is string. However, > I would like to specify the column as Long when saving it as parquet > file. What should I do to specify the column type when saving parquet > file? > > Thank you, > Jyun-Fan Tsai > > --------------------------------------------------------------------- > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org > For additional commands, e-mail: user-h...@spark.apache.org > >
