yu peng created SPARK-15175:
-------------------------------
Summary: using csv.DictReader and existing json dataframe reader
as work around to support csv reader
Key: SPARK-15175
URL: https://issues.apache.org/jira/browse/SPARK-15175
Project: Spark
Issue Type: Improvement
Components: PySpark
Affects Versions: 1.6.1
Reporter: yu peng
it is a pain to make data frame smoothly support csv file. without knowing the
schema ahead.
I think it is doable to use default csv.dictreader combining existing
sqlContext.json reader to support a smooth csv reader purely in python
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
