Re: SQLContext.read.json(path) throws java.io.IOException

2015-08-26 Thread gsvic
(path) throws java.io.IOException, click here http://apache-spark-developers-list.1001551.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_codenode=13841code=dmljdG9yYXNnc0BnbWFpbC5jb218MTM4NDF8MzQ0MzYwNzA= . NAML http://apache-spark-developers-list.1001551.n3.nabble.com/template

Re: SQLContext.read.json(path) throws java.io.IOException

2015-08-26 Thread Yin Huai
The JSON support in Spark SQL handles a file with one JSON object per line or one JSON array of objects per line. What is the format your file? Does it only contain a single line? On Wed, Aug 26, 2015 at 6:47 AM, gsvic victora...@gmail.com wrote: Hi, I have the following issue. I am trying to

Re: SQLContext.read.json(path) throws java.io.IOException

2015-08-26 Thread Reynold Xin
To unsubscribe from SQLContext.read.json(path) throws java.io.IOException, click here. NAML http://apache-spark-developers-list.1001551.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewerid=instant_html%21nabble%3Aemail.namlbase=nabble.naml.namespaces.BasicNamespace

SQLContext.read.json(path) throws java.io.IOException

2015-08-26 Thread gsvic
Hi, I have the following issue. I am trying to load a 2.5G JSON file from a 10-node Hadoop Cluster. Actually, I am trying to create a DataFrame, using sqlContext.read.json(hdfs://master:9000/path/file.json). The JSON file contains a parsed table(relation) from the TPCH benchmark. After

Re: SQLContext.read.json(path) throws java.io.IOException

2015-08-26 Thread gsvic
No, I created the file by appending each JSON record in a loop without changing line. I've just changed that and now it works fine. Thank you very much for your support. -- View this message in context: