[GitHub] spark pull request: [SPARK-14158][SQL] implement buildReader for j...

2016-03-28 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/11960 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request: [SPARK-14158][SQL] implement buildReader for j...

2016-03-28 Thread cloud-fan
Github user cloud-fan commented on the pull request: https://github.com/apache/spark/pull/11960#issuecomment-202739924 merging to master! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-14158][SQL] implement buildReader for j...

2016-03-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11960#issuecomment-202670684 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-14158][SQL] implement buildReader for j...

2016-03-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11960#issuecomment-202670681 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-14158][SQL] implement buildReader for j...

2016-03-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11960#issuecomment-202669899 **[Test build #54394 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54394/consoleFull)** for PR 11960 at commit [`e69551b`](https://g

[GitHub] spark pull request: [SPARK-14158][SQL] implement buildReader for j...

2016-03-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11960#issuecomment-202647651 **[Test build #54394 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54394/consoleFull)** for PR 11960 at commit [`e69551b`](https://gi

[GitHub] spark pull request: [SPARK-14158][SQL] implement buildReader for j...

2016-03-28 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/11960#discussion_r57657913 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/json/TestJsonData.scala --- @@ -32,7 +32,7 @@ private[json] trait TestJsonDat

[GitHub] spark pull request: [SPARK-14158][SQL] implement buildReader for j...

2016-03-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11960#issuecomment-202505765 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-14158][SQL] implement buildReader for j...

2016-03-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11960#issuecomment-202505761 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-14158][SQL] implement buildReader for j...

2016-03-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11960#issuecomment-202504866 **[Test build #54323 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54323/consoleFull)** for PR 11960 at commit [`59ae3b5`](https://g

[GitHub] spark pull request: [SPARK-14158][SQL] implement buildReader for j...

2016-03-28 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/11960#discussion_r57602697 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/json/TestJsonData.scala --- @@ -32,7 +32,7 @@ private[json] trait TestJsonData {

[GitHub] spark pull request: [SPARK-14158][SQL] implement buildReader for j...

2016-03-28 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/11960#discussion_r57602134 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/json/TestJsonData.scala --- @@ -32,7 +32,7 @@ private[json] trait TestJsonDat

[GitHub] spark pull request: [SPARK-14158][SQL] implement buildReader for j...

2016-03-28 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/11960#discussion_r57601454 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/json/TestJsonData.scala --- @@ -32,7 +32,7 @@ private[json] trait TestJsonData {

[GitHub] spark pull request: [SPARK-14158][SQL] implement buildReader for j...

2016-03-28 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/11960#discussion_r57600622 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/json/JSONRelation.scala --- @@ -120,6 +122,39 @@ class DefaultSource extends

[GitHub] spark pull request: [SPARK-14158][SQL] implement buildReader for j...

2016-03-28 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/11960#discussion_r57600394 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/json/TestJsonData.scala --- @@ -32,7 +32,7 @@ private[json] trait TestJsonDat

[GitHub] spark pull request: [SPARK-14158][SQL] implement buildReader for j...

2016-03-28 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/11960#discussion_r57599911 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/json/TestJsonData.scala --- @@ -32,7 +32,7 @@ private[json] trait TestJsonDat

[GitHub] spark pull request: [SPARK-14158][SQL] implement buildReader for j...

2016-03-28 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/11960#discussion_r57599706 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/json/JSONRelation.scala --- @@ -120,6 +122,39 @@ class DefaultSource extends

[GitHub] spark pull request: [SPARK-14158][SQL] implement buildReader for j...

2016-03-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11960#issuecomment-202459534 **[Test build #54323 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54323/consoleFull)** for PR 11960 at commit [`59ae3b5`](https://gi

[GitHub] spark pull request: [SPARK-14158][SQL] implement buildReader for j...

2016-03-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11960#issuecomment-201633733 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-14158][SQL] implement buildReader for j...

2016-03-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11960#issuecomment-201633729 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-14158][SQL] implement buildReader for j...

2016-03-25 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11960#issuecomment-201633176 **[Test build #54232 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54232/consoleFull)** for PR 11960 at commit [`dd6cef3`](https://g

[GitHub] spark pull request: [SPARK-14158][SQL] implement buildReader for j...

2016-03-25 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11960#issuecomment-201587897 **[Test build #54232 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54232/consoleFull)** for PR 11960 at commit [`dd6cef3`](https://gi

[GitHub] spark pull request: [SPARK-14158][SQL] implement buildReader for j...

2016-03-25 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/11960#discussion_r57502420 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/HadoopFileLinesReader.scala --- @@ -0,0 +1,50 @@ +/* + * Licensed to

[GitHub] spark pull request: [SPARK-14158][SQL] implement buildReader for j...

2016-03-25 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/11960#discussion_r57465871 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/HadoopFileLinesReader.scala --- @@ -0,0 +1,50 @@ +/* + * Licensed to the

[GitHub] spark pull request: [SPARK-14158][SQL] implement buildReader for j...

2016-03-25 Thread yhuai
Github user yhuai commented on the pull request: https://github.com/apache/spark/pull/11960#issuecomment-201373343 Overall looks good. Let's fix the serialization issue. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: [SPARK-14158][SQL] implement buildReader for j...

2016-03-25 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/11960#discussion_r57465176 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/FileSourceStrategy.scala --- @@ -58,7 +58,8 @@ private[sql] object FileSourceStra

[GitHub] spark pull request: [SPARK-14158][SQL] implement buildReader for j...

2016-03-25 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/11960#discussion_r57465015 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/HadoopFileLinesReader.scala --- @@ -0,0 +1,50 @@ +/* + * Licensed to the

[GitHub] spark pull request: [SPARK-14158][SQL] implement buildReader for j...

2016-03-25 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/11960#discussion_r57464019 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/FileSourceStrategy.scala --- @@ -58,7 +58,8 @@ private[sql] object FileSourceStra

[GitHub] spark pull request: [SPARK-14158][SQL] implement buildReader for j...

2016-03-25 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/11960#discussion_r57462957 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/json/JSONRelation.scala --- @@ -120,6 +122,39 @@ class DefaultSource extends File

[GitHub] spark pull request: [SPARK-14158][SQL] implement buildReader for j...

2016-03-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11960#issuecomment-201345705 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-14158][SQL] implement buildReader for j...

2016-03-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11960#issuecomment-201345704 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-14158][SQL] implement buildReader for j...

2016-03-25 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11960#issuecomment-20134 **[Test build #54180 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54180/consoleFull)** for PR 11960 at commit [`3efd4a1`](https://g

[GitHub] spark pull request: [SPARK-14158][SQL] implement buildReader for j...

2016-03-25 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11960#issuecomment-201320791 **[Test build #54180 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54180/consoleFull)** for PR 11960 at commit [`3efd4a1`](https://gi

[GitHub] spark pull request: [SPARK-14158][SQL] implement buildReader for j...

2016-03-25 Thread cloud-fan
Github user cloud-fan commented on the pull request: https://github.com/apache/spark/pull/11960#issuecomment-201320551 cc @marmbrus @liancheng @yhuai --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request: [SPARK-14158][SQL] implement buildReader for j...

2016-03-25 Thread cloud-fan
GitHub user cloud-fan opened a pull request: https://github.com/apache/spark/pull/11960 [SPARK-14158][SQL] implement buildReader for json data source ## What changes were proposed in this pull request? This PR implements buildReader for json data source and enable it in the