[GitHub] spark issue #16626: [SPARK-19261][SQL] Alter add columns for Hive serde and ...

2017-02-19 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16626 We also need to test the support of `InMemoryCatalog`. Please do not add a test case yet. I think I really need to finish https://github.com/apache/spark/pull/16592 ASAP. It will make everyone si

[GitHub] spark pull request #16995: [SPARK-19340][SQL] CSV file will result in an exc...

2017-02-19 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/16995#discussion_r101961405 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DataSource.scala --- @@ -404,6 +386,35 @@ case class DataSource( }

[GitHub] spark pull request #16626: [SPARK-19261][SQL] Alter add columns for Hive ser...

2017-02-19 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16626#discussion_r101961354 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveExternalCatalog.scala --- @@ -563,35 +574,47 @@ private[spark] class HiveExternalCatalog(

[GitHub] spark pull request #16626: [SPARK-19261][SQL] Alter add columns for Hive ser...

2017-02-19 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16626#discussion_r101961067 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveExternalCatalog.scala --- @@ -563,35 +574,47 @@ private[spark] class HiveExternalCatalog(

[GitHub] spark pull request #16626: [SPARK-19261][SQL] Alter add columns for Hive ser...

2017-02-19 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16626#discussion_r101960398 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveExternalCatalog.scala --- @@ -504,15 +504,15 @@ private[spark] class HiveExternalCatalog(

[GitHub] spark pull request #16626: [SPARK-19261][SQL] Alter add columns for Hive ser...

2017-02-19 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16626#discussion_r101960271 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveExternalCatalog.scala --- @@ -523,18 +523,29 @@ private[spark] class HiveExternalCatalog(

[GitHub] spark pull request #16626: [SPARK-19261][SQL] Alter add columns for Hive ser...

2017-02-19 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16626#discussion_r101960044 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveExternalCatalog.scala --- @@ -563,35 +574,47 @@ private[spark] class HiveExternalCatalog(

[GitHub] spark issue #16949: [SPARK-16122][CORE] Add rest api for job environment

2017-02-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16949 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16949: [SPARK-16122][CORE] Add rest api for job environment

2017-02-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16949 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73145/ Test PASSed. ---

[GitHub] spark issue #16949: [SPARK-16122][CORE] Add rest api for job environment

2017-02-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16949 **[Test build #73145 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73145/testReport)** for PR 16949 at commit [`ad570cf`](https://github.com/apache/spark/commit/a

[GitHub] spark issue #16966: [SPARK-18409][ML]LSH approxNearestNeighbors should use a...

2017-02-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16966 **[Test build #73154 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73154/testReport)** for PR 16966 at commit [`e90f2ec`](https://github.com/apache/spark/commit/e9

[GitHub] spark pull request #16626: [SPARK-19261][SQL] Alter add columns for Hive ser...

2017-02-19 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16626#discussion_r101959389 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveExternalCatalog.scala --- @@ -504,15 +504,15 @@ private[spark] class HiveExternalCatalog(

[GitHub] spark pull request #16626: [SPARK-19261][SQL] Alter add columns for Hive ser...

2017-02-19 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16626#discussion_r101958919 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/tables.scala --- @@ -174,6 +177,79 @@ case class AlterTableRenameCommand( }

[GitHub] spark issue #16726: [SPARK-19390][SQL] Replace the unnecessary usages of hiv...

2017-02-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16726 **[Test build #73153 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73153/testReport)** for PR 16726 at commit [`75d8017`](https://github.com/apache/spark/commit/75

[GitHub] spark pull request #16726: [SPARK-19390][SQL] Replace the unnecessary usages...

2017-02-19 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16726#discussion_r101958369 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveMetastoreCatalog.scala --- @@ -251,11 +251,11 @@ private[hive] class HiveMetastoreCatalo

[GitHub] spark issue #15415: [SPARK-14503][ML] spark.ml API for FPGrowth

2017-02-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15415 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark pull request #16626: [SPARK-19261][SQL] Alter add columns for Hive ser...

2017-02-19 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16626#discussion_r101958217 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/sources/TableScanSuite.scala --- @@ -416,4 +416,21 @@ class TableScanSuite extends DataSourceTest

[GitHub] spark issue #15415: [SPARK-14503][ML] spark.ml API for FPGrowth

2017-02-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15415 **[Test build #73149 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73149/testReport)** for PR 15415 at commit [`dfdf85d`](https://github.com/apache/spark/commit/d

[GitHub] spark issue #15415: [SPARK-14503][ML] spark.ml API for FPGrowth

2017-02-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15415 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73149/ Test PASSed. ---

[GitHub] spark pull request #16626: [SPARK-19261][SQL] Alter add columns for Hive ser...

2017-02-19 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16626#discussion_r101958137 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/jdbc/JDBCSuite.scala --- @@ -71,8 +71,20 @@ class JDBCSuite extends SparkFunSuite conn.pr

[GitHub] spark pull request #16626: [SPARK-19261][SQL] Alter add columns for Hive ser...

2017-02-19 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16626#discussion_r101958020 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/tables.scala --- @@ -174,6 +177,79 @@ case class AlterTableRenameCommand( }

[GitHub] spark pull request #16626: [SPARK-19261][SQL] Alter add columns for Hive ser...

2017-02-19 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16626#discussion_r101958045 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/tables.scala --- @@ -174,6 +177,79 @@ case class AlterTableRenameCommand( }

[GitHub] spark issue #16923: [SPARK-19038][Hive][YARN] Correctly figure out keytab fi...

2017-02-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16923 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73146/ Test PASSed. ---

[GitHub] spark issue #16923: [SPARK-19038][Hive][YARN] Correctly figure out keytab fi...

2017-02-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16923 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16923: [SPARK-19038][Hive][YARN] Correctly figure out keytab fi...

2017-02-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16923 **[Test build #73146 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73146/testReport)** for PR 16923 at commit [`57060e3`](https://github.com/apache/spark/commit/5

[GitHub] spark issue #16996: [SPARK-19664][SQL]put hive.metastore.warehouse.dir in ha...

2017-02-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16996 **[Test build #73152 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73152/testReport)** for PR 16996 at commit [`ac0a1c6`](https://github.com/apache/spark/commit/ac

[GitHub] spark issue #16997: Updated the SQL programming guide to explain about the E...

2017-02-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16997 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark pull request #16997: Updated the SQL programming guide to explain abou...

2017-02-19 Thread HarshSharma8
GitHub user HarshSharma8 opened a pull request: https://github.com/apache/spark/pull/16997 Updated the SQL programming guide to explain about the Encoding opera… ## What changes were proposed in this pull request? Made some updates to SQL programming guide to explain

[GitHub] spark issue #16819: [SPARK-16441][YARN] Set maxNumExecutor depends on yarn c...

2017-02-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16819 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73151/ Test PASSed. ---

[GitHub] spark issue #16819: [SPARK-16441][YARN] Set maxNumExecutor depends on yarn c...

2017-02-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16819 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16819: [SPARK-16441][YARN] Set maxNumExecutor depends on yarn c...

2017-02-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16819 **[Test build #73151 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73151/testReport)** for PR 16819 at commit [`8e99701`](https://github.com/apache/spark/commit/8

[GitHub] spark issue #16978: [SPARK-19652][UI] Do auth checks for REST API access.

2017-02-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16978 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16981: [SPARK-19637][SQL] Add from_json/to_json in FunctionRegi...

2017-02-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16981 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16981: [SPARK-19637][SQL] Add from_json/to_json in FunctionRegi...

2017-02-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16981 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73143/ Test PASSed. ---

[GitHub] spark issue #16981: [SPARK-19637][SQL] Add from_json/to_json in FunctionRegi...

2017-02-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16981 **[Test build #73143 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73143/testReport)** for PR 16981 at commit [`9b1c015`](https://github.com/apache/spark/commit/9

[GitHub] spark issue #16978: [SPARK-19652][UI] Do auth checks for REST API access.

2017-02-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16978 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73139/ Test PASSed. ---

[GitHub] spark issue #16978: [SPARK-19652][UI] Do auth checks for REST API access.

2017-02-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16978 **[Test build #73139 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73139/testReport)** for PR 16978 at commit [`7288160`](https://github.com/apache/spark/commit/7

[GitHub] spark pull request #16977: [SPARK-19651][CORE] ParallelCollectionRDD.collect...

2017-02-19 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/16977#discussion_r101955822 --- Diff: core/src/main/scala/org/apache/spark/rdd/ParallelCollectionRDD.scala --- @@ -105,6 +105,17 @@ private[spark] class ParallelCollectionRDD[T: ClassT

[GitHub] spark issue #16819: [SPARK-16441][YARN] Set maxNumExecutor depends on yarn c...

2017-02-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16819 **[Test build #73151 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73151/testReport)** for PR 16819 at commit [`8e99701`](https://github.com/apache/spark/commit/8e

[GitHub] spark pull request #16977: [SPARK-19651][CORE] ParallelCollectionRDD.collect...

2017-02-19 Thread uncleGen
Github user uncleGen commented on a diff in the pull request: https://github.com/apache/spark/pull/16977#discussion_r101954581 --- Diff: core/src/main/scala/org/apache/spark/rdd/ParallelCollectionRDD.scala --- @@ -105,6 +105,17 @@ private[spark] class ParallelCollectionRDD[T: Clas

[GitHub] spark issue #15125: [SPARK-5484][GraphX] Periodically do checkpoint in Prege...

2017-02-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15125 **[Test build #73150 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73150/testReport)** for PR 15125 at commit [`2639eb1`](https://github.com/apache/spark/commit/26

[GitHub] spark issue #16981: [SPARK-19637][SQL] Add from_json/to_json in FunctionRegi...

2017-02-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16981 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73141/ Test PASSed. ---

[GitHub] spark issue #15415: [SPARK-14503][ML] spark.ml API for FPGrowth

2017-02-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15415 **[Test build #73149 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73149/testReport)** for PR 15415 at commit [`dfdf85d`](https://github.com/apache/spark/commit/df

[GitHub] spark issue #16981: [SPARK-19637][SQL] Add from_json/to_json in FunctionRegi...

2017-02-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16981 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16981: [SPARK-19637][SQL] Add from_json/to_json in FunctionRegi...

2017-02-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16981 **[Test build #73141 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73141/testReport)** for PR 16981 at commit [`31ca0ff`](https://github.com/apache/spark/commit/3

[GitHub] spark pull request #16865: [SPARK-19530][SQL] Use guava weigher for code cac...

2017-02-19 Thread viirya
Github user viirya closed the pull request at: https://github.com/apache/spark/pull/16865 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #16865: [SPARK-19530][SQL] Use guava weigher for code cache evic...

2017-02-19 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/16865 Ok. Close this for now. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes s

[GitHub] spark issue #15125: [SPARK-5484][GraphX] Periodically do checkpoint in Prege...

2017-02-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15125 **[Test build #73148 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73148/testReport)** for PR 15125 at commit [`dd6c366`](https://github.com/apache/spark/commit/dd

[GitHub] spark issue #16949: [SPARK-16122][CORE] Add rest api for job environment

2017-02-19 Thread uncleGen
Github user uncleGen commented on the issue: https://github.com/apache/spark/pull/16949 cc @vanzin Take a second review please! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature en

[GitHub] spark issue #16996: [SPARK-19664][SQL]put hive.metastore.warehouse.dir in ha...

2017-02-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16996 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73144/ Test FAILed. ---

[GitHub] spark issue #16819: [SPARK-16441][YARN] Set maxNumExecutor depends on yarn c...

2017-02-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16819 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73147/ Test FAILed. ---

[GitHub] spark issue #16996: [SPARK-19664][SQL]put hive.metastore.warehouse.dir in ha...

2017-02-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16996 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16819: [SPARK-16441][YARN] Set maxNumExecutor depends on yarn c...

2017-02-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16819 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16819: [SPARK-16441][YARN] Set maxNumExecutor depends on yarn c...

2017-02-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16819 **[Test build #73147 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73147/testReport)** for PR 16819 at commit [`4f81680`](https://github.com/apache/spark/commit/4

[GitHub] spark issue #16996: [SPARK-19664][SQL]put hive.metastore.warehouse.dir in ha...

2017-02-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16996 **[Test build #73144 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73144/testReport)** for PR 16996 at commit [`92c1452`](https://github.com/apache/spark/commit/9

[GitHub] spark pull request #15125: [SPARK-5484][GraphX] Periodically do checkpoint i...

2017-02-19 Thread dding3
Github user dding3 commented on a diff in the pull request: https://github.com/apache/spark/pull/15125#discussion_r101952678 --- Diff: docs/graphx-programming-guide.md --- @@ -720,25 +722,53 @@ class GraphOps[VD, ED] { sendMsg: EdgeTriplet[VD, ED] => Iterator[(VertexId,

[GitHub] spark issue #16819: [SPARK-16441][YARN] Set maxNumExecutor depends on yarn c...

2017-02-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16819 **[Test build #73147 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73147/testReport)** for PR 16819 at commit [`4f81680`](https://github.com/apache/spark/commit/4f

[GitHub] spark pull request #16726: [SPARK-19390][SQL] Replace the unnecessary usages...

2017-02-19 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16726#discussion_r101952068 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveTableScanSuite.scala --- @@ -166,13 +166,11 @@ class HiveTableScanSuite extend

[GitHub] spark issue #16994: [SPARK-15453] [SQL] [Follow-up] FileSourceScanExec to ex...

2017-02-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16994 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16994: [SPARK-15453] [SQL] [Follow-up] FileSourceScanExec to ex...

2017-02-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16994 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73142/ Test PASSed. ---

[GitHub] spark pull request #16726: [SPARK-19390][SQL] Replace the unnecessary usages...

2017-02-19 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16726#discussion_r101952060 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveTableScanSuite.scala --- @@ -166,13 +166,11 @@ class HiveTableScanSuite extend

[GitHub] spark issue #16994: [SPARK-15453] [SQL] [Follow-up] FileSourceScanExec to ex...

2017-02-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16994 **[Test build #73142 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73142/testReport)** for PR 16994 at commit [`4b73130`](https://github.com/apache/spark/commit/4

[GitHub] spark issue #16819: [SPARK-16441][YARN] Set maxNumExecutor depends on yarn c...

2017-02-19 Thread wangyum
Github user wangyum commented on the issue: https://github.com/apache/spark/pull/16819 @srowen . Dynamic set `spark.dynamicAllocation.maxExecutors` can avoid some strange problems: 1. [Spark application hang when dynamic allocation is enabled](https://issues.apache.org/jira/

[GitHub] spark issue #16994: [SPARK-15453] [SQL] [Follow-up] FileSourceScanExec to ex...

2017-02-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16994 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73140/ Test PASSed. ---

[GitHub] spark issue #16994: [SPARK-15453] [SQL] [Follow-up] FileSourceScanExec to ex...

2017-02-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16994 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16994: [SPARK-15453] [SQL] [Follow-up] FileSourceScanExec to ex...

2017-02-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16994 **[Test build #73140 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73140/testReport)** for PR 16994 at commit [`f1569bf`](https://github.com/apache/spark/commit/f

[GitHub] spark pull request #15125: [SPARK-5484][GraphX] Periodically do checkpoint i...

2017-02-19 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/15125#discussion_r101950972 --- Diff: docs/graphx-programming-guide.md --- @@ -720,25 +722,53 @@ class GraphOps[VD, ED] { sendMsg: EdgeTriplet[VD, ED] => Iterator[(VertexId,

[GitHub] spark issue #16923: [SPARK-19038][Hive][YARN] Correctly figure out keytab fi...

2017-02-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16923 **[Test build #73146 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73146/testReport)** for PR 16923 at commit [`57060e3`](https://github.com/apache/spark/commit/57

[GitHub] spark pull request #16981: [SPARK-19637][SQL] Add from_json/to_json in Funct...

2017-02-19 Thread maropu
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/16981#discussion_r101950039 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/jsonExpressions.scala --- @@ -482,6 +482,15 @@ case class JsonTuple(children

[GitHub] spark pull request #16981: [SPARK-19637][SQL] Add from_json/to_json in Funct...

2017-02-19 Thread maropu
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/16981#discussion_r101950073 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/JsonFunctionsSuite.scala --- @@ -174,4 +174,44 @@ class JsonFunctionsSuite extends QueryTest with Sha

[GitHub] spark issue #16865: [SPARK-19530][SQL] Use guava weigher for code cache evic...

2017-02-19 Thread davies
Github user davies commented on the issue: https://github.com/apache/spark/pull/16865 I still think it's not worth it --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #16981: [SPARK-19637][SQL] Add from_json/to_json in Funct...

2017-02-19 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16981#discussion_r101948866 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/jsonExpressions.scala --- @@ -482,6 +482,15 @@ case class JsonTuple(chil

[GitHub] spark issue #16996: [SPARK-19664][SQL]put hive.metastore.warehouse.dir in ha...

2017-02-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16996 **[Test build #73144 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73144/testReport)** for PR 16996 at commit [`92c1452`](https://github.com/apache/spark/commit/92

[GitHub] spark issue #16949: [SPARK-16122][CORE] Add rest api for job environment

2017-02-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16949 **[Test build #73145 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73145/testReport)** for PR 16949 at commit [`ad570cf`](https://github.com/apache/spark/commit/ad

[GitHub] spark pull request #16818: [SPARK-19451][SQL][Core] Underlying integer overf...

2017-02-19 Thread uncleGen
Github user uncleGen commented on a diff in the pull request: https://github.com/apache/spark/pull/16818#discussion_r101948606 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/expressions/WindowSpec.scala --- @@ -180,16 +180,20 @@ class WindowSpec private[sql]( private

[GitHub] spark pull request #16981: [SPARK-19637][SQL] Add from_json/to_json in Funct...

2017-02-19 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16981#discussion_r101948552 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/JsonFunctionsSuite.scala --- @@ -174,4 +174,44 @@ class JsonFunctionsSuite extends QueryTest with

[GitHub] spark pull request #16996: [SPARK-19664][SQL]put hive.metastore.warehouse.di...

2017-02-19 Thread windpiger
GitHub user windpiger opened a pull request: https://github.com/apache/spark/pull/16996 [SPARK-19664][SQL]put hive.metastore.warehouse.dir in hadoopconf to verwrite its original value ## What changes were proposed in this pull request? In [SPARK-15959](https://issues.a

[GitHub] spark pull request #16981: [SPARK-19637][SQL] Add from_json/to_json in Funct...

2017-02-19 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16981#discussion_r101948378 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/JsonFunctionsSuite.scala --- @@ -174,4 +174,44 @@ class JsonFunctionsSuite extends QueryTest with

[GitHub] spark pull request #16981: [SPARK-19637][SQL] Add from_json/to_json in Funct...

2017-02-19 Thread maropu
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/16981#discussion_r101948229 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/json/JacksonUtils.scala --- @@ -55,4 +60,24 @@ object JacksonUtils { sche

[GitHub] spark pull request #16981: [SPARK-19637][SQL] Add from_json/to_json in Funct...

2017-02-19 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16981#discussion_r101947987 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/jsonExpressions.scala --- @@ -482,6 +482,15 @@ case class JsonTuple(chil

[GitHub] spark issue #16981: [SPARK-19637][SQL] Add from_json/to_json in FunctionRegi...

2017-02-19 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/16981 @gatorsmile okay, I'll do soon --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and w

[GitHub] spark issue #16981: [SPARK-19637][SQL] Add from_json/to_json in FunctionRegi...

2017-02-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16981 **[Test build #73143 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73143/testReport)** for PR 16981 at commit [`9b1c015`](https://github.com/apache/spark/commit/9b

[GitHub] spark issue #16981: [SPARK-19637][SQL] Add from_json/to_json in FunctionRegi...

2017-02-19 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16981 Could you add SQL test cases to SQLQueryTestSuite? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have th

[GitHub] spark pull request #16981: [SPARK-19637][SQL] Add from_json/to_json in Funct...

2017-02-19 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16981#discussion_r101947601 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/json/JacksonUtils.scala --- @@ -55,4 +60,24 @@ object JacksonUtils {

[GitHub] spark pull request #16981: [SPARK-19637][SQL] Add from_json/to_json in Funct...

2017-02-19 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16981#discussion_r101947505 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/jsonExpressions.scala --- @@ -482,6 +482,15 @@ case class JsonTuple(chil

[GitHub] spark issue #15125: [SPARK-5484][GraphX] Periodically do checkpoint in Prege...

2017-02-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15125 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73138/ Test PASSed. ---

[GitHub] spark issue #15125: [SPARK-5484][GraphX] Periodically do checkpoint in Prege...

2017-02-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15125 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15125: [SPARK-5484][GraphX] Periodically do checkpoint in Prege...

2017-02-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15125 **[Test build #73138 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73138/testReport)** for PR 15125 at commit [`dae94aa`](https://github.com/apache/spark/commit/d

[GitHub] spark pull request #16981: [SPARK-19637][SQL] Add from_json/to_json in Funct...

2017-02-19 Thread maropu
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/16981#discussion_r101947175 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/json/JacksonUtils.scala --- @@ -55,4 +60,26 @@ object JacksonUtils { sche

[GitHub] spark pull request #16981: [SPARK-19637][SQL] Add from_json/to_json in Funct...

2017-02-19 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/16981#discussion_r101947094 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/json/JacksonUtils.scala --- @@ -55,4 +60,26 @@ object JacksonUtils {

[GitHub] spark issue #16995: [SPARK-19340][SQL] CSV file will result in an exception ...

2017-02-19 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/16995 Could you add tests for this pr? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled an

[GitHub] spark issue #16994: [SPARK-15453] [SQL] [Follow-up] FileSourceScanExec to ex...

2017-02-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16994 **[Test build #73142 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73142/testReport)** for PR 16994 at commit [`4b73130`](https://github.com/apache/spark/commit/4b

[GitHub] spark issue #16981: [SPARK-19637][SQL] Add from_json/to_json in FunctionRegi...

2017-02-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16981 **[Test build #73141 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73141/testReport)** for PR 16981 at commit [`31ca0ff`](https://github.com/apache/spark/commit/31

[GitHub] spark issue #16994: [SPARK-15453] [SQL] [Follow-up] FileSourceScanExec to ex...

2017-02-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16994 **[Test build #73140 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73140/testReport)** for PR 16994 at commit [`f1569bf`](https://github.com/apache/spark/commit/f1

[GitHub] spark pull request #16981: [SPARK-19637][SQL] Add from_json/to_json in Funct...

2017-02-19 Thread maropu
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/16981#discussion_r101946265 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/json/JacksonUtils.scala --- @@ -55,4 +60,26 @@ object JacksonUtils { sche

[GitHub] spark issue #16978: [SPARK-19652][UI] Do auth checks for REST API access.

2017-02-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16978 **[Test build #73139 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73139/testReport)** for PR 16978 at commit [`7288160`](https://github.com/apache/spark/commit/72

[GitHub] spark issue #16865: [SPARK-19530][SQL] Use guava weigher for code cache evic...

2017-02-19 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/16865 ping @davies Do you still think this is not helpful generally? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request #16994: [SPARK-15453] [SQL] [Follow-up] FileSourceScanExe...

2017-02-19 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16994#discussion_r101941261 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/sources/BucketedReadSuite.scala --- @@ -240,6 +240,7 @@ class BucketedReadSuite extends QueryTest

[GitHub] spark pull request #16855: [SPARK-13931] Stage can hang if an executor fails...

2017-02-19 Thread GavinGavinNo1
Github user GavinGavinNo1 commented on a diff in the pull request: https://github.com/apache/spark/pull/16855#discussion_r101940439 --- Diff: core/src/test/scala/org/apache/spark/scheduler/TaskSetManagerSuite.scala --- @@ -664,6 +665,55 @@ class TaskSetManagerSuite extends SparkFun

[GitHub] spark issue #16171: [SPARK-18739][ML][PYSPARK] Classification and regression...

2017-02-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16171 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73137/ Test PASSed. ---

  1   2   3   >