[GitHub] spark issue #16982: [SPARK-19654][SPARKR][SS] Structured Streaming API for R

2017-03-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16982 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74787/ Test PASSed. ---

[GitHub] spark issue #16982: [SPARK-19654][SPARKR][SS] Structured Streaming API for R

2017-03-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16982 **[Test build #74787 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74787/testReport)** for PR 16982 at commit [`d245bb9`](https://github.com/apache/spark/commit/d

[GitHub] spark issue #17170: [SPARK-19825][R][ML] spark.ml R API for FPGrowth

2017-03-18 Thread zero323
Github user zero323 commented on the issue: https://github.com/apache/spark/pull/17170 @felixcheung It is completely up to you. I'll have to patch one or another (and also #17218) and at the end of the day it doesn't make much difference. --- If your project is set up for it, you can

[GitHub] spark issue #17286: [SPARK-19915][SQL] Exclude cartesian product candidates ...

2017-03-18 Thread ioana-delaney
Github user ioana-delaney commented on the issue: https://github.com/apache/spark/pull/17286 @gatorsmile Your example is correct. Given A J1 B J2 C: • level 0: (A), (B), (C) • level 1: {A, B}, ~{A, C}~, {B, C} • level 3: {A, B, C} Given A J1 B J2 C c

[GitHub] spark issue #17246: [SPARK-19906][SS][DOCS] Documentation describing how to ...

2017-03-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17246 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17246: [SPARK-19906][SS][DOCS] Documentation describing how to ...

2017-03-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17246 **[Test build #74789 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74789/testReport)** for PR 17246 at commit [`a3f769c`](https://github.com/apache/spark/commit/a

[GitHub] spark issue #17246: [SPARK-19906][SS][DOCS] Documentation describing how to ...

2017-03-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17246 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74789/ Test PASSed. ---

[GitHub] spark issue #17192: [SPARK-19849][SQL] Support ArrayType in to_json to produ...

2017-03-18 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/17192 I will do another pass today and merge if others do not have more concerns? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If you

[GitHub] spark issue #17170: [SPARK-19825][R][ML] spark.ml R API for FPGrowth

2017-03-18 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/17170 I suppose we should wait on #17321 before acting on this PR? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark issue #17286: [SPARK-19915][SQL] Exclude cartesian product candidates ...

2017-03-18 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/17286 My example is not related to inequality join or equi join. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request #17274: [SPARK-19925][SPARKR] Fix SparkR spark.getSparkFi...

2017-03-18 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/17274#discussion_r106787436 --- Diff: R/pkg/inst/tests/testthat/test_context.R --- @@ -177,6 +177,13 @@ test_that("add and get file to be downloaded with Spark job on every node",

[GitHub] spark issue #17246: [SPARK-19906][SS][DOCS] Documentation describing how to ...

2017-03-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17246 **[Test build #74789 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74789/testReport)** for PR 17246 at commit [`a3f769c`](https://github.com/apache/spark/commit/a3

[GitHub] spark issue #17286: [SPARK-19915][SQL] Exclude cartesian product candidates ...

2017-03-18 Thread nsyca
Github user nsyca commented on the issue: https://github.com/apache/spark/pull/17286 @gatorsmile An equality join in most cases has a better filtering than an inequality join. This can be used heuristically. However, this is not always true. An equality join can be a lookup join from

[GitHub] spark issue #17274: [SPARK-19925][SPARKR] Fix SparkR spark.getSparkFiles fai...

2017-03-18 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/17274 test failed on appveyor - it looks like the connection to JVM is dead ``` . Error: add and get file to be downloaded with Spark job on every node (@test_context.R#184) org.apach

[GitHub] spark issue #16596: [SPARK-19237][SPARKR][CORE][WIP] spark-submit should han...

2017-03-18 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/16596 I've updated the PR title/description and JIRA to reflect what needs to be changed. Will work on this today. --- If your project is set up for it, you can reply to this email and have your

[GitHub] spark issue #16330: [SPARK-18817][SPARKR][SQL] change derby log output to te...

2017-03-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16330 **[Test build #74788 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74788/testReport)** for PR 16330 at commit [`2eb75f8`](https://github.com/apache/spark/commit/2e

[GitHub] spark issue #16982: [SPARK-19654][SPARKR][SS] Structured Streaming API for R

2017-03-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16982 **[Test build #74787 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74787/testReport)** for PR 16982 at commit [`d245bb9`](https://github.com/apache/spark/commit/d2

[GitHub] spark issue #17219: [SPARK-19876][SS][WIP] OneTime Trigger Executor

2017-03-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17219 **[Test build #74786 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74786/testReport)** for PR 17219 at commit [`fd28ed7`](https://github.com/apache/spark/commit/fd

[GitHub] spark issue #16330: [SPARK-18817][SPARKR][SQL] change derby log output to te...

2017-03-18 Thread shivaram
Github user shivaram commented on the issue: https://github.com/apache/spark/pull/16330 Great. I'll take a final look and wait for Jenkins --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #16982: [SPARK-19654][SPARKR][SS] Structured Streaming API for R

2017-03-18 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/16982 rebased and force pushed again to retest --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this featur

[GitHub] spark issue #16330: [SPARK-18817][SPARKR][SQL] change derby log output to te...

2017-03-18 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/16330 rebased and force pushed to retest --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enab

[GitHub] spark pull request #15666: [SPARK-11421] [Core][Python][R] Added ability for...

2017-03-18 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/15666#discussion_r106786961 --- Diff: R/pkg/R/context.R --- @@ -319,6 +319,34 @@ spark.addFile <- function(path, recursive = FALSE) { invisible(callJMethod(sc, "addFile", su

[GitHub] spark issue #17286: [SPARK-19915][SQL] Exclude cartesian product candidates ...

2017-03-18 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/17286 Given {A, B, C} with the join conditions {A.a = B.b, B.b > C.c}. `{A, C}` should be pruned. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHu

[GitHub] spark pull request #16626: [SPARK-19261][SQL] Alter add columns for Hive ser...

2017-03-18 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16626#discussion_r106786366 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/command/DDLSuite.scala --- @@ -2178,4 +2197,107 @@ abstract class DDLSuite extends Quer

[GitHub] spark pull request #16626: [SPARK-19261][SQL] Alter add columns for Hive ser...

2017-03-18 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16626#discussion_r106786357 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/command/DDLSuite.scala --- @@ -2178,4 +2197,107 @@ abstract class DDLSuite extends Quer

[GitHub] spark pull request #16626: [SPARK-19261][SQL] Alter add columns for Hive ser...

2017-03-18 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16626#discussion_r106786355 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/command/DDLSuite.scala --- @@ -2178,4 +2197,107 @@ abstract class DDLSuite extends Quer

[GitHub] spark pull request #16626: [SPARK-19261][SQL] Alter add columns for Hive ser...

2017-03-18 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16626#discussion_r106786328 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveDDLSuite.scala --- @@ -1860,4 +1861,119 @@ class HiveDDLSuite }

[GitHub] spark pull request #16626: [SPARK-19261][SQL] Alter add columns for Hive ser...

2017-03-18 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16626#discussion_r106786292 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveDDLSuite.scala --- @@ -1860,4 +1861,119 @@ class HiveDDLSuite }

[GitHub] spark pull request #16626: [SPARK-19261][SQL] Alter add columns for Hive ser...

2017-03-18 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16626#discussion_r106786279 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveDDLSuite.scala --- @@ -1860,4 +1861,119 @@ class HiveDDLSuite }

[GitHub] spark pull request #16626: [SPARK-19261][SQL] Alter add columns for Hive ser...

2017-03-18 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16626#discussion_r106786264 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveDDLSuite.scala --- @@ -1860,4 +1861,119 @@ class HiveDDLSuite }

[GitHub] spark pull request #16626: [SPARK-19261][SQL] Alter add columns for Hive ser...

2017-03-18 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16626#discussion_r106786173 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveDDLSuite.scala --- @@ -1860,4 +1861,119 @@ class HiveDDLSuite }

[GitHub] spark pull request #16626: [SPARK-19261][SQL] Alter add columns for Hive ser...

2017-03-18 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16626#discussion_r106786118 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/command/DDLSuite.scala --- @@ -166,6 +166,25 @@ class InMemoryCatalogedDDLSuite extends

[GitHub] spark pull request #16626: [SPARK-19261][SQL] Alter add columns for Hive ser...

2017-03-18 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16626#discussion_r106786038 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/tables.scala --- @@ -175,6 +178,75 @@ case class AlterTableRenameCommand( }

[GitHub] spark issue #15666: [SPARK-11421] [Core][Python][R] Added ability for addJar...

2017-03-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15666 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark pull request #16626: [SPARK-19261][SQL] Alter add columns for Hive ser...

2017-03-18 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16626#discussion_r106786022 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/catalog/SessionCatalog.scala --- @@ -296,6 +297,64 @@ class SessionCatalog( }

[GitHub] spark issue #15666: [SPARK-11421] [Core][Python][R] Added ability for addJar...

2017-03-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15666 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74782/ Test PASSed. ---

[GitHub] spark issue #15666: [SPARK-11421] [Core][Python][R] Added ability for addJar...

2017-03-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15666 **[Test build #74782 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74782/testReport)** for PR 15666 at commit [`e1a59c9`](https://github.com/apache/spark/commit/e

[GitHub] spark pull request #16626: [SPARK-19261][SQL] Alter add columns for Hive ser...

2017-03-18 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16626#discussion_r106785992 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/catalog/SessionCatalog.scala --- @@ -296,6 +297,64 @@ class SessionCatalog( }

[GitHub] spark issue #17267: [SPARK-19926][PYSPARK] Make pyspark exception more reada...

2017-03-18 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/17267 I'm not reviewing this patch. People who know better should merge it --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project do

[GitHub] spark pull request #16626: [SPARK-19261][SQL] Alter add columns for Hive ser...

2017-03-18 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16626#discussion_r106785853 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/catalog/SessionCatalog.scala --- @@ -296,6 +297,64 @@ class SessionCatalog( }

[GitHub] spark issue #15666: [SPARK-11421] [Core][Python][R] Added ability for addJar...

2017-03-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15666 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15666: [SPARK-11421] [Core][Python][R] Added ability for addJar...

2017-03-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15666 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74781/ Test PASSed. ---

[GitHub] spark issue #15363: [SPARK-17791][SQL] Join reordering using star schema det...

2017-03-18 Thread ioana-delaney
Github user ioana-delaney commented on the issue: https://github.com/apache/spark/pull/15363 @cloud-fan Thank you for the comments. I am looking at them. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project doe

[GitHub] spark issue #15666: [SPARK-11421] [Core][Python][R] Added ability for addJar...

2017-03-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15666 **[Test build #74781 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74781/testReport)** for PR 15666 at commit [`8f956c5`](https://github.com/apache/spark/commit/8

[GitHub] spark pull request #16626: [SPARK-19261][SQL] Alter add columns for Hive ser...

2017-03-18 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16626#discussion_r106785833 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/catalog/SessionCatalog.scala --- @@ -296,6 +297,64 @@ class SessionCatalog( }

[GitHub] spark issue #17341: [SPARK-20013][SQL]add a newTablePath parameter for renam...

2017-03-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17341 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17341: [SPARK-20013][SQL]add a newTablePath parameter for renam...

2017-03-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17341 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74785/ Test PASSed. ---

[GitHub] spark issue #17341: [SPARK-20013][SQL]add a newTablePath parameter for renam...

2017-03-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17341 **[Test build #74785 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74785/testReport)** for PR 17341 at commit [`857c4c2`](https://github.com/apache/spark/commit/8

[GitHub] spark pull request #16626: [SPARK-19261][SQL] Alter add columns for Hive ser...

2017-03-18 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16626#discussion_r106785796 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/catalog/SessionCatalog.scala --- @@ -296,6 +297,64 @@ class SessionCatalog( }

[GitHub] spark pull request #17290: [SPARK-16599][CORE] java.util.NoSuchElementExcept...

2017-03-18 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/17290 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #17166: [SPARK-19820] [core] Allow reason to be specified for ta...

2017-03-18 Thread kayousterhout
Github user kayousterhout commented on the issue: https://github.com/apache/spark/pull/17166 I realized you could also just let the task reason be the empty string (or some default reason) in the Executor code. That involves changing fewer LOC but doesn't seem like the right long-ter

[GitHub] spark issue #17290: [SPARK-16599][CORE] java.util.NoSuchElementException: No...

2017-03-18 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/17290 Merged to master. I don't believe this necessarily resolves the JIRA. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project d

[GitHub] spark issue #17286: [SPARK-19915][SQL] Exclude cartesian product candidates ...

2017-03-18 Thread ioana-delaney
Github user ioana-delaney commented on the issue: https://github.com/apache/spark/pull/17286 @wzhfy Given a set of input plans (either base table access or plans over derived/complex plans), one can build a graph based on the join conditions among the plans. I think join enumeration s

[GitHub] spark issue #17338: [SPARK-19990][SQL][test-maven]create a temp file for fil...

2017-03-18 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/17338 OK, so really the resource is resolved correctly here. It's just that it is currently re-resolved later to the wrong absolute path. Grabbing the correctly-resolved file at the time the resource is re

[GitHub] spark issue #17334: [SPARK-19998][Block Manager]BlockRDD block not found Exc...

2017-03-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17334 **[Test build #3602 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3602/testReport)** for PR 17334 at commit [`98393f8`](https://github.com/apache/spark/commit/9

[GitHub] spark issue #17339: [SPARK-20010][SQL] Sort information is lost after sort m...

2017-03-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17339 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74783/ Test PASSed. ---

[GitHub] spark issue #17339: [SPARK-20010][SQL] Sort information is lost after sort m...

2017-03-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17339 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17339: [SPARK-20010][SQL] Sort information is lost after sort m...

2017-03-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17339 **[Test build #74783 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74783/testReport)** for PR 17339 at commit [`f3b5b34`](https://github.com/apache/spark/commit/f

[GitHub] spark issue #17087: [SPARK-19372][SQL] Fix throwing a Java exception at df.f...

2017-03-18 Thread kiszk
Github user kiszk commented on the issue: https://github.com/apache/spark/pull/17087 ping @marmbrus, @davies --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes s

[GitHub] spark pull request #17138: [SPARK-17080] [SQL] join reorder

2017-03-18 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/17138#discussion_r106783976 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/CostBasedJoinReorder.scala --- @@ -0,0 +1,297 @@ +/* + * Licensed

[GitHub] spark issue #17341: [SPARK-20013][SQL]add a newTablePath parameter for renam...

2017-03-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17341 **[Test build #74785 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74785/testReport)** for PR 17341 at commit [`857c4c2`](https://github.com/apache/spark/commit/85

[GitHub] spark issue #17341: [SPARK-20013][SQL]add a newTablePath parameter for renam...

2017-03-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17341 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74784/ Test FAILed. ---

[GitHub] spark issue #17341: [SPARK-20013][SQL]add a newTablePath parameter for renam...

2017-03-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17341 **[Test build #74784 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74784/testReport)** for PR 17341 at commit [`a2615b7`](https://github.com/apache/spark/commit/a

[GitHub] spark issue #17341: [SPARK-20013][SQL]add a newTablePath parameter for renam...

2017-03-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17341 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17341: [SPARK-20013][SQL]add a newTablePath parameter for renam...

2017-03-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17341 **[Test build #74784 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74784/testReport)** for PR 17341 at commit [`a2615b7`](https://github.com/apache/spark/commit/a2

[GitHub] spark pull request #17341: [SPARK-20013][SQL]add a newTablePath parameter fo...

2017-03-18 Thread windpiger
Github user windpiger commented on a diff in the pull request: https://github.com/apache/spark/pull/17341#discussion_r106782193 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/catalog/ExternalCatalogSuite.scala --- @@ -732,40 +696,6 @@ abstract class ExternalCa

[GitHub] spark pull request #17331: [SPARK-19994][SQL] Wrong outputOrdering for right...

2017-03-18 Thread wzhfy
Github user wzhfy commented on a diff in the pull request: https://github.com/apache/spark/pull/17331#discussion_r106782184 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/PlannerSuite.scala --- @@ -557,6 +470,130 @@ class PlannerSuite extends SharedSQLContext {

[GitHub] spark pull request #17341: [SPARK-20013][SQL]add a newTablePath parameter fo...

2017-03-18 Thread windpiger
Github user windpiger commented on a diff in the pull request: https://github.com/apache/spark/pull/17341#discussion_r106782178 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/catalog/ExternalCatalogSuite.scala --- @@ -196,30 +196,6 @@ abstract class ExternalCa

[GitHub] spark pull request #17341: [SPARK-20013][SQL]add a newTablePath parameter fo...

2017-03-18 Thread windpiger
Github user windpiger commented on a diff in the pull request: https://github.com/apache/spark/pull/17341#discussion_r106782179 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/catalog/ExternalCatalogSuite.scala --- @@ -196,30 +196,6 @@ abstract class ExternalCa

[GitHub] spark pull request #17341: [SPARK-20013][SQL]add a newTablePath parameter fo...

2017-03-18 Thread windpiger
Github user windpiger commented on a diff in the pull request: https://github.com/apache/spark/pull/17341#discussion_r106782161 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/catalog/ExternalCatalogSuite.scala --- @@ -196,30 +196,6 @@ abstract class ExternalCa

[GitHub] spark pull request #17341: [SPARK-20013][SQL]add a newTablePath parameter fo...

2017-03-18 Thread windpiger
GitHub user windpiger opened a pull request: https://github.com/apache/spark/pull/17341 [SPARK-20013][SQL]add a newTablePath parameter for renameTable in ExternalCatalog ## What changes were proposed in this pull request? Currently when we create / rename a managed table, w

[GitHub] spark issue #17339: [SPARK-20010][SQL] Sort information is lost after sort m...

2017-03-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17339 **[Test build #74783 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74783/testReport)** for PR 17339 at commit [`f3b5b34`](https://github.com/apache/spark/commit/f3

[GitHub] spark issue #17339: [SPARK-20010][SQL] Sort information is lost after sort m...

2017-03-18 Thread wzhfy
Github user wzhfy commented on the issue: https://github.com/apache/spark/pull/17339 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark issue #15666: [SPARK-11421] [Core][Python][R] Added ability for addJar...

2017-03-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15666 **[Test build #74782 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74782/testReport)** for PR 15666 at commit [`e1a59c9`](https://github.com/apache/spark/commit/e1

[GitHub] spark pull request #17340: [SPARK-20013][SQL][WIP] merge renameTable to alte...

2017-03-18 Thread windpiger
Github user windpiger closed the pull request at: https://github.com/apache/spark/pull/17340 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #15666: [SPARK-11421] [Core][Python][R] Added ability for addJar...

2017-03-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15666 **[Test build #74781 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74781/testReport)** for PR 15666 at commit [`8f956c5`](https://github.com/apache/spark/commit/8f

[GitHub] spark pull request #15666: [SPARK-11421] [Core][Python][R] Added ability for...

2017-03-18 Thread mariusvniekerk
Github user mariusvniekerk commented on a diff in the pull request: https://github.com/apache/spark/pull/15666#discussion_r106781948 --- Diff: R/pkg/R/context.R --- @@ -319,6 +319,34 @@ spark.addFile <- function(path, recursive = FALSE) { invisible(callJMethod(sc, "addFile",

[GitHub] spark pull request #17138: [SPARK-17080] [SQL] join reorder

2017-03-18 Thread wzhfy
Github user wzhfy commented on a diff in the pull request: https://github.com/apache/spark/pull/17138#discussion_r106781914 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/CostBasedJoinReorder.scala --- @@ -0,0 +1,297 @@ +/* + * Licensed to th

[GitHub] spark pull request #17329: [SPARK-19991]FileSegmentManagedBuffer performance...

2017-03-18 Thread witgo
Github user witgo commented on a diff in the pull request: https://github.com/apache/spark/pull/17329#discussion_r106781598 --- Diff: common/network-common/src/main/java/org/apache/spark/network/buffer/FileSegmentManagedBuffer.java --- @@ -37,13 +37,24 @@ * A {@link ManagedB

[GitHub] spark issue #17340: [SPARK-20013][SQL][WIP] merge renameTable to alterTable ...

2017-03-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17340 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74780/ Test FAILed. ---

[GitHub] spark issue #17340: [SPARK-20013][SQL][WIP] merge renameTable to alterTable ...

2017-03-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17340 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17340: [SPARK-20013][SQL][WIP] merge renameTable to alterTable ...

2017-03-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17340 **[Test build #74780 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74780/testReport)** for PR 17340 at commit [`bea0956`](https://github.com/apache/spark/commit/b

[GitHub] spark issue #17334: [SPARK-19998][Block Manager]BlockRDD block not found Exc...

2017-03-18 Thread jianran
Github user jianran commented on the issue: https://github.com/apache/spark/pull/17334 @srowen Has removed --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #17340: [SPARK-20013][SQL] merge renameTable to alterTable in Ex...

2017-03-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17340 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74779/ Test FAILed. ---

[GitHub] spark issue #17340: [SPARK-20013][SQL] merge renameTable to alterTable in Ex...

2017-03-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17340 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17340: [SPARK-20013][SQL] merge renameTable to alterTable in Ex...

2017-03-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17340 **[Test build #74779 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74779/testReport)** for PR 17340 at commit [`7c8d92b`](https://github.com/apache/spark/commit/7

[GitHub] spark issue #17340: [SPARK-20013][SQL] merge renameTable to alterTable in Ex...

2017-03-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17340 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74778/ Test FAILed. ---

[GitHub] spark issue #17340: [SPARK-20013][SQL] merge renameTable to alterTable in Ex...

2017-03-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17340 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17340: [SPARK-20013][SQL] merge renameTable to alterTable in Ex...

2017-03-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17340 **[Test build #74778 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74778/testReport)** for PR 17340 at commit [`8d287d3`](https://github.com/apache/spark/commit/8

[GitHub] spark issue #17340: [SPARK-20013][SQL] merge renameTable to alterTable in Ex...

2017-03-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17340 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74777/ Test FAILed. ---

[GitHub] spark issue #17340: [SPARK-20013][SQL] merge renameTable to alterTable in Ex...

2017-03-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17340 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17340: [SPARK-20013][SQL] merge renameTable to alterTable in Ex...

2017-03-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17340 **[Test build #74777 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74777/testReport)** for PR 17340 at commit [`26c6c7b`](https://github.com/apache/spark/commit/2

[GitHub] spark issue #16867: [SPARK-16929] Improve performance when check speculatabl...

2017-03-18 Thread mridulm
Github user mridulm commented on the issue: https://github.com/apache/spark/pull/16867 LGTM @kayousterhout , @squito. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #17340: [SPARK-20013][SQL] merge renameTable to alterTabl...

2017-03-18 Thread windpiger
Github user windpiger commented on a diff in the pull request: https://github.com/apache/spark/pull/17340#discussion_r106780117 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/catalog/ExternalCatalogSuite.scala --- @@ -732,40 +676,6 @@ abstract class ExternalCa

[GitHub] spark pull request #17340: [SPARK-20013][SQL] merge renameTable to alterTabl...

2017-03-18 Thread windpiger
Github user windpiger commented on a diff in the pull request: https://github.com/apache/spark/pull/17340#discussion_r106780097 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/catalog/ExternalCatalogSuite.scala --- @@ -196,50 +196,6 @@ abstract class ExternalCa

[GitHub] spark pull request #17340: [SPARK-20013][SQL] merge renameTable to alterTabl...

2017-03-18 Thread windpiger
Github user windpiger commented on a diff in the pull request: https://github.com/apache/spark/pull/17340#discussion_r106780090 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/catalog/ExternalCatalogSuite.scala --- @@ -196,50 +196,6 @@ abstract class ExternalCa

[GitHub] spark issue #17340: [SPARK-20013][SQL] merge renameTable to alterTable in Ex...

2017-03-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17340 **[Test build #74780 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74780/testReport)** for PR 17340 at commit [`bea0956`](https://github.com/apache/spark/commit/be

[GitHub] spark pull request #17340: [SPARK-20013][SQL] merge renameTable to alterTabl...

2017-03-18 Thread windpiger
Github user windpiger commented on a diff in the pull request: https://github.com/apache/spark/pull/17340#discussion_r106780038 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/catalog/ExternalCatalogSuite.scala --- @@ -196,50 +196,6 @@ abstract class ExternalCa

[GitHub] spark pull request #17340: [SPARK-20013][SQL] merge renameTable to alterTabl...

2017-03-18 Thread windpiger
Github user windpiger commented on a diff in the pull request: https://github.com/apache/spark/pull/17340#discussion_r106780033 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/catalog/ExternalCatalogSuite.scala --- @@ -196,50 +196,6 @@ abstract class ExternalCa

[GitHub] spark pull request #17340: [SPARK-20013][SQL] merge renameTable to alterTabl...

2017-03-18 Thread windpiger
Github user windpiger commented on a diff in the pull request: https://github.com/apache/spark/pull/17340#discussion_r106780030 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/catalog/ExternalCatalogSuite.scala --- @@ -196,50 +196,6 @@ abstract class ExternalCa

<    1   2   3   4   >