[GitHub] spark issue #22011: [WIP][SPARK-24822][PySpark] Python support for barrier e...

2018-08-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22011 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #22011: [WIP][SPARK-24822][PySpark] Python support for barrier e...

2018-08-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/22011 **[Test build #94302 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94302/testReport)** for PR 22011 at commit

[GitHub] spark issue #22011: [WIP][SPARK-24822][PySpark] Python support for barrier e...

2018-08-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22011 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94302/ Test FAILed. ---

[GitHub] spark issue #21937: [SPARK-23914][SQL][follow-up] refactor ArrayUnion

2018-08-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21937 **[Test build #94304 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94304/testReport)** for PR 21937 at commit

[GitHub] spark issue #22010: [SPARK-21436][CORE] Take advantage of known partitioner ...

2018-08-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/22010 **[Test build #94303 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94303/testReport)** for PR 22010 at commit

[GitHub] spark issue #22011: [WIP][SPARK-24822][PySpark] Python support for barrier e...

2018-08-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/22011 **[Test build #94302 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94302/testReport)** for PR 22011 at commit

[GitHub] spark issue #22010: [SPARK-21436][CORE] Take advantage of known partitioner ...

2018-08-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22010 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark issue #22010: [SPARK-21436][CORE] Take advantage of known partitioner ...

2018-08-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22010 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #22011: [WIP][SPARK-24822][PySpark] Python support for barrier e...

2018-08-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22011 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark issue #22011: [WIP][SPARK-24822][PySpark] Python support for barrier e...

2018-08-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22011 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #22001: [SPARK-24819][CORE] Fail fast when no enough slots to la...

2018-08-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22001 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94278/ Test FAILed. ---

[GitHub] spark pull request #22011: [WIP][SPARK-24822][PySpark] Python support for ba...

2018-08-06 Thread jiangxb1987
GitHub user jiangxb1987 opened a pull request: https://github.com/apache/spark/pull/22011 [WIP][SPARK-24822][PySpark] Python support for barrier execution mode ## What changes were proposed in this pull request? This PR add python support for barrier execution mode, thus

[GitHub] spark issue #22001: [SPARK-24819][CORE] Fail fast when no enough slots to la...

2018-08-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22001 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark pull request #22010: [SPARK-21436] Take advantage of known partioner f...

2018-08-06 Thread holdenk
GitHub user holdenk opened a pull request: https://github.com/apache/spark/pull/22010 [SPARK-21436] Take advantage of known partioner for distinct on RDDs to avoid a shuffle ## What changes were proposed in this pull request? Special case the situation where we know

[GitHub] spark issue #22001: [SPARK-24819][CORE] Fail fast when no enough slots to la...

2018-08-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/22001 **[Test build #94278 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94278/testReport)** for PR 22001 at commit

[GitHub] spark issue #21986: [SPARK-23937][SQL] Add map_filter SQL function

2018-08-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21986 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21986: [SPARK-23937][SQL] Add map_filter SQL function

2018-08-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21986 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94291/ Test FAILed. ---

[GitHub] spark issue #21986: [SPARK-23937][SQL] Add map_filter SQL function

2018-08-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21986 **[Test build #94291 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94291/testReport)** for PR 21986 at commit

[GitHub] spark issue #21898: [SPARK-24817][Core] Implement BarrierTaskContext.barrier...

2018-08-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21898 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94286/ Test FAILed. ---

[GitHub] spark issue #22009: [SPARK-24882][SQL] improve data source v2 API

2018-08-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22009 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #22009: [SPARK-24882][SQL] improve data source v2 API

2018-08-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22009 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94301/ Test FAILed. ---

[GitHub] spark issue #21986: [SPARK-23937][SQL] Add map_filter SQL function

2018-08-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21986 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94280/ Test PASSed. ---

[GitHub] spark issue #21898: [SPARK-24817][Core] Implement BarrierTaskContext.barrier...

2018-08-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21898 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #22009: [SPARK-24882][SQL] improve data source v2 API

2018-08-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/22009 **[Test build #94301 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94301/testReport)** for PR 22009 at commit

[GitHub] spark issue #21986: [SPARK-23937][SQL] Add map_filter SQL function

2018-08-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21986 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21898: [SPARK-24817][Core] Implement BarrierTaskContext.barrier...

2018-08-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21898 **[Test build #94286 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94286/testReport)** for PR 21898 at commit

[GitHub] spark issue #21986: [SPARK-23937][SQL] Add map_filter SQL function

2018-08-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21986 **[Test build #94280 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94280/testReport)** for PR 21986 at commit

[GitHub] spark issue #22009: [SPARK-24882][SQL] improve data source v2 API

2018-08-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/22009 **[Test build #94301 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94301/testReport)** for PR 22009 at commit

[GitHub] spark issue #22009: [SPARK-24882][SQL] improve data source v2 API

2018-08-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22009 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark issue #22009: [SPARK-24882][SQL] improve data source v2 API

2018-08-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22009 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark pull request #22009: [SPARK-24882][SQL] improve data source v2 API

2018-08-06 Thread jose-torres
Github user jose-torres commented on a diff in the pull request: https://github.com/apache/spark/pull/22009#discussion_r207978414 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/memory.scala --- @@ -122,24 +119,22 @@ case class MemoryStream[A :

[GitHub] spark issue #21991: [SPARK-25018] [Infra] Use `Co-authored-by` and `Signed-o...

2018-08-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21991 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21991: [SPARK-25018] [Infra] Use `Co-authored-by` and `Signed-o...

2018-08-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21991 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark issue #22006: [SPARK-25031][SQL] Fix MapType schema print

2018-08-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22006 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #22006: [SPARK-25031][SQL] Fix MapType schema print

2018-08-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22006 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94282/ Test PASSed. ---

[GitHub] spark issue #22006: [SPARK-25031][SQL] Fix MapType schema print

2018-08-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/22006 **[Test build #94282 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94282/testReport)** for PR 22006 at commit

[GitHub] spark pull request #22009: [SPARK-24882][SQL] improve data source v2 API

2018-08-06 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/22009#discussion_r207976440 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/memory.scala --- @@ -122,24 +119,22 @@ case class MemoryStream[A :

[GitHub] spark issue #20611: [SPARK-23425][SQL]Support wildcard in HDFS path for load...

2018-08-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20611 **[Test build #94300 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94300/testReport)** for PR 20611 at commit

[GitHub] spark issue #21991: [SPARK-25018] [Infra] Use `Co-authored-by` and `Signed-o...

2018-08-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21991 **[Test build #94299 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94299/testReport)** for PR 21991 at commit

[GitHub] spark issue #22009: [SPARK-24882][SQL] improve data source v2 API

2018-08-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22009 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark issue #22009: [SPARK-24882][SQL] improve data source v2 API

2018-08-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22009 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20611: [SPARK-23425][SQL]Support wildcard in HDFS path for load...

2018-08-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20611 **[Test build #94298 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94298/testReport)** for PR 20611 at commit

[GitHub] spark issue #20611: [SPARK-23425][SQL]Support wildcard in HDFS path for load...

2018-08-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20611 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94298/ Test FAILed. ---

[GitHub] spark issue #20611: [SPARK-23425][SQL]Support wildcard in HDFS path for load...

2018-08-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20611 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #22009: [SPARK-24882][SQL] improve data source v2 API

2018-08-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22009 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94297/ Test FAILed. ---

[GitHub] spark issue #22009: [SPARK-24882][SQL] improve data source v2 API

2018-08-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22009 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #22009: [SPARK-24882][SQL] improve data source v2 API

2018-08-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/22009 **[Test build #94297 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94297/testReport)** for PR 22009 at commit

[GitHub] spark issue #21898: [SPARK-24817][Core] Implement BarrierTaskContext.barrier...

2018-08-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21898 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94279/ Test FAILed. ---

[GitHub] spark issue #21087: [SPARK-23997][SQL] Configurable maximum number of bucket...

2018-08-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21087 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94276/ Test PASSed. ---

[GitHub] spark issue #21087: [SPARK-23997][SQL] Configurable maximum number of bucket...

2018-08-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21087 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21898: [SPARK-24817][Core] Implement BarrierTaskContext.barrier...

2018-08-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21898 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20611: [SPARK-23425][SQL]Support wildcard in HDFS path for load...

2018-08-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20611 **[Test build #94298 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94298/testReport)** for PR 20611 at commit

[GitHub] spark issue #22009: [SPARK-24882][SQL] improve data source v2 API

2018-08-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/22009 **[Test build #94297 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94297/testReport)** for PR 22009 at commit

[GitHub] spark issue #21898: [SPARK-24817][Core] Implement BarrierTaskContext.barrier...

2018-08-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21898 **[Test build #94279 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94279/testReport)** for PR 21898 at commit

[GitHub] spark issue #21087: [SPARK-23997][SQL] Configurable maximum number of bucket...

2018-08-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21087 **[Test build #94276 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94276/testReport)** for PR 21087 at commit

[GitHub] spark pull request #21980: [SPARK-25010][SQL] Rand/Randn should produce diff...

2018-08-06 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/21980#discussion_r207971182 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/IncrementalExecution.scala --- @@ -75,14 +74,11 @@ class IncrementalExecution(

[GitHub] spark pull request #21451: [SPARK-24296][CORE] Replicate large blocks as a s...

2018-08-06 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/21451#discussion_r207968882 --- Diff: core/src/main/scala/org/apache/spark/storage/BlockManager.scala --- @@ -404,6 +405,47 @@ private[spark] class BlockManager(

[GitHub] spark issue #21991: [SPARK-25018] [Infra] Use `Co-authored-by` and `Signed-o...

2018-08-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21991 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21991: [SPARK-25018] [Infra] Use `Co-authored-by` and `Signed-o...

2018-08-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21991 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request #21102: [SPARK-23913][SQL] Add array_intersect function

2018-08-06 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/21102#discussion_r207967923 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/collectionOperations.scala --- @@ -3965,6 +4034,248 @@ object ArrayUnion {

[GitHub] spark issue #22009: [SPARK-24882][SQL] improve data source v2 API

2018-08-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22009 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94294/ Test FAILed. ---

[GitHub] spark issue #22009: [SPARK-24882][SQL] improve data source v2 API

2018-08-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/22009 **[Test build #94294 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94294/testReport)** for PR 22009 at commit

[GitHub] spark issue #22009: [SPARK-24882][SQL] improve data source v2 API

2018-08-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22009 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21944: [SPARK-24988][SQL]Add a castBySchema method which casts ...

2018-08-06 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/21944 Thanks, Mahmoud! --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #22009: [SPARK-24882][SQL] improve data source v2 API

2018-08-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/22009 **[Test build #94294 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94294/testReport)** for PR 22009 at commit

[GitHub] spark issue #21923: [SPARK-24918][Core] Executor Plugin api

2018-08-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21923 **[Test build #94296 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94296/testReport)** for PR 21923 at commit

[GitHub] spark issue #21991: [SPARK-25018] [Infra] Use `Co-authored-by` and `Signed-o...

2018-08-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21991 **[Test build #94295 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94295/testReport)** for PR 21991 at commit

[GitHub] spark issue #21923: [SPARK-24918][Core] Executor Plugin api

2018-08-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21923 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark issue #22009: [SPARK-24882][SQL] improve data source v2 API

2018-08-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22009 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21923: [SPARK-24918][Core] Executor Plugin api

2018-08-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21923 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #22009: [SPARK-24882][SQL] improve data source v2 API

2018-08-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22009 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark issue #22009: [SPARK-24882][SQL] improve data source v2 API

2018-08-06 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/22009 cc @rxin @rdblue @jose-torres @marmbrus @gengliangwang @gatorsmile --- - To unsubscribe, e-mail:

[GitHub] spark pull request #22009: [SPARK-24882][SQL] improve data source v2 API

2018-08-06 Thread cloud-fan
GitHub user cloud-fan opened a pull request: https://github.com/apache/spark/pull/22009 [SPARK-24882][SQL] improve data source v2 API ## What changes were proposed in this pull request? Improve the data source v2 API according to the [design

[GitHub] spark issue #21608: [SPARK-24626] [SQL] Improve location size calculation in...

2018-08-06 Thread Achuth17
Github user Achuth17 commented on the issue: https://github.com/apache/spark/pull/21608 @maropu @gatorsmile, Any other changes required? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For

[GitHub] spark pull request #21986: [SPARK-23937][SQL] Add map_filter SQL function

2018-08-06 Thread ueshin
Github user ueshin commented on a diff in the pull request: https://github.com/apache/spark/pull/21986#discussion_r207965203 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/higherOrderFunctions.scala --- @@ -205,29 +230,82 @@ case class

[GitHub] spark pull request #21937: [SPARK-23914][SQL][follow-up] refactor ArrayUnion

2018-08-06 Thread ueshin
Github user ueshin commented on a diff in the pull request: https://github.com/apache/spark/pull/21937#discussion_r207962845 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/collectionOperations.scala --- @@ -3767,230 +3767,160 @@ object

[GitHub] spark pull request #22003: [SPARK-25019][BUILD] Fix orc dependency to use th...

2018-08-06 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/22003#discussion_r207962501 --- Diff: sql/core/pom.xml --- @@ -90,39 +90,11 @@ org.apache.orc orc-core ${orc.classifier} - - -

[GitHub] spark pull request #21919: [SPARK-24933][SS] Report numOutputRows in SinkPro...

2018-08-06 Thread jose-torres
Github user jose-torres commented on a diff in the pull request: https://github.com/apache/spark/pull/21919#discussion_r207961663 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/WriteToDataSourceV2.scala --- @@ -179,3 +192,24 @@ class

[GitHub] spark pull request #22003: [SPARK-25019][BUILD] Fix orc dependency to use th...

2018-08-06 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/22003#discussion_r207960480 --- Diff: sql/core/pom.xml --- @@ -90,39 +90,11 @@ org.apache.orc orc-core ${orc.classifier} - -

[GitHub] spark issue #22004: [WIP][SPARK-25029][TESTS] Scala 2.12 issues: TaskNotSeri...

2018-08-06 Thread skonto
Github user skonto commented on the issue: https://github.com/apache/spark/pull/22004 @srowen Lukas has reproduced the TasksErialization issue for the `FailThisAttempt` object with a minimal program outside Spark. He is going to investigate further. This has nothing to do with the

[GitHub] spark issue #21222: [SPARK-24161][SS] Enable debug package feature on struct...

2018-08-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21222 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21222: [SPARK-24161][SS] Enable debug package feature on struct...

2018-08-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21222 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94285/ Test FAILed. ---

[GitHub] spark pull request #21980: [SPARK-25010][SQL] Rand/Randn should produce diff...

2018-08-06 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/21980#discussion_r207957197 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/IncrementalExecution.scala --- @@ -75,14 +74,11 @@ class

[GitHub] spark issue #21222: [SPARK-24161][SS] Enable debug package feature on struct...

2018-08-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21222 **[Test build #94285 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94285/testReport)** for PR 21222 at commit

[GitHub] spark pull request #21860: [SPARK-24901][SQL]Merge the codegen of RegularHas...

2018-08-06 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/21860#discussion_r207955873 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/WholeStageCodegenSuite.scala --- @@ -232,6 +232,23 @@ class WholeStageCodegenSuite extends

[GitHub] spark pull request #21909: [SPARK-24959][SQL] Speed up count() for JSON and ...

2018-08-06 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/21909#discussion_r207955299 --- Diff: docs/sql-programming-guide.md --- @@ -1892,6 +1892,7 @@ working with timestamps in `pandas_udf`s to get the best performance, see - In

[GitHub] spark issue #22008: [SPARK-24928][SQL] Optimize cross join according to stat...

2018-08-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/22008 **[Test build #94293 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94293/testReport)** for PR 22008 at commit

[GitHub] spark pull request #21986: [SPARK-23937][SQL] Add map_filter SQL function

2018-08-06 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/21986#discussion_r207954320 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/higherOrderFunctions.scala --- @@ -123,7 +125,10 @@ trait

[GitHub] spark issue #22008: [SPARK-24928][SQL] Optimize cross join according to stat...

2018-08-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22008 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark issue #22008: [SPARK-24928][SQL] Optimize cross join according to stat...

2018-08-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22008 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark pull request #22008: [SPARK-24928][SQL] Optimize cross join according ...

2018-08-06 Thread mgaido91
GitHub user mgaido91 opened a pull request: https://github.com/apache/spark/pull/22008 [SPARK-24928][SQL] Optimize cross join according to stats ## What changes were proposed in this pull request? The cartesian product of 2 RDDs perform a nested loop. This means that the

[GitHub] spark issue #21939: [SPARK-23874][SQL][PYTHON] Upgrade Apache Arrow to 0.10....

2018-08-06 Thread shaneknapp
Github user shaneknapp commented on the issue: https://github.com/apache/spark/pull/21939 @BryanCutler we currently test spark against only one version of pyarrow (and against py27 and py34).. setting things up to test against a matrix of python/pyarrow versions will have to

[GitHub] spark pull request #21102: [SPARK-23913][SQL] Add array_intersect function

2018-08-06 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/21102#discussion_r207945648 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/collectionOperations.scala --- @@ -3965,6 +4034,248 @@ object ArrayUnion

[GitHub] spark issue #21403: [SPARK-24341][SQL] Support only IN subqueries with the s...

2018-08-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21403 **[Test build #94292 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94292/testReport)** for PR 21403 at commit

[GitHub] spark issue #21305: [SPARK-24251][SQL] Add AppendData logical plan.

2018-08-06 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/21305 LGTM, can you resolve the conflict and address my concern about filling null for nullable missing fields? I think it's ready to go. thanks! ---

[GitHub] spark issue #21986: [SPARK-23937][SQL] Add map_filter SQL function

2018-08-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21986 **[Test build #94291 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94291/testReport)** for PR 21986 at commit

[GitHub] spark issue #21403: [SPARK-24341][SQL] Support only IN subqueries with the s...

2018-08-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21403 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21403: [SPARK-24341][SQL] Support only IN subqueries with the s...

2018-08-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21403 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark issue #21986: [SPARK-23937][SQL] Add map_filter SQL function

2018-08-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21986 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21986: [SPARK-23937][SQL] Add map_filter SQL function

2018-08-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21986 Test PASSed. Refer to this link for build results (access rights to CI server needed):

<    1   2   3   4   5   6   7   8   >