[GitHub] spark issue #20043: [SPARK-22856][SQL] Add wrappers for codegen output and n...

2018-01-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20043 **[Test build #85588 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85588/testReport)** for PR 20043 at commit

[GitHub] spark issue #20043: [SPARK-22856][SQL] Add wrappers for codegen output and n...

2018-01-01 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/20043 retest this please. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #20072: [SPARK-22790][SQL] add a configurable factor to describe...

2018-01-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20072 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/85586/ Test PASSed. ---

[GitHub] spark issue #20072: [SPARK-22790][SQL] add a configurable factor to describe...

2018-01-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20072 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20072: [SPARK-22790][SQL] add a configurable factor to describe...

2018-01-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20072 **[Test build #85586 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85586/testReport)** for PR 20072 at commit

[GitHub] spark issue #20133: [SPARK-22934] [SQL] Make optional clauses order insensit...

2018-01-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20133 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/85585/ Test PASSed. ---

[GitHub] spark issue #20133: [SPARK-22934] [SQL] Make optional clauses order insensit...

2018-01-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20133 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20133: [SPARK-22934] [SQL] Make optional clauses order insensit...

2018-01-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20133 **[Test build #85585 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85585/testReport)** for PR 20133 at commit

[GitHub] spark issue #20133: [SPARK-22934] [SQL] Make optional clauses order insensit...

2018-01-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20133 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20133: [SPARK-22934] [SQL] Make optional clauses order insensit...

2018-01-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20133 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/85584/ Test PASSed. ---

[GitHub] spark issue #20133: [SPARK-22934] [SQL] Make optional clauses order insensit...

2018-01-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20133 **[Test build #85584 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85584/testReport)** for PR 20133 at commit

[GitHub] spark issue #20116: [SPARK-20960][SQL] make ColumnVector public

2018-01-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20116 **[Test build #85587 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85587/testReport)** for PR 20116 at commit

[GitHub] spark issue #20119: [SPARK-21475][Core]Revert "[SPARK-21475][CORE] Use NIO's...

2018-01-01 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/20119 let's also cc the author. @jerryshao do you know if there is a way to fix the regression? --- - To unsubscribe, e-mail:

[GitHub] spark issue #20120: [SPARK-22926] [SQL] Respect table-level conf compression...

2018-01-01 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/20120 I think we should document the difference between table options and properties. AFAIK we added table properties to data source tables since Spark 2.3, and previously table options is the only

[GitHub] spark issue #20082: [SPARK-22897][CORE]: Expose stageAttemptId in TaskContex...

2018-01-01 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/20082 LGTM --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark pull request #20082: [SPARK-22897][CORE]: Expose stageAttemptId in Tas...

2018-01-01 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/20082#discussion_r159175320 --- Diff: core/src/main/scala/org/apache/spark/scheduler/Task.scala --- @@ -79,6 +79,7 @@ private[spark] abstract class Task[T](

[GitHub] spark issue #19077: [SPARK-21860][core]Improve memory reuse for heap memory ...

2018-01-01 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/19077 The idea LGTM, but I think we can simplify the implementation to allow the memory allocator to return a larger memory than requested. ---

[GitHub] spark pull request #20072: [SPARK-22790][SQL] add a configurable factor to d...

2018-01-01 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/20072#discussion_r159175078 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala --- @@ -261,6 +261,17 @@ object SQLConf { .booleanConf

[GitHub] spark pull request #20072: [SPARK-22790][SQL] add a configurable factor to d...

2018-01-01 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/20072#discussion_r159175087 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/HadoopFsRelation.scala --- @@ -82,7 +82,11 @@ case class HadoopFsRelation(

[GitHub] spark pull request #20127: [SPARK-22932] [SQL] Refactor AnalysisContext

2018-01-01 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/20127#discussion_r159174832 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala --- @@ -95,6 +98,17 @@ class Analyzer(

[GitHub] spark issue #20078: [SPARK-22900] [Spark-Streaming] Remove unnecessary restr...

2018-01-01 Thread sharkdtu
Github user sharkdtu commented on the issue: https://github.com/apache/spark/pull/20078 @felixcheung if you submit spark on yarn with `spark.streaming.dynamicAllocation.enabled=true`, the `num-executors` can not be set. So, at the begining, there are only 2(default value)

[GitHub] spark issue #20087: [SPARK-21786][SQL] The 'spark.sql.parquet.compression.co...

2018-01-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20087 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/85583/ Test FAILed. ---

[GitHub] spark issue #20087: [SPARK-21786][SQL] The 'spark.sql.parquet.compression.co...

2018-01-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20087 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20087: [SPARK-21786][SQL] The 'spark.sql.parquet.compression.co...

2018-01-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20087 **[Test build #85583 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85583/testReport)** for PR 20087 at commit

[GitHub] spark issue #20072: [SPARK-22790][SQL] add a configurable factor to describe...

2018-01-01 Thread CodingCat
Github user CodingCat commented on the issue: https://github.com/apache/spark/pull/20072 @wzhfy thanks for the review, please take a look --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For

[GitHub] spark issue #20072: [SPARK-22790][SQL] add a configurable factor to describe...

2018-01-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20072 **[Test build #85586 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85586/testReport)** for PR 20072 at commit

[GitHub] spark pull request #20072: [SPARK-22790][SQL] add a configurable factor to d...

2018-01-01 Thread CodingCat
Github user CodingCat commented on a diff in the pull request: https://github.com/apache/spark/pull/20072#discussion_r159171970 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala --- @@ -261,6 +261,17 @@ object SQLConf { .booleanConf

[GitHub] spark issue #20133: [SPARK-22934] [SQL] Make optional clauses order insensit...

2018-01-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20133 **[Test build #85585 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85585/testReport)** for PR 20133 at commit

[GitHub] spark issue #20133: [SPARK-22934] [SQL] Make optional clauses order insensit...

2018-01-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20133 **[Test build #85584 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85584/testReport)** for PR 20133 at commit

[GitHub] spark pull request #20133: [SPARK-22934] [SQL] Make optional clauses order i...

2018-01-01 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/20133#discussion_r159170627 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveDDLSuite.scala --- @@ -875,12 +875,13 @@ class HiveDDLSuite

[GitHub] spark pull request #20133: [SPARK-22934] [SQL] Make optional clauses order i...

2018-01-01 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/20133#discussion_r159170624 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/command/DDLSuite.scala --- @@ -1971,8 +1971,8 @@ abstract class DDLSuite extends

[GitHub] spark pull request #20133: [SPARK-22934] [SQL] Make optional clauses order i...

2018-01-01 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/20133#discussion_r159170240 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkSqlParser.scala --- @@ -384,22 +384,31 @@ class SparkSqlAstBuilder(conf: SQLConf)

[GitHub] spark pull request #20133: [SPARK-22934] [SQL] Make optional clauses order i...

2018-01-01 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/20133#discussion_r159170197 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkSqlParser.scala --- @@ -408,9 +417,17 @@ class SparkSqlAstBuilder(conf: SQLConf)

[GitHub] spark pull request #20133: [SPARK-22934] [SQL] Make optional clauses order i...

2018-01-01 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/20133#discussion_r159170195 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/parser/ParserUtils.scala --- @@ -39,6 +41,17 @@ object ParserUtils { throw

[GitHub] spark issue #20082: [SPARK-22897][CORE]: Expose stageAttemptId in TaskContex...

2018-01-01 Thread advancedxy
Github user advancedxy commented on the issue: https://github.com/apache/spark/pull/20082 @cloud-fan Please take another look. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20087: [SPARK-21786][SQL] The 'spark.sql.parquet.compression.co...

2018-01-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20087 **[Test build #85583 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85583/testReport)** for PR 20087 at commit

[GitHub] spark issue #20087: [SPARK-21786][SQL] The 'spark.sql.parquet.compression.co...

2018-01-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20087 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20087: [SPARK-21786][SQL] The 'spark.sql.parquet.compression.co...

2018-01-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20087 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/85582/ Test FAILed. ---

[GitHub] spark issue #20087: [SPARK-21786][SQL] The 'spark.sql.parquet.compression.co...

2018-01-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20087 **[Test build #85582 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85582/testReport)** for PR 20087 at commit

[GitHub] spark issue #20087: [SPARK-21786][SQL] The 'spark.sql.parquet.compression.co...

2018-01-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20087 **[Test build #85582 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85582/testReport)** for PR 20087 at commit

[GitHub] spark pull request #20133: [SPARK-22934] [SQL] Make optional clauses order i...

2018-01-01 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/20133#discussion_r159168832 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/command/DDLParserSuite.scala --- @@ -1153,65 +1191,165 @@ class DDLParserSuite

[GitHub] spark pull request #20133: [SPARK-22934] [SQL] Make optional clauses order i...

2018-01-01 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/20133#discussion_r159168804 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveDDLSuite.scala --- @@ -875,12 +875,13 @@ class HiveDDLSuite

[GitHub] spark pull request #20133: [SPARK-22934] [SQL] Make optional clauses order i...

2018-01-01 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/20133#discussion_r159168759 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/command/DDLSuite.scala --- @@ -1971,8 +1971,8 @@ abstract class DDLSuite extends

[GitHub] spark pull request #20127: [SPARK-22932] [SQL] Refactor AnalysisContext

2018-01-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/20127 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request #20127: [SPARK-22932] [SQL] Refactor AnalysisContext

2018-01-01 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/20127#discussion_r159168110 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala --- @@ -70,6 +71,8 @@ object AnalysisContext { }

[GitHub] spark issue #20127: [SPARK-22932] [SQL] Refactor AnalysisContext

2018-01-01 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/20127 Thanks! Merged to master --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #19968: [SPARK-22769][CORE] When driver stopping, there is error...

2018-01-01 Thread KaiXinXiaoLei
Github user KaiXinXiaoLei commented on the issue: https://github.com/apache/spark/pull/19968 @srowen ok ,i will update, thanks --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark pull request #19968: [SPARK-22769][CORE] When driver stopping, there i...

2018-01-01 Thread KaiXinXiaoLei
Github user KaiXinXiaoLei commented on a diff in the pull request: https://github.com/apache/spark/pull/19968#discussion_r159167935 --- Diff: core/src/main/scala/org/apache/spark/rpc/netty/Dispatcher.scala --- @@ -100,6 +102,7 @@ private[netty] class Dispatcher(nettyEnv:

[GitHub] spark issue #19498: [SPARK-17756][PYTHON][STREAMING] Workaround to avoid ret...

2018-01-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19498 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/85581/ Test PASSed. ---

[GitHub] spark issue #19498: [SPARK-17756][PYTHON][STREAMING] Workaround to avoid ret...

2018-01-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19498 **[Test build #85581 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85581/testReport)** for PR 19498 at commit

[GitHub] spark issue #19498: [SPARK-17756][PYTHON][STREAMING] Workaround to avoid ret...

2018-01-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19498 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19498: [SPARK-17756][PYTHON][STREAMING] Workaround to avoid ret...

2018-01-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19498 **[Test build #85581 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85581/testReport)** for PR 19498 at commit

[GitHub] spark issue #19498: [SPARK-17756][PYTHON][STREAMING] Workaround to avoid ret...

2018-01-01 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/19498 retest this please --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark pull request #20133: [SPARK-22934] [SQL] Make optional clauses order i...

2018-01-01 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/20133#discussion_r159150554 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkSqlParser.scala --- @@ -384,22 +384,31 @@ class SparkSqlAstBuilder(conf: SQLConf)

[GitHub] spark pull request #20128: [SPARK-21893][SPARK-22142][TESTS][FOLLOWUP] Enabl...

2018-01-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/20128 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #20128: [SPARK-21893][SPARK-22142][TESTS][FOLLOWUP] Enables PySp...

2018-01-01 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/20128 Merged to master. Thank you @srowen, @felixcheung and @ueshin for reviewing this. --- - To unsubscribe, e-mail:

[GitHub] spark pull request #20114: [SPARK-22530][PYTHON][SQL] Adding Arrow support f...

2018-01-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/20114 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #20114: [SPARK-22530][PYTHON][SQL] Adding Arrow support for Arra...

2018-01-01 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/20114 Merged to master. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #20131: [MINOR] Fix a bunch of typos

2018-01-01 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/20131 Merged to master - https://github.com/apache/spark/commit/c284c4e1f6f684ca8db1cc446fdcc43b46e3413c --- - To unsubscribe,

[GitHub] spark pull request #20106: [SPARK-21616][SPARKR][DOCS] update R migration gu...

2018-01-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/20106 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #20106: [SPARK-21616][SPARKR][DOCS] update R migration guide and...

2018-01-01 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/20106 Merged to master. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark pull request #20133: [SPARK-22934] [SQL] Make optional clauses order i...

2018-01-01 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/20133#discussion_r159164626 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkSqlParser.scala --- @@ -408,9 +417,17 @@ class SparkSqlAstBuilder(conf: SQLConf)

[GitHub] spark issue #20078: [SPARK-22900] [Spark-Streaming] Remove unnecessary restr...

2018-01-01 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/20078 hmm, that sounds like a different problem, why is numReceivers set to > spark.cores.max? --- - To unsubscribe, e-mail:

[GitHub] spark issue #18714: [SPARK-20236][SQL] runtime partition overwrite

2018-01-01 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/18714 ah yes, please please :) --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark pull request #20068: [SPARK-17916][SQL] Fix empty string being parsed ...

2018-01-01 Thread aa8y
Github user aa8y commented on a diff in the pull request: https://github.com/apache/spark/pull/20068#discussion_r159160508 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/CSVOptions.scala --- @@ -152,7 +152,11 @@ class CSVOptions(

[GitHub] spark issue #20127: [SPARK-22932] [SQL] Refactor AnalysisContext

2018-01-01 Thread jiangxb1987
Github user jiangxb1987 commented on the issue: https://github.com/apache/spark/pull/20127 lgtm --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #18714: [SPARK-20236][SQL] runtime partition overwrite

2018-01-01 Thread jiangxb1987
Github user jiangxb1987 commented on the issue: https://github.com/apache/spark/pull/18714 Is this PR still targeted to 2.3? @cloud-fan @gatorsmile --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org

[GitHub] spark issue #19077: [SPARK-21860][core]Improve memory reuse for heap memory ...

2018-01-01 Thread jiangxb1987
Github user jiangxb1987 commented on the issue: https://github.com/apache/spark/pull/19077 ping @cloud-fan shall we continue with this PR? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For

[GitHub] spark issue #19992: [SPARK-22805][CORE] Use StorageLevel aliases in event lo...

2018-01-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19992 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19992: [SPARK-22805][CORE] Use StorageLevel aliases in event lo...

2018-01-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19992 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/85580/ Test PASSed. ---

[GitHub] spark issue #14180: [SPARK-16367][PYSPARK] Support for deploying Anaconda an...

2018-01-01 Thread jiangxb1987
Github user jiangxb1987 commented on the issue: https://github.com/apache/spark/pull/14180 gentle ping @ueshin --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #19992: [SPARK-22805][CORE] Use StorageLevel aliases in event lo...

2018-01-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19992 **[Test build #85580 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85580/testReport)** for PR 19992 at commit

[GitHub] spark issue #20133: [SPARK-22934] [SQL] Make optional clauses order insensit...

2018-01-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20133 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/85578/ Test PASSed. ---

[GitHub] spark issue #20133: [SPARK-22934] [SQL] Make optional clauses order insensit...

2018-01-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20133 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20133: [SPARK-22934] [SQL] Make optional clauses order insensit...

2018-01-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20133 **[Test build #85578 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85578/testReport)** for PR 20133 at commit

[GitHub] spark pull request #20132: [SPARK-13030][ML] Follow-up cleanups for OneHotEn...

2018-01-01 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/20132#discussion_r159157608 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/OneHotEncoderEstimator.scala --- @@ -205,60 +210,58 @@ class OneHotEncoderModel private[ml] (

[GitHub] spark pull request #19035: [SPARK-21822][SQL]When insert Hive Table is finis...

2018-01-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/19035 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request #19917: [SPARK-22725][SQL] Add failing test for select wi...

2018-01-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/19917 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request #20130: [BUILD] Close stale PRs

2018-01-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/20130 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request #20044: [SPARK-22857] Optimize code by inspecting code

2018-01-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/20044 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request #20131: [MINOR] Fix a bunch of typos

2018-01-01 Thread srowen
Github user srowen closed the pull request at: https://github.com/apache/spark/pull/20131 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request #19936: Branch 0.5

2018-01-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/19936 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request #19919: [SPARK-22727] spark.executor.instances's default ...

2018-01-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/19919 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request #18916: [SPARK-21705][CORE][DOC]Add spark.internal.config...

2018-01-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/18916 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request #20027: Branch 2.2

2018-01-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/20027 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request #19933: [SPARK-22744][CORE] Add a configuration to show t...

2018-01-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/19933 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request #20104: Merge pull request #1 from apache/master

2018-01-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/20104 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request #19739: [SPARK-22513][BUILD] Provide build profile for ha...

2018-01-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/19739 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request #19613: Fixed a typo

2018-01-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/19613 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request #19520: [SPARK-22298][WEB-UI] url encode APP id before ge...

2018-01-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/19520 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request #20133: [SPARK-22934] [SQL] Make optional clauses order i...

2018-01-01 Thread maropu
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/20133#discussion_r159156756 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/parser/ParserUtils.scala --- @@ -39,6 +41,17 @@ object ParserUtils { throw new

[GitHub] spark issue #19992: [SPARK-22805][CORE] Use StorageLevel aliases in event lo...

2018-01-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19992 **[Test build #85580 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85580/testReport)** for PR 19992 at commit

[GitHub] spark issue #19992: [SPARK-22805][CORE] Use StorageLevel aliases in event lo...

2018-01-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19992 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/85579/ Test FAILed. ---

[GitHub] spark issue #19992: [SPARK-22805][CORE] Use StorageLevel aliases in event lo...

2018-01-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19992 **[Test build #85579 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85579/testReport)** for PR 19992 at commit

[GitHub] spark issue #19992: [SPARK-22805][CORE] Use StorageLevel aliases in event lo...

2018-01-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19992 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19992: [SPARK-22805][CORE] Use StorageLevel aliases in event lo...

2018-01-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19992 **[Test build #85579 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85579/testReport)** for PR 19992 at commit

[GitHub] spark issue #20133: [SPARK-22934] [SQL] Make optional clauses order insensit...

2018-01-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20133 **[Test build #85578 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85578/testReport)** for PR 20133 at commit

[GitHub] spark issue #20129: [SPARK-22933][SPARKR] R Structured Streaming API for wit...

2018-01-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20129 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/85577/ Test PASSed. ---

[GitHub] spark issue #20129: [SPARK-22933][SPARKR] R Structured Streaming API for wit...

2018-01-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20129 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20129: [SPARK-22933][SPARKR] R Structured Streaming API for wit...

2018-01-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20129 **[Test build #85577 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85577/testReport)** for PR 20129 at commit

  1   2   >