[GitHub] spark issue #23054: [SPARK-26085][SQL] Key attribute of non-struct type unde...

2018-11-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23054 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/99146/ Test PASSed. ---

[GitHub] spark issue #23054: [SPARK-26085][SQL] Key attribute of non-struct type unde...

2018-11-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23054 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #23054: [SPARK-26085][SQL] Key attribute of non-struct type unde...

2018-11-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/23054 **[Test build #99146 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99146/testReport)** for PR 23054 at commit

[GitHub] spark pull request #22979: [SPARK-25977][SQL] Parsing decimals from CSV usin...

2018-11-21 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/22979#discussion_r235588064 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/csv/CSVExprUtils.scala --- @@ -79,4 +83,22 @@ object CSVExprUtils {

[GitHub] spark issue #23027: [SPARK-26049][SQL][TEST] FilterPushdownBenchmark add InM...

2018-11-21 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/23027 Looks fine. @dongjoon-hyun WDYT? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands,

[GitHub] spark issue #23052: [SPARK-26081][SQL] Prevent empty files for empty partiti...

2018-11-21 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/23052 There are two more things to deal with: https://github.com/apache/spark/pull/23052#issuecomment-440687200 comment will still be valid - at least it should be double checked because

[GitHub] spark issue #23090: [SPARK-26118][Web UI] Introducing spark.ui.requestHeader...

2018-11-21 Thread attilapiros
Github user attilapiros commented on the issue: https://github.com/apache/spark/pull/23090 Backport PR for 2.2: https://github.com/apache/spark/pull/23115 Both 2.2 and 2.3 are retested. --- - To

[GitHub] spark issue #23115: [SPARK-26118][BACKPORT-2.2][WEB UI] Introducing spark.ui...

2018-11-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/23115 **[Test build #99157 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99157/testReport)** for PR 23115 at commit

[GitHub] spark issue #23115: [SPARK-26118][BACKPORT-2.2][WEB UI] Introducing spark.ui...

2018-11-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23115 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #23115: [SPARK-26118][BACKPORT-2.2][WEB UI] Introducing spark.ui...

2018-11-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23115 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #23052: [SPARK-26081][SQL] Prevent empty files for empty partiti...

2018-11-21 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/23052 First of all, sometimes we do need to write "empty" files, so that we can infer schema of a parquet directory. Empty parquet file is not really empty, as it has header/footer.

[GitHub] spark issue #23110: [SPARK-26129][SQL] edge behavior for QueryPlanningTracke...

2018-11-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23110 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/99145/ Test PASSed. ---

[GitHub] spark pull request #23115: [SPARK-26118][WEB UI] Introducing spark.ui.reques...

2018-11-21 Thread attilapiros
GitHub user attilapiros opened a pull request: https://github.com/apache/spark/pull/23115 [SPARK-26118][WEB UI] Introducing spark.ui.requestHeaderSize for setting HTTP requestHeaderSize ## What changes were proposed in this pull request? Introducing

[GitHub] spark issue #23110: [SPARK-26129][SQL] edge behavior for QueryPlanningTracke...

2018-11-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23110 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #23110: [SPARK-26129][SQL] edge behavior for QueryPlanningTracke...

2018-11-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/23110 **[Test build #99145 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99145/testReport)** for PR 23110 at commit

[GitHub] spark pull request #22938: [SPARK-25935][SQL] Prevent null rows from JSON pa...

2018-11-21 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/22938#discussion_r235584943 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/json/JsonSuite.scala --- @@ -1892,7 +1898,7 @@ class JsonSuite extends

[GitHub] spark issue #23111: [DO-NOT-MERGE] Increases default parallelism in PySpark ...

2018-11-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/23111 **[Test build #99156 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99156/testReport)** for PR 23111 at commit

[GitHub] spark issue #23111: [DO-NOT-MERGE] Increases default parallelism in PySpark ...

2018-11-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23111 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark issue #23111: [DO-NOT-MERGE] Increases default parallelism in PySpark ...

2018-11-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23111 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #23052: [SPARK-26081][SQL] Prevent empty files for empty partiti...

2018-11-21 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/23052 cc @cloud-fan as well --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #23111: [DO-NOT-MERGE] Increases default parallelism in PySpark ...

2018-11-21 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/23111 retest this please --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark pull request #22938: [SPARK-25935][SQL] Prevent null rows from JSON pa...

2018-11-21 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/22938#discussion_r235583851 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/SQLQuerySuite.scala --- @@ -240,16 +240,6 @@ class SQLQuerySuite extends QueryTest with

[GitHub] spark issue #22938: [SPARK-25935][SQL] Prevent null rows from JSON parser

2018-11-21 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/22938 Sorry for the late response. The change looks good to me in general but I had one question. --- - To unsubscribe, e-mail:

[GitHub] spark issue #23111: [DO-NOT-MERGE] Increases default parallelism in PySpark ...

2018-11-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23111 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #23111: [DO-NOT-MERGE] Increases default parallelism in PySpark ...

2018-11-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23111 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/99151/ Test PASSed. ---

[GitHub] spark pull request #22938: [SPARK-25935][SQL] Prevent null rows from JSON pa...

2018-11-21 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/22938#discussion_r235583559 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/json/JsonSuite.scala --- @@ -1892,7 +1898,7 @@ class JsonSuite extends

[GitHub] spark issue #23111: [DO-NOT-MERGE] Increases default parallelism in PySpark ...

2018-11-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/23111 **[Test build #99151 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99151/testReport)** for PR 23111 at commit

[GitHub] spark pull request #22938: [SPARK-25935][SQL] Prevent null rows from JSON pa...

2018-11-21 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/22938#discussion_r235583349 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/json/JsonSuite.scala --- @@ -1892,7 +1898,7 @@ class JsonSuite extends

[GitHub] spark pull request #22938: [SPARK-25935][SQL] Prevent null rows from JSON pa...

2018-11-21 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/22938#discussion_r235583315 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/json/JsonSuite.scala --- @@ -1905,7 +1911,7 @@ class JsonSuite extends

[GitHub] spark issue #22938: [SPARK-25935][SQL] Prevent null rows from JSON parser

2018-11-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22938 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #22938: [SPARK-25935][SQL] Prevent null rows from JSON parser

2018-11-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22938 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/99144/ Test PASSed. ---

[GitHub] spark pull request #22938: [SPARK-25935][SQL] Prevent null rows from JSON pa...

2018-11-21 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/22938 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #22938: [SPARK-25935][SQL] Prevent null rows from JSON parser

2018-11-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/22938 **[Test build #99144 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99144/testReport)** for PR 22938 at commit

[GitHub] spark issue #22938: [SPARK-25935][SQL] Prevent null rows from JSON parser

2018-11-21 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/22938 thanks, merging to master! --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #23043: [SPARK-26021][SQL] replace minus zero with zero in Platf...

2018-11-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23043 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #23043: [SPARK-26021][SQL] replace minus zero with zero in Platf...

2018-11-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23043 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark issue #23043: [SPARK-26021][SQL] replace minus zero with zero in Platf...

2018-11-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/23043 **[Test build #99155 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99155/testReport)** for PR 23043 at commit

[GitHub] spark issue #23043: [SPARK-26021][SQL] replace minus zero with zero in Platf...

2018-11-21 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/23043 retest this please --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #23114: [SPARK-26118][BACKPORT-2.3][WEB UI] Introducing spark.ui...

2018-11-21 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/23114 Thank you, @attilapiros . If Jenkins pass, I'll merge this to `branch-2.3`. --- - To unsubscribe, e-mail:

[GitHub] spark issue #23100: [WIP][SPARK-26133][ML] Remove deprecated OneHotEncoder a...

2018-11-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23100 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #23100: [WIP][SPARK-26133][ML] Remove deprecated OneHotEncoder a...

2018-11-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23100 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark issue #23114: [SPARK-26118][BACKPORT-2.3][WEB UI] Introducing spark.ui...

2018-11-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/23114 **[Test build #99153 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99153/testReport)** for PR 23114 at commit

[GitHub] spark issue #23100: [WIP][SPARK-26133][ML] Remove deprecated OneHotEncoder a...

2018-11-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/23100 **[Test build #99154 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99154/testReport)** for PR 23100 at commit

[GitHub] spark issue #23090: [SPARK-26118][Web UI] Introducing spark.ui.requestHeader...

2018-11-21 Thread attilapiros
Github user attilapiros commented on the issue: https://github.com/apache/spark/pull/23090 Backport PR for 2.3: https://github.com/apache/spark/pull/23114 --- - To unsubscribe, e-mail:

[GitHub] spark issue #23114: [SPARK-26118][BACKPORT-2.3][WEB UI] Introducing spark.ui...

2018-11-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23114 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #23114: [SPARK-26118][BACKPORT-2.3][WEB UI] Introducing spark.ui...

2018-11-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23114 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark pull request #23114: [SPARK-26118][BACKPORT-2.3][WEB UI] Introducing s...

2018-11-21 Thread attilapiros
GitHub user attilapiros opened a pull request: https://github.com/apache/spark/pull/23114 [SPARK-26118][BACKPORT-2.3][WEB UI] Introducing spark.ui.requestHeaderSize for setting HTTP requestHeaderSize ## What changes were proposed in this pull request? Introducing

[GitHub] spark issue #23100: [WIP][SPARK-26133][ML] Remove deprecated OneHotEncoder a...

2018-11-21 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/23100 cc @jkbradley @MLnick @dbtsai --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands,

[GitHub] spark issue #23100: [WIP][SPARK-26133][ML] Remove deprecated OneHotEncoder a...

2018-11-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23100 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark issue #23100: [WIP][SPARK-26133][ML] Remove deprecated OneHotEncoder a...

2018-11-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23100 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #23100: [WIP][SPARK-26133][ML] Remove deprecated OneHotEncoder a...

2018-11-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/23100 **[Test build #99152 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99152/testReport)** for PR 23100 at commit

[GitHub] spark issue #21978: [SPARK-25006][SQL] Add CatalogTableIdentifier.

2018-11-21 Thread mccheah
Github user mccheah commented on the issue: https://github.com/apache/spark/pull/21978 Wanted to follow up here - are we planning on merging this or are there more things we need to discuss? --- - To unsubscribe,

[GitHub] spark issue #23111: [DO-NOT-MERGE] Increases default parallelism in PySpark ...

2018-11-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23111 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #23111: [DO-NOT-MERGE] Increases default parallelism in PySpark ...

2018-11-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/23111 **[Test build #99151 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99151/testReport)** for PR 23111 at commit

[GitHub] spark issue #23111: [DO-NOT-MERGE] Increases default parallelism in PySpark ...

2018-11-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23111 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark issue #23111: [DO-NOT-MERGE] Increases default parallelism in PySpark ...

2018-11-21 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/23111 retest this please --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #23111: [DO-NOT-MERGE] Increases default parallelism in PySpark ...

2018-11-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23111 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/99149/ Test PASSed. ---

[GitHub] spark issue #23111: [DO-NOT-MERGE] Increases default parallelism in PySpark ...

2018-11-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23111 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #23111: [DO-NOT-MERGE] Increases default parallelism in PySpark ...

2018-11-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/23111 **[Test build #99149 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99149/testReport)** for PR 23111 at commit

[GitHub] spark issue #23113: [SPARK-26019][PYTHON] Fix race condition in accumulators...

2018-11-21 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/23113 > race condition explained in https://issues.apache.org/jira/browse/SPARK-26019 How race condition happens? Can you clarify it in PR description. I think @viirya's analysis is matched

[GitHub] spark issue #23113: [SPARK-26019][PYTHON] Fix race condition in accumulators...

2018-11-21 Thread Tagar
Github user Tagar commented on the issue: https://github.com/apache/spark/pull/23113 @squito please help review this PR Thank you. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For

[GitHub] spark issue #23113: [SPARK-26019][PYTHON] Fix race condition in accumulators...

2018-11-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23113 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #23113: [SPARK-26019][PYTHON] Fix race condition in accumulators...

2018-11-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23113 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #23113: [SPARK-26019][PYTHON] Fix race condition in accumulators...

2018-11-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23113 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark pull request #23113: [SPARK-26019][PYTHON] Fix race condition in accum...

2018-11-21 Thread Tagar
GitHub user Tagar opened a pull request: https://github.com/apache/spark/pull/23113 [SPARK-26019][PYTHON] Fix race condition in accumulators.py: _start_update_server() ## What changes were proposed in this pull request? Fixing race condition that happens in

[GitHub] spark issue #23101: [SPARK-26134][CORE] Upgrading Hadoop to 2.7.4 to fix jav...

2018-11-21 Thread tasanuma
Github user tasanuma commented on the issue: https://github.com/apache/spark/pull/23101 Thanks all for your reviews. Updated PR based on the @dongjoon-hyun's review. --- - To unsubscribe, e-mail:

[GitHub] spark issue #23101: [SPARK-26134][CORE] Upgrading Hadoop to 2.7.4 to fix jav...

2018-11-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/23101 **[Test build #99150 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99150/testReport)** for PR 23101 at commit

[GitHub] spark issue #23101: [SPARK-26134][CORE] Upgrading Hadoop to 2.7.4 to fix jav...

2018-11-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23101 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #23101: [SPARK-26134][CORE] Upgrading Hadoop to 2.7.4 to fix jav...

2018-11-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23101 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark issue #23112: [GraphX] Remove unused variables left over by previous r...

2018-11-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23112 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #23112: [GraphX] Remove unused variables left over by previous r...

2018-11-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23112 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #22938: [SPARK-25935][SQL] Prevent null rows from JSON parser

2018-11-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22938 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/99143/ Test PASSed. ---

[GitHub] spark pull request #23098: [WIP][SPARK-26132][BUILD][CORE] Remove support fo...

2018-11-21 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/23098#discussion_r235572895 --- Diff: bin/load-spark-env.cmd --- @@ -21,37 +21,42 @@ rem This script loads spark-env.cmd if it exists, and ensures it is only loaded rem

[GitHub] spark issue #22938: [SPARK-25935][SQL] Prevent null rows from JSON parser

2018-11-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22938 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #23112: [GraphX] Remove unused variables left over by previous r...

2018-11-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23112 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark pull request #23098: [WIP][SPARK-26132][BUILD][CORE] Remove support fo...

2018-11-21 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/23098#discussion_r235572737 --- Diff: bin/load-spark-env.cmd --- @@ -21,37 +21,42 @@ rem This script loads spark-env.cmd if it exists, and ensures it is only loaded rem

[GitHub] spark pull request #23112: [GraphX] Remove unused variables left over by pre...

2018-11-21 Thread huonw
GitHub user huonw opened a pull request: https://github.com/apache/spark/pull/23112 [GraphX] Remove unused variables left over by previous refactoring. ## What changes were proposed in this pull request? Some variables were previously used for indexing the routing

[GitHub] spark issue #22938: [SPARK-25935][SQL] Prevent null rows from JSON parser

2018-11-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/22938 **[Test build #99143 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99143/testReport)** for PR 22938 at commit

[GitHub] spark pull request #23098: [WIP][SPARK-26132][BUILD][CORE] Remove support fo...

2018-11-21 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/23098#discussion_r235572442 --- Diff: bin/load-spark-env.cmd --- @@ -21,37 +21,42 @@ rem This script loads spark-env.cmd if it exists, and ensures it is only loaded rem

[GitHub] spark issue #23111: [DO-NOT-MERGE] Increases default parallelism in PySpark ...

2018-11-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23111 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark issue #23111: [DO-NOT-MERGE] Increases default parallelism in PySpark ...

2018-11-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23111 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #23111: [DO-NOT-MERGE] Increases default parallelism in PySpark ...

2018-11-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/23111 **[Test build #99149 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99149/testReport)** for PR 23111 at commit

[GitHub] spark pull request #23111: [DO-NOT-MERGE] Increases default parallelism in P...

2018-11-21 Thread HyukjinKwon
GitHub user HyukjinKwon opened a pull request: https://github.com/apache/spark/pull/23111 [DO-NOT-MERGE] Increases default parallelism in PySpark tests ## What changes were proposed in this pull request? I'm trying to see if increasing parallelism decreases elapsed time in

[GitHub] spark pull request #23078: [SPARK-26106][PYTHON] Prioritizes ML unittests ov...

2018-11-21 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/23078 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #23078: [SPARK-26106][PYTHON] Prioritizes ML unittests over the ...

2018-11-21 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/23078 Thanks. Merged to master. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands,

[GitHub] spark pull request #23102: [SPARK-26137][CORE] Use Java system property "fil...

2018-11-21 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/23102#discussion_r235570156 --- Diff: core/src/main/scala/org/apache/spark/deploy/DependencyUtils.scala --- @@ -65,7 +65,7 @@ private[deploy] object DependencyUtils extends

[GitHub] spark issue #23102: [SPARK-26137][CORE] Use Java system property "file.separ...

2018-11-21 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/23102 @markpavey, can you write a test? I can run the test on Windows via AppVeyor. --- - To unsubscribe, e-mail:

[GitHub] spark issue #22979: [SPARK-25977][SQL] Parsing decimals from CSV using local...

2018-11-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22979 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #22979: [SPARK-25977][SQL] Parsing decimals from CSV using local...

2018-11-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22979 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/99142/ Test PASSed. ---

[GitHub] spark pull request #23053: [SPARK-25957][K8S] Make building alternate langua...

2018-11-21 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/23053 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #22979: [SPARK-25977][SQL] Parsing decimals from CSV using local...

2018-11-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/22979 **[Test build #99142 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99142/testReport)** for PR 22979 at commit

[GitHub] spark issue #23102: [SPARK-26137][CORE] Use Java system property "file.separ...

2018-11-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23102 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #23102: [SPARK-26137][CORE] Use Java system property "file.separ...

2018-11-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23102 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/99140/ Test PASSed. ---

[GitHub] spark issue #23102: [SPARK-26137][CORE] Use Java system property "file.separ...

2018-11-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/23102 **[Test build #99140 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99140/testReport)** for PR 23102 at commit

[GitHub] spark issue #23053: [SPARK-25957][K8S] Make building alternate language bind...

2018-11-21 Thread mccheah
Github user mccheah commented on the issue: https://github.com/apache/spark/pull/23053 Ok that makes sense. I will merge this into master then. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For

[GitHub] spark issue #23055: [SPARK-26080][PYTHON] Disable 'spark.executor.pyspark.me...

2018-11-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23055 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #23055: [SPARK-26080][PYTHON] Disable 'spark.executor.pyspark.me...

2018-11-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/23055 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark issue #23055: [SPARK-26080][PYTHON] Disable 'spark.executor.pyspark.me...

2018-11-21 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/23055 Sorry, may I ask to take another look please? I thought it's quite a straightforward fix by a consistent way of fixing. ---

[GitHub] spark issue #23055: [SPARK-26080][PYTHON] Disable 'spark.executor.pyspark.me...

2018-11-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/23055 **[Test build #99148 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99148/testReport)** for PR 23055 at commit

[GitHub] spark issue #23053: [SPARK-25957][K8S] Make building alternate language bind...

2018-11-21 Thread ramaddepally
Github user ramaddepally commented on the issue: https://github.com/apache/spark/pull/23053 > So now the utility must always build the Java image, and optionally will build python and R - is that correct? Is there any way to opt-out of building Java? Yes.. you are correct.

<    1   2   3   4   5   6   7   >