[GitHub] spark issue #18375: [SPARK-21144][SQL] Print a warning if the data schema an...

2017-06-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18375 **[Test build #78528 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78528/testReport)** for PR 18375 at commit [`0f449df`](https://github.com/apache/spark/commit/0f

[GitHub] spark issue #18375: [SPARK-21144][SQL] Print a warning if the data schema an...

2017-06-23 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/18375 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wis

[GitHub] spark issue #18375: [SPARK-21144][SQL] Print a warning if the data schema an...

2017-06-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18375 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18375: [SPARK-21144][SQL] Print a warning if the data schema an...

2017-06-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18375 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78524/ Test FAILed. ---

[GitHub] spark issue #18375: [SPARK-21144][SQL] Print a warning if the data schema an...

2017-06-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18375 **[Test build #78524 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78524/testReport)** for PR 18375 at commit [`eba52f3`](https://github.com/apache/spark/commit/e

[GitHub] spark issue #16924: [SPARK-19531] Send UPDATE_LENGTH for Spark History servi...

2017-06-23 Thread dosoft
Github user dosoft commented on the issue: https://github.com/apache/spark/pull/16924 @cloud-fan spark thriftserver as long-running application? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not hav

[GitHub] spark issue #18384: [SPARK-21170] [CORE] Utils.tryWithSafeFinallyAndFailureC...

2017-06-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18384 **[Test build #3811 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3811/testReport)** for PR 18384 at commit [`371933d`](https://github.com/apache/spark/commit/3

[GitHub] spark issue #18403: [SPARK-21193][PYTHON] Specify Pandas version in setup.py

2017-06-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18403 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18403: [SPARK-21193][PYTHON] Specify Pandas version in setup.py

2017-06-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18403 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78527/ Test PASSed. ---

[GitHub] spark issue #18403: [SPARK-21193][PYTHON] Specify Pandas version in setup.py

2017-06-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18403 **[Test build #78527 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78527/testReport)** for PR 18403 at commit [`e04fb89`](https://github.com/apache/spark/commit/e

[GitHub] spark issue #18327: [SPARK-21047] Add test suites for complicated cases in C...

2017-06-23 Thread jinxing64
Github user jinxing64 commented on the issue: https://github.com/apache/spark/pull/18327 @cloud-fan Thanks for merging :) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature ena

[GitHub] spark pull request #18404: [SPARK-18004][SQL] Make sure the date or timestam...

2017-06-23 Thread SharpRay
Github user SharpRay closed the pull request at: https://github.com/apache/spark/pull/18404 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is e

[GitHub] spark issue #16924: [SPARK-19531] Send UPDATE_LENGTH for Spark History servi...

2017-06-23 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/16924 what's the use case of this patch? I think it makes sense to show the history entry after the app is finished, I'm not sure why we want the history server to detect it earlier. --- If your proje

[GitHub] spark issue #18391: [SPARK-21180][SQL] Remove conf from stats functions sinc...

2017-06-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18391 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18398: [MINOR][DOCS] Docs in DataFrameNaFunctions.scala use wro...

2017-06-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18398 **[Test build #3809 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3809/testReport)** for PR 18398 at commit [`6c6df33`](https://github.com/apache/spark/commit/

[GitHub] spark issue #18391: [SPARK-21180][SQL] Remove conf from stats functions sinc...

2017-06-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18391 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78521/ Test PASSed. ---

[GitHub] spark issue #18391: [SPARK-21180][SQL] Remove conf from stats functions sinc...

2017-06-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18391 **[Test build #78521 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78521/testReport)** for PR 18391 at commit [`cd9f424`](https://github.com/apache/spark/commit/c

[GitHub] spark issue #18404: [SPARK-18004][SQL] Make sure the date or timestamp relat...

2017-06-23 Thread SharpRay
Github user SharpRay commented on the issue: https://github.com/apache/spark/pull/18404 OK, I will make this PR to master, Thank you. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark issue #18384: [SPARK-21170] [CORE] Utils.tryWithSafeFinallyAndFailureC...

2017-06-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18384 **[Test build #3810 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3810/testReport)** for PR 18384 at commit [`371933d`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #18322: [SPARK-21115][Core]If the cores left is less than...

2017-06-23 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/18322 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #18322: [SPARK-21115][Core]If the cores left is less than the co...

2017-06-23 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/18322 LGTM, merging to master! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wish

[GitHub] spark issue #18403: [SPARK-21193][PYTHON] Specify Pandas version in setup.py

2017-06-23 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/18403 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the featur

[GitHub] spark issue #18403: [SPARK-21193][PYTHON] Specify Pandas version in setup.py

2017-06-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18403 **[Test build #78527 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78527/testReport)** for PR 18403 at commit [`e04fb89`](https://github.com/apache/spark/commit/e0

[GitHub] spark issue #18402: [SPARK-21192][SS] Preserve State Store provider class co...

2017-06-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18402 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18402: [SPARK-21192][SS] Preserve State Store provider class co...

2017-06-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18402 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78520/ Test PASSed. ---

[GitHub] spark issue #18403: [SPARK-21193][PYTHON] Specify Pandas version in setup.py

2017-06-23 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/18403 Thank you @srowen, @viirya and @cloud-fan. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark issue #18402: [SPARK-21192][SS] Preserve State Store provider class co...

2017-06-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18402 **[Test build #78520 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78520/testReport)** for PR 18402 at commit [`0255e5d`](https://github.com/apache/spark/commit/0

[GitHub] spark issue #18386: [SPARK-21165] [SQL] [2.2] Use executedPlan instead of an...

2017-06-23 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/18386 thanks, merging to 2.2! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishe

[GitHub] spark pull request #18327: [SPARK-21047] Add test suites for complicated cas...

2017-06-23 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/18327 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #18404: [SPARK-18004][SQL] Make sure the date or timestamp relat...

2017-06-23 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/18404 Hi, I think you need to make pr to not `branch-2.1` but `master`. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark issue #18327: [SPARK-21047] Add test suites for complicated cases in C...

2017-06-23 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/18327 thanks, merging to master! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wi

[GitHub] spark pull request #18403: [SPARK-21193][PYTHON] Specify Pandas version in s...

2017-06-23 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/18403#discussion_r123738175 --- Diff: python/setup.py --- @@ -199,7 +199,7 @@ def _supports_symlinks(): extras_require={ 'ml': ['numpy>=1.7'],

[GitHub] spark pull request #18403: [SPARK-21193][PYTHON] Specify Pandas version in s...

2017-06-23 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/18403#discussion_r123737717 --- Diff: python/setup.py --- @@ -199,7 +199,7 @@ def _supports_symlinks(): extras_require={ 'ml': ['numpy>=1.7'],

[GitHub] spark issue #18266: [SPARK-20427][SQL] Read JDBC table use custom schema

2017-06-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18266 **[Test build #78526 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78526/testReport)** for PR 18266 at commit [`a984f3b`](https://github.com/apache/spark/commit/a9

[GitHub] spark pull request #18266: [SPARK-20427][SQL] Read JDBC table use custom sch...

2017-06-23 Thread wangyum
Github user wangyum commented on a diff in the pull request: https://github.com/apache/spark/pull/18266#discussion_r123736535 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/JDBCRDD.scala --- @@ -82,7 +82,7 @@ object JDBCRDD extends Logging {

[GitHub] spark pull request #18266: [SPARK-20427][SQL] Read JDBC table use custom sch...

2017-06-23 Thread wangyum
Github user wangyum commented on a diff in the pull request: https://github.com/apache/spark/pull/18266#discussion_r123734456 --- Diff: external/docker-integration-tests/src/test/scala/org/apache/spark/sql/jdbc/OracleIntegrationSuite.scala --- @@ -198,4 +205,37 @@ class OracleInte

[GitHub] spark issue #18375: [SPARK-21144][SQL] Print a warning if the data schema an...

2017-06-23 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/18375 @gatorsmile Manually checked: ``` scala> Seq((1, 2, 3)).toDF("a", "b", "c").write.save(s"$path/a=0") scala> spark.read.load(path).show 17/06/23 21:04:44 WARN SchemaUtils: Found duplicat

[GitHub] spark issue #18375: [SPARK-21144][SQL] Print a warning if the data schema an...

2017-06-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18375 **[Test build #78525 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78525/testReport)** for PR 18375 at commit [`0f449df`](https://github.com/apache/spark/commit/0f

[GitHub] spark pull request #18266: [SPARK-20427][SQL] Read JDBC table use custom sch...

2017-06-23 Thread wangyum
Github user wangyum commented on a diff in the pull request: https://github.com/apache/spark/pull/18266#discussion_r123733947 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/jdbc/JDBCSuite.scala --- @@ -907,7 +907,7 @@ class JDBCSuite extends SparkFunSuite assert(ne

[GitHub] spark issue #18404: [SPARK-18004][SQL] Make sure the date or timestamp relat...

2017-06-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18404 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark pull request #18404: [SPARK-18004][SQL] Make sure the date or timestam...

2017-06-23 Thread SharpRay
GitHub user SharpRay opened a pull request: https://github.com/apache/spark/pull/18404 [SPARK-18004][SQL] Make sure the date or timestamp related predicate can be pushed down to Oracle correctly ## What changes were proposed in this pull request? 1. Override beforeFetch met

[GitHub] spark issue #18375: [SPARK-21144][SQL] Check if the data schema and partitio...

2017-06-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18375 **[Test build #78524 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78524/testReport)** for PR 18375 at commit [`eba52f3`](https://github.com/apache/spark/commit/eb

[GitHub] spark issue #18320: [SPARK-21093][R] Terminate R's worker processes in the p...

2017-06-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18320 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78523/ Test PASSed. ---

[GitHub] spark issue #18320: [SPARK-21093][R] Terminate R's worker processes in the p...

2017-06-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18320 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18320: [SPARK-21093][R] Terminate R's worker processes in the p...

2017-06-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18320 **[Test build #78523 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78523/testReport)** for PR 18320 at commit [`c5fe347`](https://github.com/apache/spark/commit/c

[GitHub] spark pull request #18403: [SPARK-21193][PYTHON] Specify Pandas version in s...

2017-06-23 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/18403#discussion_r123727387 --- Diff: python/pyspark/sql/dataframe.py --- @@ -1746,7 +1746,7 @@ def toPandas(self): pdf = pd.DataFrame.from_records(self.collect(),

[GitHub] spark pull request #18403: [SPARK-21193][PYTHON] Specify Pandas version in s...

2017-06-23 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/18403#discussion_r123726773 --- Diff: python/pyspark/sql/dataframe.py --- @@ -1746,7 +1746,7 @@ def toPandas(self): pdf = pd.DataFrame.from_records(self.collect(),

[GitHub] spark issue #18301: [SPARK-21052][SQL] Add hash map metrics to join

2017-06-23 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/18301 ping @cloud-fan --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or i

[GitHub] spark issue #18403: [SPARK-21193][PYTHON] Specify Pandas version in setup.py

2017-06-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18403 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78522/ Test PASSed. ---

[GitHub] spark issue #18403: [SPARK-21193][PYTHON] Specify Pandas version in setup.py

2017-06-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18403 **[Test build #78522 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78522/testReport)** for PR 18403 at commit [`4ddc54b`](https://github.com/apache/spark/commit/4

[GitHub] spark issue #18403: [SPARK-21193][PYTHON] Specify Pandas version in setup.py

2017-06-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18403 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18320: [SPARK-21093][R] Terminate R's worker processes in the p...

2017-06-23 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/18320 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the featur

[GitHub] spark pull request #18403: [SPARK-21193][PYTHON] Specify Pandas version in s...

2017-06-23 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/18403#discussion_r123726189 --- Diff: python/pyspark/sql/dataframe.py --- @@ -1746,7 +1746,7 @@ def toPandas(self): pdf = pd.DataFrame.from_records(self.collect(), colu

[GitHub] spark pull request #18403: [SPARK-21193][PYTHON] Specify Pandas version in s...

2017-06-23 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/18403#discussion_r123725824 --- Diff: python/pyspark/sql/dataframe.py --- @@ -1746,7 +1746,7 @@ def toPandas(self): pdf = pd.DataFrame.from_records(self.collect(), colu

[GitHub] spark issue #18235: [SPARK-21012][Submit] Add glob support for resources add...

2017-06-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18235 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78516/ Test PASSed. ---

[GitHub] spark issue #18235: [SPARK-21012][Submit] Add glob support for resources add...

2017-06-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18235 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18235: [SPARK-21012][Submit] Add glob support for resources add...

2017-06-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18235 **[Test build #78516 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78516/testReport)** for PR 18235 at commit [`9ae5bf2`](https://github.com/apache/spark/commit/9

[GitHub] spark issue #18320: [SPARK-21093][R] Terminate R's worker processes in the p...

2017-06-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18320 **[Test build #78523 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78523/testReport)** for PR 18320 at commit [`c5fe347`](https://github.com/apache/spark/commit/c5

[GitHub] spark pull request #18320: [SPARK-21093][R] Terminate R's worker processes i...

2017-06-23 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/18320#discussion_r123722811 --- Diff: R/pkg/inst/worker/daemon.R --- @@ -30,8 +30,55 @@ port <- as.integer(Sys.getenv("SPARKR_WORKER_PORT")) inputCon <- socketConnection(

[GitHub] spark issue #18384: [SPARK-21170] [CORE] Utils.tryWithSafeFinallyAndFailureC...

2017-06-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18384 **[Test build #3810 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3810/testReport)** for PR 18384 at commit [`371933d`](https://github.com/apache/spark/commit/3

[GitHub] spark issue #18398: [MINOR][DOCS] Docs in DataFrameNaFunctions.scala use wro...

2017-06-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18398 **[Test build #3809 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3809/testReport)** for PR 18398 at commit [`6c6df33`](https://github.com/apache/spark/commit/6

[GitHub] spark pull request #18403: [SPARK-21193][PYTHON] Specify Pandas version in s...

2017-06-23 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/18403#discussion_r123722199 --- Diff: python/pyspark/sql/dataframe.py --- @@ -1746,7 +1746,7 @@ def toPandas(self): pdf = pd.DataFrame.from_records(self.collect(),

[GitHub] spark issue #18403: [SPARK-21193][PYTHON] Specify Pandas version in setup.py

2017-06-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18403 **[Test build #78522 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78522/testReport)** for PR 18403 at commit [`4ddc54b`](https://github.com/apache/spark/commit/4d

[GitHub] spark pull request #18403: [SPARK-21193][PYTHON] Specify Pandas version in s...

2017-06-23 Thread HyukjinKwon
GitHub user HyukjinKwon opened a pull request: https://github.com/apache/spark/pull/18403 [SPARK-21193][PYTHON] Specify Pandas version in setup.py ## What changes were proposed in this pull request? It looks we missed specifying the Pandas version. This PR proposes to fix i

[GitHub] spark pull request #18288: [SPARK-21066][ML] LibSVM load just one input file

2017-06-23 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/18288#discussion_r123721406 --- Diff: mllib/src/main/scala/org/apache/spark/ml/source/libsvm/LibSVMRelation.scala --- @@ -91,12 +91,10 @@ private[libsvm] class LibSVMFileFormat extends

[GitHub] spark issue #17747: [SPARK-11373] [CORE] Add metrics to the FsHistoryProvide...

2017-06-23 Thread steveloughran
Github user steveloughran commented on the issue: https://github.com/apache/spark/pull/17747 Mima test failure was about a new method in hist server ``` [info] spark-mllib: found 0 potential binary incompatibilities while checking against org.apache.spark:spark-mllib_2.11:2.0.0

[GitHub] spark issue #18391: [SPARK-21180][SQL] Remove conf from stats functions sinc...

2017-06-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18391 **[Test build #78521 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78521/testReport)** for PR 18391 at commit [`cd9f424`](https://github.com/apache/spark/commit/cd

[GitHub] spark pull request #18320: [SPARK-21093][R] Terminate R's worker processes i...

2017-06-23 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/18320#discussion_r123719067 --- Diff: R/pkg/inst/worker/daemon.R --- @@ -30,8 +30,55 @@ port <- as.integer(Sys.getenv("SPARKR_WORKER_PORT")) inputCon <- socketConnection( p

[GitHub] spark pull request #18320: [SPARK-21093][R] Terminate R's worker processes i...

2017-06-23 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/18320#discussion_r123718675 --- Diff: R/pkg/inst/worker/daemon.R --- @@ -30,8 +30,55 @@ port <- as.integer(Sys.getenv("SPARKR_WORKER_PORT")) inputCon <- socketConnection( p

[GitHub] spark issue #18402: [SPARK-21192][SS] Preserve State Store provider class co...

2017-06-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18402 **[Test build #78520 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78520/testReport)** for PR 18402 at commit [`0255e5d`](https://github.com/apache/spark/commit/02

[GitHub] spark issue #18401: [SPARK-21191] DataFrame Row StructType check duplicate n...

2017-06-23 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/18401 No, this is a behavior change. It is maybe not a good idea in many cases but it's allowed. Please see JIRA --- If your project is set up for it, you can reply to this email and have your reply appea

[GitHub] spark pull request #18288: [SPARK-21066][ML] LibSVM load just one input file

2017-06-23 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/18288#discussion_r123718043 --- Diff: mllib/src/main/scala/org/apache/spark/ml/source/libsvm/LibSVMRelation.scala --- @@ -91,12 +91,10 @@ private[libsvm] class LibSVMFileFormat exte

[GitHub] spark pull request #18402: [SPARK-21192][SS] Preserve State Store provider c...

2017-06-23 Thread tdas
GitHub user tdas opened a pull request: https://github.com/apache/spark/pull/18402 [SPARK-21192][SS] Preserve State Store provider class configuration across restarts ## What changes were proposed in this pull request? If the SQL conf for StateStore provider class is change

[GitHub] spark pull request #18320: [SPARK-21093][R] Terminate R's worker processes i...

2017-06-23 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/18320#discussion_r123717458 --- Diff: R/pkg/inst/worker/daemon.R --- @@ -30,8 +30,55 @@ port <- as.integer(Sys.getenv("SPARKR_WORKER_PORT")) inputCon <- socketConnection(

[GitHub] spark pull request #18320: [SPARK-21093][R] Terminate R's worker processes i...

2017-06-23 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/18320#discussion_r123717120 --- Diff: R/pkg/inst/worker/daemon.R --- @@ -30,8 +30,55 @@ port <- as.integer(Sys.getenv("SPARKR_WORKER_PORT")) inputCon <- socketConnection( p

[GitHub] spark issue #18384: [SPARK-21170] [CORE] Utils.tryWithSafeFinallyAndFailureC...

2017-06-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18384 **[Test build #3808 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3808/testReport)** for PR 18384 at commit [`371933d`](https://github.com/apache/spark/commit/

[GitHub] spark issue #18401: [SPARK-21191] DataFrame Row StructType check duplicate n...

2017-06-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18401 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark issue #18323: [SPARK-21117][SQL] Built-in SQL Function Support - WIDTH...

2017-06-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18323 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18323: [SPARK-21117][SQL] Built-in SQL Function Support - WIDTH...

2017-06-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18323 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78515/ Test PASSed. ---

[GitHub] spark issue #17455: [Spark-20044][Web UI] Support Spark UI behind front-end ...

2017-06-23 Thread jiangxb1987
Github user jiangxb1987 commented on the issue: https://github.com/apache/spark/pull/17455 ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark pull request #18401: [SPARK-21191] DataFrame Row StructType check dupl...

2017-06-23 Thread darionyaphet
GitHub user darionyaphet opened a pull request: https://github.com/apache/spark/pull/18401 [SPARK-21191] DataFrame Row StructType check duplicate name ## What changes were proposed in this pull request? to Avoid dataframe to have duplicated name when create dataframe using

[GitHub] spark issue #18323: [SPARK-21117][SQL] Built-in SQL Function Support - WIDTH...

2017-06-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18323 **[Test build #78515 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78515/testReport)** for PR 18323 at commit [`5c3ecee`](https://github.com/apache/spark/commit/5

[GitHub] spark pull request #18320: [SPARK-21093][R] Terminate R's worker processes i...

2017-06-23 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/18320#discussion_r123716354 --- Diff: R/pkg/inst/worker/daemon.R --- @@ -30,8 +30,55 @@ port <- as.integer(Sys.getenv("SPARKR_WORKER_PORT")) inputCon <- socketConnection( p

[GitHub] spark pull request #18320: [SPARK-21093][R] Terminate R's worker processes i...

2017-06-23 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/18320#discussion_r123715868 --- Diff: R/pkg/inst/worker/daemon.R --- @@ -30,8 +30,55 @@ port <- as.integer(Sys.getenv("SPARKR_WORKER_PORT")) inputCon <- socketConnection(

[GitHub] spark issue #18320: [SPARK-21093][R] Terminate R's worker processes in the p...

2017-06-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18320 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18320: [SPARK-21093][R] Terminate R's worker processes in the p...

2017-06-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18320 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78519/ Test PASSed. ---

[GitHub] spark issue #18320: [SPARK-21093][R] Terminate R's worker processes in the p...

2017-06-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18320 **[Test build #78519 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78519/testReport)** for PR 18320 at commit [`7d61153`](https://github.com/apache/spark/commit/7

[GitHub] spark issue #18399: [SPARK-21189][INFRA] Handle unknown error codes in Jenki...

2017-06-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18399 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78509/ Test PASSed. ---

[GitHub] spark issue #18399: [SPARK-21189][INFRA] Handle unknown error codes in Jenki...

2017-06-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18399 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18399: [SPARK-21189][INFRA] Handle unknown error codes in Jenki...

2017-06-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18399 **[Test build #78509 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78509/testReport)** for PR 18399 at commit [`cbf3517`](https://github.com/apache/spark/commit/c

[GitHub] spark pull request #18320: [SPARK-21093][R] Terminate R's worker processes i...

2017-06-23 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/18320#discussion_r123714768 --- Diff: R/pkg/inst/worker/daemon.R --- @@ -30,8 +30,55 @@ port <- as.integer(Sys.getenv("SPARKR_WORKER_PORT")) inputCon <- socketConnection( p

[GitHub] spark issue #17714: [SPARK-20428][Core]REST interface about 'v1/submissions/...

2017-06-23 Thread jiangxb1987
Github user jiangxb1987 commented on the issue: https://github.com/apache/spark/pull/17714 One general question: what do we expect to gain from this improvement? Seems it's just looping the drivers and send kill requests? --- If your project is set up for it, you can reply to this em

[GitHub] spark issue #17714: [SPARK-20428][Core]REST interface about 'v1/submissions/...

2017-06-23 Thread jiangxb1987
Github user jiangxb1987 commented on the issue: https://github.com/apache/spark/pull/17714 ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark issue #18327: [SPARK-21047] Add test suites for complicated cases in C...

2017-06-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18327 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18327: [SPARK-21047] Add test suites for complicated cases in C...

2017-06-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18327 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78514/ Test PASSed. ---

[GitHub] spark issue #18327: [SPARK-21047] Add test suites for complicated cases in C...

2017-06-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18327 **[Test build #78514 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78514/testReport)** for PR 18327 at commit [`ed210fb`](https://github.com/apache/spark/commit/e

[GitHub] spark issue #17713: [SPARK-20417][SQL] Move subquery error handling to check...

2017-06-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17713 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78512/ Test PASSed. ---

[GitHub] spark issue #17713: [SPARK-20417][SQL] Move subquery error handling to check...

2017-06-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17713 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark pull request #17922: [SPARK-20601][PYTHON][ML] Python API Changes for ...

2017-06-23 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/17922#discussion_r123707614 --- Diff: python/pyspark/ml/param/__init__.py --- @@ -170,6 +170,15 @@ def toVector(value): raise TypeError("Could not convert %s to vector"

[GitHub] spark pull request #17922: [SPARK-20601][PYTHON][ML] Python API Changes for ...

2017-06-23 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/17922#discussion_r123711301 --- Diff: python/pyspark/ml/tests.py --- @@ -832,6 +860,96 @@ def test_logistic_regression(self): except OSError: pass

<    1   2   3   4   5   6   >