[GitHub] spark issue #18709: [SPARK-21504] [SQL] Add spark version info into table me...

2017-07-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18709 **[Test build #79967 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79967/testReport)** for PR 18709 at commit [`4e71b66`](https://github.com/apache/spark/commit/4

[GitHub] spark issue #18709: [SPARK-21504] [SQL] Add spark version info into table me...

2017-07-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18709 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18709: [SPARK-21504] [SQL] Add spark version info into table me...

2017-07-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18709 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79967/ Test FAILed. ---

[GitHub] spark issue #18679: [SPARK-21319][SQL] Fix memory leak in sorter

2017-07-26 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/18679 cc @ueshin --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark pull request #18610: [SPARK-21386] ML LinearRegression supports warm s...

2017-07-26 Thread WeichenXu123
Github user WeichenXu123 commented on a diff in the pull request: https://github.com/apache/spark/pull/18610#discussion_r129652515 --- Diff: mllib/src/main/scala/org/apache/spark/ml/util/ReadWrite.scala --- @@ -309,6 +313,23 @@ private[ml] object DefaultParamsWriter { val m

[GitHub] spark issue #18664: [SPARK-21375][PYSPARK][SQL][WIP] Add Date and Timestamp ...

2017-07-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18664 **[Test build #79972 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79972/testReport)** for PR 18664 at commit [`f977d0b`](https://github.com/apache/spark/commit/f9

[GitHub] spark issue #18735: [SPARK-21530] Update description of spark.shuffle.maxChu...

2017-07-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18735 **[Test build #79965 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79965/testReport)** for PR 18735 at commit [`2216b31`](https://github.com/apache/spark/commit/2

[GitHub] spark issue #18735: [SPARK-21530] Update description of spark.shuffle.maxChu...

2017-07-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18735 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79965/ Test PASSed. ---

[GitHub] spark issue #18735: [SPARK-21530] Update description of spark.shuffle.maxChu...

2017-07-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18735 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18664: [SPARK-21375][PYSPARK][SQL][WIP] Add Date and Timestamp ...

2017-07-26 Thread BryanCutler
Github user BryanCutler commented on the issue: https://github.com/apache/spark/pull/18664 Thanks @jreback and @wesm for looking. I'm going to try one more fix and if that doesn't work then I can add some printouts to see what is going on. --- If your project is set up for it, you ca

[GitHub] spark issue #18735: [SPARK-21530] Update description of spark.shuffle.maxChu...

2017-07-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18735 **[Test build #79966 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79966/testReport)** for PR 18735 at commit [`14f857e`](https://github.com/apache/spark/commit/1

[GitHub] spark issue #16630: [SPARK-19270][ML] Add summary table to GLM summary

2017-07-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16630 **[Test build #79970 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79970/testReport)** for PR 16630 at commit [`7281b77`](https://github.com/apache/spark/commit/7

[GitHub] spark issue #18735: [SPARK-21530] Update description of spark.shuffle.maxChu...

2017-07-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18735 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79966/ Test PASSed. ---

[GitHub] spark issue #18735: [SPARK-21530] Update description of spark.shuffle.maxChu...

2017-07-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18735 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16630: [SPARK-19270][ML] Add summary table to GLM summary

2017-07-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16630 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79970/ Test PASSed. ---

[GitHub] spark issue #16630: [SPARK-19270][ML] Add summary table to GLM summary

2017-07-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16630 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18503: [SPARK-21271][SQL] Ensure Unsafe.sizeInBytes is a multip...

2017-07-26 Thread tdas
Github user tdas commented on the issue: https://github.com/apache/spark/pull/18503 @cloud-fan @kiszk thanks for confirming. LGTM pending tests. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not hav

[GitHub] spark issue #18645: [SPARK-14280][BUILD][WIP] Update change-version.sh and p...

2017-07-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18645 **[Test build #79968 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79968/testReport)** for PR 18645 at commit [`82b51dc`](https://github.com/apache/spark/commit/8

[GitHub] spark issue #18645: [SPARK-14280][BUILD][WIP] Update change-version.sh and p...

2017-07-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18645 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18645: [SPARK-14280][BUILD][WIP] Update change-version.sh and p...

2017-07-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18645 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79968/ Test FAILed. ---

[GitHub] spark issue #18503: [SPARK-21271][SQL] Ensure Unsafe.sizeInBytes is a multip...

2017-07-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18503 **[Test build #79969 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79969/testReport)** for PR 18503 at commit [`cc467de`](https://github.com/apache/spark/commit/c

[GitHub] spark issue #18503: [SPARK-21271][SQL] Ensure Unsafe.sizeInBytes is a multip...

2017-07-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18503 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79969/ Test PASSed. ---

[GitHub] spark issue #18503: [SPARK-21271][SQL] Ensure Unsafe.sizeInBytes is a multip...

2017-07-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18503 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18679: [SPARK-21319][SQL] Fix memory leak in sorter

2017-07-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18679 **[Test build #79971 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79971/testReport)** for PR 18679 at commit [`9b88297`](https://github.com/apache/spark/commit/9

[GitHub] spark issue #18679: [SPARK-21319][SQL] Fix memory leak in sorter

2017-07-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18679 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18679: [SPARK-21319][SQL] Fix memory leak in sorter

2017-07-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18679 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79971/ Test FAILed. ---

[GitHub] spark pull request #18740: [SPARK-21538][SQL] Attribute resolution inconsist...

2017-07-26 Thread aokolnychyi
GitHub user aokolnychyi opened a pull request: https://github.com/apache/spark/pull/18740 [SPARK-21538][SQL] Attribute resolution inconsistency in the Dataset API ## What changes were proposed in this pull request? This PR contains a tiny update that removes an attribute res

[GitHub] spark issue #18740: [SPARK-21538][SQL] Attribute resolution inconsistency in...

2017-07-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18740 **[Test build #79973 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79973/testReport)** for PR 18740 at commit [`b0fbd5e`](https://github.com/apache/spark/commit/b0

[GitHub] spark issue #18664: [SPARK-21375][PYSPARK][SQL][WIP] Add Date and Timestamp ...

2017-07-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18664 **[Test build #79972 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79972/testReport)** for PR 18664 at commit [`f977d0b`](https://github.com/apache/spark/commit/f

[GitHub] spark issue #18664: [SPARK-21375][PYSPARK][SQL][WIP] Add Date and Timestamp ...

2017-07-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18664 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79972/ Test FAILed. ---

[GitHub] spark issue #18664: [SPARK-21375][PYSPARK][SQL][WIP] Add Date and Timestamp ...

2017-07-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18664 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18695: [SPARK-12717][PYTHON] Adding thread-safe broadcast pickl...

2017-07-26 Thread BryanCutler
Github user BryanCutler commented on the issue: https://github.com/apache/spark/pull/18695 Thanks @viirya , that was a good idea! I updated to use a thread-local object to store the pickled vars --- If your project is set up for it, you can reply to this email and have your reply ap

[GitHub] spark issue #18695: [SPARK-12717][PYTHON] Adding thread-safe broadcast pickl...

2017-07-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18695 **[Test build #79974 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79974/testReport)** for PR 18695 at commit [`54e8357`](https://github.com/apache/spark/commit/54

[GitHub] spark issue #18664: [SPARK-21375][PYSPARK][SQL][WIP] Add Date and Timestamp ...

2017-07-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18664 **[Test build #79975 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79975/testReport)** for PR 18664 at commit [`a0f912f`](https://github.com/apache/spark/commit/a0

[GitHub] spark issue #9183: [SPARK-11215] [ML] Add multiple columns support to String...

2017-07-26 Thread WeichenXu123
Github user WeichenXu123 commented on the issue: https://github.com/apache/spark/pull/9183 @yanboliang I will take over this feature and create a new PR soon. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark issue #18695: [SPARK-12717][PYTHON] Adding thread-safe broadcast pickl...

2017-07-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18695 **[Test build #79974 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79974/testReport)** for PR 18695 at commit [`54e8357`](https://github.com/apache/spark/commit/5

[GitHub] spark issue #18695: [SPARK-12717][PYTHON] Adding thread-safe broadcast pickl...

2017-07-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18695 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18695: [SPARK-12717][PYTHON] Adding thread-safe broadcast pickl...

2017-07-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18695 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79974/ Test PASSed. ---

[GitHub] spark pull request #17373: [SPARK-12664] Expose probability in mlp model

2017-07-26 Thread WeichenXu123
Github user WeichenXu123 commented on a diff in the pull request: https://github.com/apache/spark/pull/17373#discussion_r129698281 --- Diff: mllib/src/main/scala/org/apache/spark/ml/ann/Layer.scala --- @@ -527,9 +544,21 @@ private[ml] class FeedForwardModel private( ove

[GitHub] spark pull request #17373: [SPARK-12664] Expose probability in mlp model

2017-07-26 Thread WeichenXu123
Github user WeichenXu123 commented on a diff in the pull request: https://github.com/apache/spark/pull/17373#discussion_r129697890 --- Diff: mllib/src/main/scala/org/apache/spark/ml/ann/Layer.scala --- @@ -527,9 +544,21 @@ private[ml] class FeedForwardModel private( ove

[GitHub] spark pull request #17373: [SPARK-12664] Expose probability in mlp model

2017-07-26 Thread WeichenXu123
Github user WeichenXu123 commented on a diff in the pull request: https://github.com/apache/spark/pull/17373#discussion_r129697649 --- Diff: mllib/src/main/scala/org/apache/spark/ml/ann/Layer.scala --- @@ -463,7 +479,7 @@ private[ml] class FeedForwardModel private( private va

[GitHub] spark issue #17373: [SPARK-12664] Expose probability in mlp model

2017-07-26 Thread WeichenXu123
Github user WeichenXu123 commented on the issue: https://github.com/apache/spark/pull/17373 cc @yanboliang @jkbradley --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #18707: [SPARK-21503][UI]: Spark UI shows incorrect task status ...

2017-07-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18707 **[Test build #79976 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79976/testReport)** for PR 18707 at commit [`55c6c37`](https://github.com/apache/spark/commit/55

[GitHub] spark issue #18707: [SPARK-21503][UI]: Spark UI shows incorrect task status ...

2017-07-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18707 **[Test build #79977 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79977/testReport)** for PR 18707 at commit [`f454c89`](https://github.com/apache/spark/commit/f4

[GitHub] spark issue #18707: [SPARK-21503][UI]: Spark UI shows incorrect task status ...

2017-07-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18707 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79977/ Test FAILed. ---

[GitHub] spark issue #18707: [SPARK-21503][UI]: Spark UI shows incorrect task status ...

2017-07-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18707 **[Test build #79977 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79977/testReport)** for PR 18707 at commit [`f454c89`](https://github.com/apache/spark/commit/f

[GitHub] spark issue #18707: [SPARK-21503][UI]: Spark UI shows incorrect task status ...

2017-07-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18707 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18707: [SPARK-21503][UI]: Spark UI shows incorrect task status ...

2017-07-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18707 **[Test build #79978 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79978/testReport)** for PR 18707 at commit [`6b7d5c6`](https://github.com/apache/spark/commit/6b

[GitHub] spark issue #18528: [SPARK-13041][Mesos] Adds sandbox uri to spark dispatche...

2017-07-26 Thread ArtRand
Github user ArtRand commented on the issue: https://github.com/apache/spark/pull/18528 LGTM, pretty nice to have this now! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #18740: [SPARK-21538][SQL] Attribute resolution inconsistency in...

2017-07-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18740 **[Test build #79973 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79973/testReport)** for PR 18740 at commit [`b0fbd5e`](https://github.com/apache/spark/commit/b

[GitHub] spark issue #18528: [SPARK-13041][Mesos] Adds sandbox uri to spark dispatche...

2017-07-26 Thread skonto
Github user skonto commented on the issue: https://github.com/apache/spark/pull/18528 @vanzin Could we get a merge please and/or a review? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #18740: [SPARK-21538][SQL] Attribute resolution inconsistency in...

2017-07-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18740 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79973/ Test PASSed. ---

[GitHub] spark issue #18740: [SPARK-21538][SQL] Attribute resolution inconsistency in...

2017-07-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18740 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18528: [SPARK-13041][Mesos] Adds sandbox uri to spark dispatche...

2017-07-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18528 **[Test build #79979 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79979/testReport)** for PR 18528 at commit [`5b8d1b8`](https://github.com/apache/spark/commit/5b

[GitHub] spark pull request #18741: [Spark-21541][YARN]: Spark Logs show incorrect jo...

2017-07-26 Thread pgandhi999
GitHub user pgandhi999 opened a pull request: https://github.com/apache/spark/pull/18741 [Spark-21541][YARN]: Spark Logs show incorrect job status for a job that does not create SparkContext If you run a spark job without creating the SparkSession or SparkContext, the spark job log

[GitHub] spark issue #18741: [Spark-21541][YARN]: Spark Logs show incorrect job statu...

2017-07-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18741 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark pull request #18742: Python persistence helper functions

2017-07-26 Thread ajaysaini725
GitHub user ajaysaini725 opened a pull request: https://github.com/apache/spark/pull/18742 Python persistence helper functions ## What changes were proposed in this pull request? Added DefaultParamsWriteable, DefaultParamsReadable, DefaultParamsWriter, and DefaultParamsRead

[GitHub] spark issue #18742: Python persistence helper functions

2017-07-26 Thread ajaysaini725
Github user ajaysaini725 commented on the issue: https://github.com/apache/spark/pull/18742 @jkbradley @thunterdb @MrBago Could you please review this PR? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project do

[GitHub] spark issue #18528: [SPARK-13041][Mesos] Adds sandbox uri to spark dispatche...

2017-07-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18528 **[Test build #79979 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79979/testReport)** for PR 18528 at commit [`5b8d1b8`](https://github.com/apache/spark/commit/5

[GitHub] spark issue #18528: [SPARK-13041][Mesos] Adds sandbox uri to spark dispatche...

2017-07-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18528 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79979/ Test PASSed. ---

[GitHub] spark issue #18528: [SPARK-13041][Mesos] Adds sandbox uri to spark dispatche...

2017-07-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18528 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18742: Python persistence helper functions

2017-07-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18742 **[Test build #79980 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79980/testReport)** for PR 18742 at commit [`9cb114b`](https://github.com/apache/spark/commit/9c

[GitHub] spark issue #18664: [SPARK-21375][PYSPARK][SQL][WIP] Add Date and Timestamp ...

2017-07-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18664 **[Test build #79975 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79975/testReport)** for PR 18664 at commit [`a0f912f`](https://github.com/apache/spark/commit/a

[GitHub] spark issue #18664: [SPARK-21375][PYSPARK][SQL][WIP] Add Date and Timestamp ...

2017-07-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18664 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18664: [SPARK-21375][PYSPARK][SQL][WIP] Add Date and Timestamp ...

2017-07-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18664 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79975/ Test FAILed. ---

[GitHub] spark issue #18742: [Spark-21542][Python]Python persistence helper functions

2017-07-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18742 **[Test build #79980 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79980/testReport)** for PR 18742 at commit [`9cb114b`](https://github.com/apache/spark/commit/9

[GitHub] spark issue #18742: [Spark-21542][Python]Python persistence helper functions

2017-07-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18742 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18742: [Spark-21542][Python]Python persistence helper functions

2017-07-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18742 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79980/ Test PASSed. ---

[GitHub] spark issue #18315: [SPARK-21108] [ML] [WIP] convert LinearSVC to aggregator...

2017-07-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18315 **[Test build #79981 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79981/testReport)** for PR 18315 at commit [`c8228fb`](https://github.com/apache/spark/commit/c8

[GitHub] spark issue #18702: [SPARK-21485][SQL][DOCS] Spark SQL documentation generat...

2017-07-26 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/18702 Thank you @srowen and @rxin. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled an

[GitHub] spark issue #18664: [SPARK-21375][PYSPARK][SQL][WIP] Add Date and Timestamp ...

2017-07-26 Thread BryanCutler
Github user BryanCutler commented on the issue: https://github.com/apache/spark/pull/18664 So this is currently failing due to this issue: ``` ERROR: test_bbb_fail (pyspark.sql.tests.ArrowTests) -- Trace

[GitHub] spark issue #18692: [SPARK-21417][SQL] Detect joind conditions via filter ex...

2017-07-26 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/18692 You are on the right track. You might find some bugs/issues when you implement it. Sorry, too busy recently. --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark issue #18664: [SPARK-21375][PYSPARK][SQL][WIP] Add Date and Timestamp ...

2017-07-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18664 **[Test build #79982 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79982/testReport)** for PR 18664 at commit [`709427d`](https://github.com/apache/spark/commit/70

[GitHub] spark issue #18029: [SPARK-20168][DStream] Add changes to use kinesis fetche...

2017-07-26 Thread yssharma
Github user yssharma commented on the issue: https://github.com/apache/spark/pull/18029 Would love to work on the review feedback here @budde @brkyvz . Please have a look when you have time. --- If your project is set up for it, you can reply to this email and have your reply appear

[GitHub] spark issue #18734: [SPARK-21070][PYSPARK] Attempt to update cloudpickle aga...

2017-07-26 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/18734 I guess this should be fine in general if it simply ports the changes in cloudpickle. Will double check next week (to me, it takes a while to double check). @rgbkrk, would you mind doub

[GitHub] spark issue #18315: [SPARK-21108] [ML] [WIP] convert LinearSVC to aggregator...

2017-07-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18315 **[Test build #79981 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79981/testReport)** for PR 18315 at commit [`c8228fb`](https://github.com/apache/spark/commit/c

[GitHub] spark issue #18315: [SPARK-21108] [ML] [WIP] convert LinearSVC to aggregator...

2017-07-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18315 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79981/ Test PASSed. ---

[GitHub] spark issue #18315: [SPARK-21108] [ML] [WIP] convert LinearSVC to aggregator...

2017-07-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18315 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18707: [SPARK-21503][UI]: Spark UI shows incorrect task status ...

2017-07-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18707 **[Test build #79976 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79976/testReport)** for PR 18707 at commit [`55c6c37`](https://github.com/apache/spark/commit/5

[GitHub] spark issue #18707: [SPARK-21503][UI]: Spark UI shows incorrect task status ...

2017-07-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18707 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79976/ Test PASSed. ---

[GitHub] spark issue #18707: [SPARK-21503][UI]: Spark UI shows incorrect task status ...

2017-07-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18707 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18735: [SPARK-21530] Update description of spark.shuffle.maxChu...

2017-07-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18735 **[Test build #79983 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79983/testReport)** for PR 18735 at commit [`7db7cc7`](https://github.com/apache/spark/commit/7d

[GitHub] spark issue #18707: [SPARK-21503][UI]: Spark UI shows incorrect task status ...

2017-07-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18707 **[Test build #79978 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79978/testReport)** for PR 18707 at commit [`6b7d5c6`](https://github.com/apache/spark/commit/6

[GitHub] spark issue #18707: [SPARK-21503][UI]: Spark UI shows incorrect task status ...

2017-07-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18707 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18707: [SPARK-21503][UI]: Spark UI shows incorrect task status ...

2017-07-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18707 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79978/ Test PASSed. ---

[GitHub] spark issue #18664: [SPARK-21375][PYSPARK][SQL][WIP] Add Date and Timestamp ...

2017-07-26 Thread shaneknapp
Github user shaneknapp commented on the issue: https://github.com/apache/spark/pull/18664 i'm now thoroughly confused as pandas is now showing 0.18.0 on workers 2-8, and 0.19.2 on worker 1. latest is 0.20.3... should i just bump everything to that? also, this will

[GitHub] spark pull request #18655: [SPARK-21440][SQL][PYSPARK] Refactor ArrowConvert...

2017-07-26 Thread BryanCutler
Github user BryanCutler commented on a diff in the pull request: https://github.com/apache/spark/pull/18655#discussion_r129735129 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/arrow/ArrowConverters.scala --- @@ -77,95 +59,55 @@ private[sql] object ArrowConverter

[GitHub] spark issue #18664: [SPARK-21375][PYSPARK][SQL][WIP] Add Date and Timestamp ...

2017-07-26 Thread shaneknapp
Github user shaneknapp commented on the issue: https://github.com/apache/spark/pull/18664 nvm, i just force-installed pandas on the workers to be 0.19.2 let's see if this helps. On Wed, Jul 26, 2017 at 6:11 PM, shane knapp ☠ wrote: > i'm now thoroughly con

[GitHub] spark issue #18664: [SPARK-21375][PYSPARK][SQL][WIP] Add Date and Timestamp ...

2017-07-26 Thread BryanCutler
Github user BryanCutler commented on the issue: https://github.com/apache/spark/pull/18664 great, thanks @shaneknapp ! that should be fine --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have thi

[GitHub] spark pull request #18739: [WIP][SPARK-21539][CORE] Job should not be aborte...

2017-07-26 Thread caneGuy
Github user caneGuy closed the pull request at: https://github.com/apache/spark/pull/18739 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is en

[GitHub] spark issue #18664: [SPARK-21375][PYSPARK][SQL][WIP] Add Date and Timestamp ...

2017-07-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18664 **[Test build #79982 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79982/testReport)** for PR 18664 at commit [`709427d`](https://github.com/apache/spark/commit/7

[GitHub] spark issue #18664: [SPARK-21375][PYSPARK][SQL][WIP] Add Date and Timestamp ...

2017-07-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18664 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18664: [SPARK-21375][PYSPARK][SQL][WIP] Add Date and Timestamp ...

2017-07-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18664 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79982/ Test FAILed. ---

[GitHub] spark issue #18281: [SPARK-21027][ML][PYTHON] Added tunable parallelism to o...

2017-07-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18281 **[Test build #79984 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79984/testReport)** for PR 18281 at commit [`1c9de16`](https://github.com/apache/spark/commit/1c

[GitHub] spark issue #18281: [SPARK-21027][ML][PYTHON] Added tunable parallelism to o...

2017-07-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18281 **[Test build #79984 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79984/testReport)** for PR 18281 at commit [`1c9de16`](https://github.com/apache/spark/commit/1

[GitHub] spark issue #18281: [SPARK-21027][ML][PYTHON] Added tunable parallelism to o...

2017-07-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18281 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18281: [SPARK-21027][ML][PYTHON] Added tunable parallelism to o...

2017-07-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18281 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79984/ Test FAILed. ---

[GitHub] spark issue #18609: Spark SQL merge small files to big files Update InsertIn...

2017-07-26 Thread wuzhilon
Github user wuzhilon commented on the issue: https://github.com/apache/spark/pull/18609 I am trying to, now the problem is unable to know the number of data MB, I can only get the number of data, and then re-coarse-grained. --- If your project is set up for it, you can reply to this

[GitHub] spark issue #18664: [SPARK-21375][PYSPARK][SQL][WIP] Add Date and Timestamp ...

2017-07-26 Thread BryanCutler
Github user BryanCutler commented on the issue: https://github.com/apache/spark/pull/18664 Jenkins retest this please On Jul 26, 2017 6:54 PM, "UCB AMPLab" wrote: > Test FAILed. > Refer to this link for build results (access rights to CI server needed): > http

[GitHub] spark issue #18281: [SPARK-21027][ML][PYTHON] Added tunable parallelism to o...

2017-07-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18281 **[Test build #79985 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79985/testReport)** for PR 18281 at commit [`9f34404`](https://github.com/apache/spark/commit/9f

<    1   2   3   >