[GitHub] spark issue #14517: [SPARK-16931][PYTHON] PySpark APIS for bucketBy and sort...

2016-08-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14517 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13621: [SPARK-2623] [ML] Implement stacked autoencoder

2016-08-08 Thread MLnick
Github user MLnick commented on the issue: https://github.com/apache/spark/pull/13621 cc @JeremyNixon also --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #14517: [SPARK-16931][PYTHON] PySpark APIS for bucketBy and sort...

2016-08-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14517 **[Test build #63364 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63364/consoleFull)** for PR 14517 at commit [`47d9ef7`](https://github.com/apache/spark/commit/4

[GitHub] spark issue #14517: [SPARK-16931][PYTHON] PySpark APIS for bucketBy and sort...

2016-08-08 Thread MLnick
Github user MLnick commented on the issue: https://github.com/apache/spark/pull/14517 ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark pull request #14517: [SPARK-16931][PYTHON] PySpark APIS for bucketBy a...

2016-08-08 Thread MLnick
Github user MLnick commented on a diff in the pull request: https://github.com/apache/spark/pull/14517#discussion_r73884828 --- Diff: python/pyspark/sql/readwriter.py --- @@ -500,6 +500,41 @@ def partitionBy(self, *cols): self._jwrite = self._jwrite.partitionBy(_to_seq(

[GitHub] spark pull request #14517: [SPARK-16931][PYTHON] PySpark APIS for bucketBy a...

2016-08-08 Thread MLnick
Github user MLnick commented on a diff in the pull request: https://github.com/apache/spark/pull/14517#discussion_r73884740 --- Diff: python/pyspark/sql/readwriter.py --- @@ -500,6 +500,41 @@ def partitionBy(self, *cols): self._jwrite = self._jwrite.partitionBy(_to_seq(

[GitHub] spark issue #14519: [SPARK-16933] [ML] Fix AFTAggregator in AFTSurvivalRegre...

2016-08-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14519 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark pull request #14113: [SPARK-16457] [SQL] Fix Wrong Messages when CTAS ...

2016-08-08 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14113 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #14519: [SPARK-16933] [ML] Fix AFTAggregator in AFTSurvivalRegre...

2016-08-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14519 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63362/ Test PASSed. ---

[GitHub] spark issue #14519: [SPARK-16933] [ML] Fix AFTAggregator in AFTSurvivalRegre...

2016-08-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14519 **[Test build #63362 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63362/consoleFull)** for PR 14519 at commit [`287f153`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14113: [SPARK-16457] [SQL] Fix Wrong Messages when CTAS with a ...

2016-08-08 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/14113 thanks, merging to master and 2.0! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enable

[GitHub] spark pull request #14517: [SPARK-16931][PYTHON] PySpark APIS for bucketBy a...

2016-08-08 Thread MLnick
Github user MLnick commented on a diff in the pull request: https://github.com/apache/spark/pull/14517#discussion_r73884350 --- Diff: python/pyspark/sql/readwriter.py --- @@ -500,6 +500,41 @@ def partitionBy(self, *cols): self._jwrite = self._jwrite.partitionBy(_to_seq(

[GitHub] spark pull request #14501: [SPARK-16906][SQL] Adds auxiliary info like input...

2016-08-08 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14501 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #14501: [SPARK-16906][SQL] Adds auxiliary info like input class ...

2016-08-08 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/14501 thanks, merging to master! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wi

[GitHub] spark pull request #14494: [SPARK-16898][SQL] Adds argument type information...

2016-08-08 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/14494#discussion_r73881870 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/aggregate/typedaggregators.scala --- @@ -27,7 +27,7 @@ import org.apache.spark.sql.expres

[GitHub] spark pull request #14519: [SPARK-16933] [ML] Fix AFTAggregator in AFTSurviv...

2016-08-08 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/14519#discussion_r73881801 --- Diff: mllib/src/main/scala/org/apache/spark/ml/regression/AFTSurvivalRegression.scala --- @@ -478,21 +482,23 @@ object AFTSurvivalRegressionModel ext

[GitHub] spark issue #14540: [SPARK-16950] [PySpark] fromOffsets parameter support in...

2016-08-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14540 **[Test build #63363 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63363/consoleFull)** for PR 14540 at commit [`d2a4027`](https://github.com/apache/spark/commit/d

[GitHub] spark issue #14540: [SPARK-16950] [PySpark] fromOffsets parameter support in...

2016-08-08 Thread MLnick
Github user MLnick commented on the issue: https://github.com/apache/spark/pull/14540 ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #14520: [SPARK-16934][ML][MLLib] Improve LogisticCostFun to avoi...

2016-08-08 Thread MLnick
Github user MLnick commented on the issue: https://github.com/apache/spark/pull/14520 @WeichenXu123 I believe #13729 already took care of the actual serialization issue. Out of interest have you tested this impl here for a difference in shuffle data read/write? However, #1410

[GitHub] spark issue #14519: [SPARK-16933] [ML] Fix AFTAggregator in AFTSurvivalRegre...

2016-08-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14519 **[Test build #63362 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63362/consoleFull)** for PR 14519 at commit [`287f153`](https://github.com/apache/spark/commit/2

[GitHub] spark issue #12574: [SPARK-13857][ML][WIP] Add "recommend all" functionality...

2016-08-08 Thread MLnick
Github user MLnick commented on the issue: https://github.com/apache/spark/pull/12574 @debasish83 thanks, would like to get your comments especially around `transform` semantics. I will be doing performance testing on this and post numbers soon. --- If your project is set up for it,

[GitHub] spark issue #14539: [SPARK-16947][SQL] Improve type coercion for inline tabl...

2016-08-08 Thread eyalfa
Github user eyalfa commented on the issue: https://github.com/apache/spark/pull/14539 fair enough, I think it's worth adding a negative test just to see what we're dealing with. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark pull request #14414: [SPARK-16809] enable history server links in disp...

2016-08-08 Thread skonto
Github user skonto commented on a diff in the pull request: https://github.com/apache/spark/pull/14414#discussion_r73874399 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosCoarseGrainedSchedulerBackend.scala --- @@ -152,8 +152,13 @@ private[spark] class

[GitHub] spark issue #14524: [SPARK-16832] [ML] [WIP] CrossValidator and TrainValidat...

2016-08-08 Thread MLnick
Github user MLnick commented on the issue: https://github.com/apache/spark/pull/14524 I tend to agree the default should be a new random seed, and it is more consistent with other libs. But @jkbradley seemed to explicitly want things to default to reproducible behavior in [SPARK-7678

[GitHub] spark pull request #13146: [SPARK-13081][PYSPARK][SPARK_SUBMIT]. Allow set p...

2016-08-08 Thread zjffdu
GitHub user zjffdu reopened a pull request: https://github.com/apache/spark/pull/13146 [SPARK-13081][PYSPARK][SPARK_SUBMIT]. Allow set pythonExec of driver and executor through conf… ## What changes were proposed in this pull request? Before this PR, user have to export e

[GitHub] spark pull request #13146: [SPARK-13081][PYSPARK][SPARK_SUBMIT]. Allow set p...

2016-08-08 Thread zjffdu
Github user zjffdu closed the pull request at: https://github.com/apache/spark/pull/13146 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #13146: [SPARK-13081][PYSPARK][SPARK_SUBMIT]. Allow set pythonEx...

2016-08-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13146 **[Test build #63361 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63361/consoleFull)** for PR 13146 at commit [`0a6a96c`](https://github.com/apache/spark/commit/0

[GitHub] spark issue #14539: [SPARK-16947][SQL] Improve type coercion for inline tabl...

2016-08-08 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/14539 @eyalfa I am a bit hesitant to add yet another almost pointless `LogicalPlan` node to Catalyst, and certainly not one that is functionally exactly the same as a `Union`. This would require us to

[GitHub] spark pull request #14414: [SPARK-16809] enable history server links in disp...

2016-08-08 Thread skonto
Github user skonto commented on a diff in the pull request: https://github.com/apache/spark/pull/14414#discussion_r73872335 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosClusterScheduler.scala --- @@ -37,32 +37,36 @@ import org.apache.spark.util.Utils

[GitHub] spark issue #14538: [SPARK-16588][SQL][FOLLOWUP] Rename approxCountDistinct,...

2016-08-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14538 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63359/ Test PASSed. ---

[GitHub] spark issue #14538: [SPARK-16588][SQL][FOLLOWUP] Rename approxCountDistinct,...

2016-08-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14538 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14538: [SPARK-16588][SQL][FOLLOWUP] Rename approxCountDistinct,...

2016-08-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14538 **[Test build #63359 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63359/consoleFull)** for PR 14538 at commit [`99e49f0`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14539: [SPARK-16947][SQL] Improve type coercion for inline tabl...

2016-08-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14539 **[Test build #63360 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63360/consoleFull)** for PR 14539 at commit [`3f3aa93`](https://github.com/apache/spark/commit/3

[GitHub] spark issue #14539: [SPARK-16947][SQL] Improve type coercion for inline tabl...

2016-08-08 Thread eyalfa
Github user eyalfa commented on the issue: https://github.com/apache/spark/pull/14539 @hvanhovell don't you think that if you're already taking a stab at it, it's better to introduce something like UnresolvedInlineTable with its own resolution logic and type coercion, once it's resol

[GitHub] spark issue #14540: [SPARK-16950] [PySpark] fromOffsets parameter support in...

2016-08-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14540 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark issue #14530: [SPARK-16868][Web Ui] Fix executor be both dead and aliv...

2016-08-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14530 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14538: [SPARK-16588][SQL][FOLLOWUP] Rename approxCountDistinct,...

2016-08-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14538 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14538: [SPARK-16588][SQL][FOLLOWUP] Rename approxCountDistinct,...

2016-08-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14538 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63357/ Test PASSed. ---

[GitHub] spark issue #14530: [SPARK-16868][Web Ui] Fix executor be both dead and aliv...

2016-08-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14530 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63355/ Test PASSed. ---

[GitHub] spark issue #14538: [SPARK-16588][SQL][FOLLOWUP] Rename approxCountDistinct,...

2016-08-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14538 **[Test build #63357 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63357/consoleFull)** for PR 14538 at commit [`fc0203e`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14530: [SPARK-16868][Web Ui] Fix executor be both dead and aliv...

2016-08-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14530 **[Test build #63355 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63355/consoleFull)** for PR 14530 at commit [`c065661`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #14540: [SPARK-16950] [PySpark] fromOffsets parameter sup...

2016-08-08 Thread szczeles
GitHub user szczeles opened a pull request: https://github.com/apache/spark/pull/14540 [SPARK-16950] [PySpark] fromOffsets parameter support in KafkaUtils.createDirectStream for python3 ## What changes were proposed in this pull request? Ability to use KafkaUtils.createDire

[GitHub] spark issue #14538: [SPARK-16588][SQL][FOLLOWUP] Rename approxCountDistinct,...

2016-08-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14538 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63356/ Test PASSed. ---

[GitHub] spark issue #14538: [SPARK-16588][SQL][FOLLOWUP] Rename approxCountDistinct,...

2016-08-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14538 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14538: [SPARK-16588][SQL][FOLLOWUP] Rename approxCountDistinct,...

2016-08-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14538 **[Test build #63356 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63356/consoleFull)** for PR 14538 at commit [`230db75`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #14511: [SPARK-16927] [SPARK-16923] Override task propert...

2016-08-08 Thread skonto
Github user skonto commented on a diff in the pull request: https://github.com/apache/spark/pull/14511#discussion_r73868759 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosClusterScheduler.scala --- @@ -463,9 +455,20 @@ private[spark] class MesosCluster

[GitHub] spark issue #14539: [SPARK-16947][SQL] Improve type coercion for inline tabl...

2016-08-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14539 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63358/ Test FAILed. ---

[GitHub] spark issue #14539: [SPARK-16947][SQL] Improve type coercion for inline tabl...

2016-08-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14539 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14539: [SPARK-16947][SQL] Improve type coercion for inline tabl...

2016-08-08 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/14539 @eyalfa It is currently going to complain about Unions (if type coercion fails). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. I

[GitHub] spark issue #14539: [SPARK-16947][SQL] Improve type coercion for inline tabl...

2016-08-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14539 **[Test build #63358 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63358/consoleFull)** for PR 14539 at commit [`3b0a28b`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14414: [SPARK-16809] enable history server links in dispatcher ...

2016-08-08 Thread skonto
Github user skonto commented on the issue: https://github.com/apache/spark/pull/14414 > cc @skonto. This somewhat relates to your work on https://issues.apache.org/jira/browse/SPARK-13401, but it seems to be disjoint. The link is not correct i guess you meant https://issues.a

[GitHub] spark issue #14414: [SPARK-16809] enable history server links in dispatcher ...

2016-08-08 Thread skonto
Github user skonto commented on the issue: https://github.com/apache/spark/pull/14414 You need to add UI screenshots for the changes in the description (https://github.com/apache/spark/blob/master/.github/PULL_REQUEST_TEMPLATE). --- If your project is set up for it, you can reply to

[GitHub] spark issue #14539: [SPARK-16947][SQL] Improve type coercion for inline tabl...

2016-08-08 Thread eyalfa
Github user eyalfa commented on the issue: https://github.com/apache/spark/pull/14539 @hvanhovell in case of validation error, how will the error message look like? will it mention inline-tables in any way, or is it just going to complain about Union's requirements? --- If your proj

[GitHub] spark pull request #14511: [SPARK-16927] [SPARK-16923] Override task propert...

2016-08-08 Thread skonto
Github user skonto commented on a diff in the pull request: https://github.com/apache/spark/pull/14511#discussion_r73864717 --- Diff: docs/running-on-mesos.md --- @@ -467,7 +467,19 @@ See the [configuration page](configuration.html) for information on Spark config Set the

[GitHub] spark pull request #14511: [SPARK-16927] [SPARK-16923] Override task propert...

2016-08-08 Thread skonto
Github user skonto commented on a diff in the pull request: https://github.com/apache/spark/pull/14511#discussion_r73864552 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosClusterScheduler.scala --- @@ -463,9 +455,20 @@ private[spark] class MesosCluster

[GitHub] spark pull request #14511: [SPARK-16927] [SPARK-16923] Override task propert...

2016-08-08 Thread skonto
Github user skonto commented on a diff in the pull request: https://github.com/apache/spark/pull/14511#discussion_r73864247 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosClusterScheduler.scala --- @@ -358,14 +358,12 @@ private[spark] class MesosCluste

[GitHub] spark issue #14538: [SPARK-16588][SQL][FOLLOWUP] Rename approxCountDistinct,...

2016-08-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14538 **[Test build #63359 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63359/consoleFull)** for PR 14538 at commit [`99e49f0`](https://github.com/apache/spark/commit/9

[GitHub] spark issue #14539: [SPARK-16947][SQL] Improve type coercion for inline tabl...

2016-08-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14539 **[Test build #63358 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63358/consoleFull)** for PR 14539 at commit [`3b0a28b`](https://github.com/apache/spark/commit/3

[GitHub] spark issue #14539: [SPARK-16947][SQL] Improve type coercion for inline tabl...

2016-08-08 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/14539 cc @cloud-fan @eyalfa --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark pull request #14539: [SPARK-16947][SQL] Improve type coercion for inli...

2016-08-08 Thread hvanhovell
GitHub user hvanhovell opened a pull request: https://github.com/apache/spark/pull/14539 [SPARK-16947][SQL] Improve type coercion for inline tables. ## What changes were proposed in this pull request? Inline tables were added in to Spark SQL in 2.0, e.g.: `select * from values (

[GitHub] spark issue #14534: [SPARK-16941]Add SynchronizedMap trait with Map in Spark...

2016-08-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14534 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63354/ Test PASSed. ---

[GitHub] spark issue #14534: [SPARK-16941]Add SynchronizedMap trait with Map in Spark...

2016-08-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14534 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14534: [SPARK-16941]Add SynchronizedMap trait with Map in Spark...

2016-08-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14534 **[Test build #63354 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63354/consoleFull)** for PR 14534 at commit [`2591b50`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14538: [SPARK-16588][SQL][FOLLOWUP] Rename approxCountDistinct,...

2016-08-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14538 **[Test build #63357 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63357/consoleFull)** for PR 14538 at commit [`fc0203e`](https://github.com/apache/spark/commit/f

[GitHub] spark issue #14538: [SPARK-16588][SQL][FOLLOWUP] Rename approxCountDistinct,...

2016-08-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14538 **[Test build #63356 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63356/consoleFull)** for PR 14538 at commit [`230db75`](https://github.com/apache/spark/commit/2

[GitHub] spark issue #14538: [SPARK-16588][SQL][FOLLOWUP] Rename approxCountDistinct,...

2016-08-08 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/14538 cc @rxin --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if t

[GitHub] spark pull request #14538: [SPARK-16588][SQL][FOLLOWUP] Rename approxCountDi...

2016-08-08 Thread HyukjinKwon
GitHub user HyukjinKwon opened a pull request: https://github.com/apache/spark/pull/14538 [SPARK-16588][SQL][FOLLOWUP] Rename approxCountDistinct, toDegrees and toRadians according to FunctionRegistry as well. ## What changes were proposed in this pull request? It seems `ap

[GitHub] spark issue #14530: [SPARK-16868][Web Ui] Fix executor be both dead and aliv...

2016-08-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14530 **[Test build #63355 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63355/consoleFull)** for PR 14530 at commit [`c065661`](https://github.com/apache/spark/commit/c

[GitHub] spark issue #14534: [SPARK-16941]Add SynchronizedMap trait with Map in Spark...

2016-08-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14534 **[Test build #63354 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63354/consoleFull)** for PR 14534 at commit [`2591b50`](https://github.com/apache/spark/commit/2

[GitHub] spark issue #14511: [SPARK-16927] [SPARK-16923] Override task properties at ...

2016-08-08 Thread skonto
Github user skonto commented on the issue: https://github.com/apache/spark/pull/14511 I will have a look shortly --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishe

[GitHub] spark pull request #14411: [SPARK-16804][SQL] Correlated subqueries containi...

2016-08-08 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14411 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #14411: [SPARK-16804][SQL] Correlated subqueries containing non-...

2016-08-08 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/14411 Merging to master. Thanks for working on this! Ping me as soon as you open a JIRA for null aware anti joins. --- If your project is set up for it, you can reply to this email and have yo

[GitHub] spark issue #14116: [SPARK-16452][SQL] Support basic INFORMATION_SCHEMA

2016-08-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14116 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63351/ Test PASSed. ---

[GitHub] spark issue #14116: [SPARK-16452][SQL] Support basic INFORMATION_SCHEMA

2016-08-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14116 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14116: [SPARK-16452][SQL] Support basic INFORMATION_SCHEMA

2016-08-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14116 **[Test build #63351 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63351/consoleFull)** for PR 14116 at commit [`9ad03d9`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14537: [SPARK-16948][SQL] Querying empty partitioned orc tables...

2016-08-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14537 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63352/ Test PASSed. ---

[GitHub] spark issue #14537: [SPARK-16948][SQL] Querying empty partitioned orc tables...

2016-08-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14537 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14537: [SPARK-16948][SQL] Querying empty partitioned orc tables...

2016-08-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14537 **[Test build #63352 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63352/consoleFull)** for PR 14537 at commit [`5721b88`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14411: [SPARK-16804][SQL] Correlated subqueries containing non-...

2016-08-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14411 **[Test build #3208 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3208/consoleFull)** for PR 14411 at commit [`7eb9b2d`](https://github.com/apache/spark/commit

[GitHub] spark issue #14065: [SPARK-14743][YARN] Add a configurable credential manage...

2016-08-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14065 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63349/ Test PASSed. ---

[GitHub] spark issue #14065: [SPARK-14743][YARN] Add a configurable credential manage...

2016-08-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14065 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14065: [SPARK-14743][YARN] Add a configurable credential manage...

2016-08-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14065 **[Test build #63349 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63349/consoleFull)** for PR 14065 at commit [`32c16c0`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14534: [SPARK-16941]Add SynchronizedMap trait with Map in Spark...

2016-08-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14534 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14534: [SPARK-16941]Add SynchronizedMap trait with Map in Spark...

2016-08-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14534 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63353/ Test FAILed. ---

[GitHub] spark issue #14534: [SPARK-16941]Add SynchronizedMap trait with Map in Spark...

2016-08-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14534 **[Test build #63353 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63353/consoleFull)** for PR 14534 at commit [`a333269`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14534: [SPARK-16941]Add SynchronizedMap trait with Map in Spark...

2016-08-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14534 **[Test build #63353 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63353/consoleFull)** for PR 14534 at commit [`a333269`](https://github.com/apache/spark/commit/a

[GitHub] spark issue #14537: [SPARK-16948][SQL] Querying empty partitioned orc tables...

2016-08-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14537 **[Test build #63352 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63352/consoleFull)** for PR 14537 at commit [`5721b88`](https://github.com/apache/spark/commit/5

[GitHub] spark issue #14426: [SPARK-16475][SQL] Broadcast Hint for SQL Queries

2016-08-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14426 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63348/ Test PASSed. ---

[GitHub] spark issue #14426: [SPARK-16475][SQL] Broadcast Hint for SQL Queries

2016-08-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14426 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark pull request #14537: [SPARK-16948][SQL] Querying empty partitioned orc...

2016-08-08 Thread rajeshbalamohan
GitHub user rajeshbalamohan opened a pull request: https://github.com/apache/spark/pull/14537 [SPARK-16948][SQL] Querying empty partitioned orc tables throws excep… ## What changes were proposed in this pull request? Querying empty partitioned ORC tables from spark-sql throws e

[GitHub] spark issue #14426: [SPARK-16475][SQL] Broadcast Hint for SQL Queries

2016-08-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14426 **[Test build #63348 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63348/consoleFull)** for PR 14426 at commit [`79c91be`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14532: SPARK-16945: Fix Java Lint errors

2016-08-08 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14532 Merged to master --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or i

[GitHub] spark pull request #14532: SPARK-16945: Fix Java Lint errors

2016-08-08 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14532 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #14509: [SPARK-16924][SQL] - Support option("inferSchema", true)...

2016-08-08 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/14509 To the original issue here, `inferSchema` is CSV-specific option. I guess we don't need this option for other sources because, - we need anyway to read the same amount of data for JSON (

[GitHub] spark issue #14509: [SPARK-16924][SQL] - Support option("inferSchema", true)...

2016-08-08 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/14509 1. I think this issue is related with the question, https://issues.apache.org/jira/browse/SPARK-15458. It seems we want to disable the inference and promote to give schema explicitly in this cas

[GitHub] spark issue #14175: [SPARK-16522][MESOS] Spark application throws exception ...

2016-08-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14175 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63345/ Test PASSed. ---

[GitHub] spark issue #14175: [SPARK-16522][MESOS] Spark application throws exception ...

2016-08-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14175 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14175: [SPARK-16522][MESOS] Spark application throws exception ...

2016-08-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14175 **[Test build #63345 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63345/consoleFull)** for PR 14175 at commit [`5348138`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #14232: [SPARK-16587] [CORE] The annotation for the abstr...

2016-08-08 Thread f7753
Github user f7753 closed the pull request at: https://github.com/apache/spark/pull/14232 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request #14530: [SPARK-16868][Web Ui] Fix executor be both dead a...

2016-08-08 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/14530#discussion_r73835552 --- Diff: core/src/main/scala/org/apache/spark/storage/StorageStatusListener.scala --- @@ -77,6 +77,18 @@ class StorageStatusListener(conf: SparkConf) extends

<    1   2   3   4   5   6   7   >