[GitHub] spark issue #15072: [SPARK-17123][SQL] Use type-widen encoder for DataFrame ...

2016-09-12 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/15072 cc @dongjoon-hyun too who I believe took a look for this ahead. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark issue #15072: [SPARK-17123][SQL] Use type-widen encoder for DataFrame ...

2016-09-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15072 **[Test build #65302 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65302/consoleFull)** for PR 15072 at commit

[GitHub] spark issue #15072: [SPARK-17123][SQL] Use type-widen encoder for DataFrame ...

2016-09-12 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/15072 @rxin and @JoshRosen Actually, I made this patch few weeks ago but I was being hesitated to submit this PR because it seems hacky. Though, I found this issue is pretty major and not fixed for

[GitHub] spark pull request #13943: [SPARK-16251][CORE][wip] Fix Flaky test - LocalCh...

2016-09-12 Thread ScrapCodes
Github user ScrapCodes closed the pull request at: https://github.com/apache/spark/pull/13943 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] spark pull request #15072: [SPARK-17123][SQL] Use type-widen encoder for Dat...

2016-09-12 Thread HyukjinKwon
GitHub user HyukjinKwon opened a pull request: https://github.com/apache/spark/pull/15072 [SPARK-17123][SQL] Use type-widen encoder for DataFrame rather than existing encoder to allow type-widening from set operations ## What changes were proposed in this pull request?

[GitHub] spark pull request #14452: [SPARK-16849][SQL][WIP] Improve subquery executio...

2016-09-12 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/14452#discussion_r78499987 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/exchange/EnsureRequirements.scala --- @@ -268,3 +269,35 @@ case class

[GitHub] spark pull request #14452: [SPARK-16849][SQL][WIP] Improve subquery executio...

2016-09-12 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/14452#discussion_r78499975 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/subquery/CommonSubquery.scala --- @@ -0,0 +1,68 @@ +/* + * Licensed to the Apache

[GitHub] spark issue #14452: [SPARK-16849][SQL][WIP] Improve subquery execution by de...

2016-09-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14452 **[Test build #65301 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65301/consoleFull)** for PR 14452 at commit

[GitHub] spark issue #15071: [WIP][SPARK-17517][SQL]Improve generated Code for Broadc...

2016-09-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15071 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #15071: [WIP][SPARK-17517][SQL]Improve generated Code for...

2016-09-12 Thread yaooqinn
GitHub user yaooqinn opened a pull request: https://github.com/apache/spark/pull/15071 [WIP][SPARK-17517][SQL]Improve generated Code for BroadcastHashJoinExec ## What changes were proposed in this pull request? For current `BroadcastHashJoinExec`, we generate join code for

[GitHub] spark issue #15035: [SPARK-17477]: SparkSQL cannot handle schema evolution f...

2016-09-12 Thread wgtmac
Github user wgtmac commented on the issue: https://github.com/apache/spark/pull/15035 @HyukjinKwon Yup that makes sense. Do you have any idea where is the best place to fix this? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub

[GitHub] spark issue #14793: [SPARK-17221] [SQL] Build File-based Test Cases for Usin...

2016-09-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14793 **[Test build #65300 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65300/consoleFull)** for PR 14793 at commit

[GitHub] spark issue #14793: [SPARK-17221] [SQL] Build File-based Test Cases for Usin...

2016-09-12 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/14793 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #11119: [SPARK-10780][ML] Add an initial model to kmeans

2016-09-12 Thread yinxusen
Github user yinxusen commented on the issue: https://github.com/apache/spark/pull/9 ping @dbtsai @sethah --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark pull request #15024: [SPARK-17470][SQL] unify path for data source tab...

2016-09-12 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/15024#discussion_r78495300 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DataSource.scala --- @@ -435,13 +435,13 @@ case class DataSource(

[GitHub] spark pull request #10840: [SPARK-12797] [SQL] Generated TungstenAggregate (...

2016-09-12 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/10840#discussion_r78495137 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/metric/SQLMetricsSuite.scala --- @@ -71,7 +71,9 @@ class SQLMetricsSuite extends

[GitHub] spark pull request #14452: [SPARK-16849][SQL][WIP] Improve subquery executio...

2016-09-12 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/14452#discussion_r78494742 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/exchange/EnsureRequirements.scala --- @@ -268,3 +269,35 @@ case class

[GitHub] spark issue #15054: [SPARK-17502] [SQL] Fix Multiple Bugs in DDL Statements ...

2016-09-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15054 **[Test build #65299 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65299/consoleFull)** for PR 15054 at commit

[GitHub] spark pull request #14750: [SPARK-17183][SQL] put hive serde table schema to...

2016-09-12 Thread clockfly
Github user clockfly commented on a diff in the pull request: https://github.com/apache/spark/pull/14750#discussion_r78494405 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveExternalCatalog.scala --- @@ -93,8 +92,11 @@ private[spark] class HiveExternalCatalog(conf:

[GitHub] spark pull request #14452: [SPARK-16849][SQL][WIP] Improve subquery executio...

2016-09-12 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/14452#discussion_r78494245 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/subquery/CommonSubquery.scala --- @@ -0,0 +1,68 @@ +/* + * Licensed to the Apache

[GitHub] spark issue #15070: [SPARK-17515] CollectLimit.execute() should perform per-...

2016-09-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15070 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65296/ Test PASSed. ---

[GitHub] spark issue #15070: [SPARK-17515] CollectLimit.execute() should perform per-...

2016-09-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15070 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15070: [SPARK-17515] CollectLimit.execute() should perform per-...

2016-09-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15070 **[Test build #65296 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65296/consoleFull)** for PR 15070 at commit

[GitHub] spark issue #14912: [SPARK-17357][SQL] Fix current predicate pushdown

2016-09-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14912 **[Test build #65298 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65298/consoleFull)** for PR 14912 at commit

[GitHub] spark pull request #15024: [SPARK-17470][SQL] unify path for data source tab...

2016-09-12 Thread clockfly
Github user clockfly commented on a diff in the pull request: https://github.com/apache/spark/pull/15024#discussion_r78493500 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DataSource.scala --- @@ -435,13 +435,13 @@ case class DataSource(

[GitHub] spark issue #13758: [SPARK-16043][SQL] Prepare GenericArrayData implementati...

2016-09-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13758 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65293/ Test PASSed. ---

[GitHub] spark issue #13758: [SPARK-16043][SQL] Prepare GenericArrayData implementati...

2016-09-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13758 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13758: [SPARK-16043][SQL] Prepare GenericArrayData implementati...

2016-09-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13758 **[Test build #65293 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65293/consoleFull)** for PR 13758 at commit

[GitHub] spark pull request #15024: [SPARK-17470][SQL] unify path for data source tab...

2016-09-12 Thread clockfly
Github user clockfly commented on a diff in the pull request: https://github.com/apache/spark/pull/15024#discussion_r78493170 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/createDataSourceTables.scala --- @@ -204,13 +194,21 @@ case class

[GitHub] spark pull request #15024: [SPARK-17470][SQL] unify path for data source tab...

2016-09-12 Thread clockfly
Github user clockfly commented on a diff in the pull request: https://github.com/apache/spark/pull/15024#discussion_r78493048 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/createDataSourceTables.scala --- @@ -204,13 +194,21 @@ case class

[GitHub] spark issue #14912: [SPARK-17357][SQL] Fix current predicate pushdown

2016-09-12 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/14912 ping @srinathshankar @cloud-fan @hvanhovell Can you help review this change? Some context here: Some predicates are unable to push down because: 1. Predicates are simplified

[GitHub] spark issue #14981: [SPARK-17418] Remove Kinesis artifacts from Spark releas...

2016-09-12 Thread lresende
Github user lresende commented on the issue: https://github.com/apache/spark/pull/14981 @srowen should I update this PR with the removal of kinesis assembly then ? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #14912: [SPARK-17357][SQL] Fix current predicate pushdown

2016-09-12 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/14912 @nsyca Thanks for your detailed comment. I would like to leave the decision of predicate transformation to later PRs, as this PR is not motivated by this. I think to simplify a predicate

[GitHub] spark issue #15068: [SPARK-17514] df.take(1) and df.limit(1).collect() shoul...

2016-09-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15068 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65290/ Test PASSed. ---

[GitHub] spark issue #15068: [SPARK-17514] df.take(1) and df.limit(1).collect() shoul...

2016-09-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15068 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15068: [SPARK-17514] df.take(1) and df.limit(1).collect() shoul...

2016-09-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15068 **[Test build #65290 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65290/consoleFull)** for PR 15068 at commit

[GitHub] spark issue #15068: [SPARK-17514] df.take(1) and df.limit(1).collect() shoul...

2016-09-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15068 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15068: [SPARK-17514] df.take(1) and df.limit(1).collect() shoul...

2016-09-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15068 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65288/ Test PASSed. ---

[GitHub] spark issue #15068: [SPARK-17514] df.take(1) and df.limit(1).collect() shoul...

2016-09-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15068 **[Test build #65288 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65288/consoleFull)** for PR 15068 at commit

[GitHub] spark issue #14858: [SPARK-17219][ML] Add NaN value handling in Bucketizer

2016-09-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14858 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14858: [SPARK-17219][ML] Add NaN value handling in Bucketizer

2016-09-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14858 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65295/ Test FAILed. ---

[GitHub] spark issue #14858: [SPARK-17219][ML] Add NaN value handling in Bucketizer

2016-09-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14858 **[Test build #65295 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65295/consoleFull)** for PR 14858 at commit

[GitHub] spark issue #15063: [SPARK-17463][Core]Make CollectionAccumulator and SetAcc...

2016-09-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15063 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15063: [SPARK-17463][Core]Make CollectionAccumulator and SetAcc...

2016-09-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15063 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65287/ Test PASSed. ---

[GitHub] spark issue #15065: [SPARK-17463][Core]Add memory barriers for accumulators

2016-09-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15065 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65286/ Test PASSed. ---

[GitHub] spark issue #14547: [SPARK-16718][MLlib] gbm-style treeboost

2016-09-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14547 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15063: [SPARK-17463][Core]Make CollectionAccumulator and SetAcc...

2016-09-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15063 **[Test build #65287 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65287/consoleFull)** for PR 15063 at commit

[GitHub] spark issue #14547: [SPARK-16718][MLlib] gbm-style treeboost

2016-09-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14547 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65297/ Test FAILed. ---

[GitHub] spark issue #15065: [SPARK-17463][Core]Add memory barriers for accumulators

2016-09-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15065 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14547: [SPARK-16718][MLlib] gbm-style treeboost

2016-09-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14547 **[Test build #65297 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65297/consoleFull)** for PR 14547 at commit

[GitHub] spark issue #15065: [SPARK-17463][Core]Add memory barriers for accumulators

2016-09-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15065 **[Test build #65286 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65286/consoleFull)** for PR 15065 at commit

[GitHub] spark issue #14858: [SPARK-17219][ML] Add NaN value handling in Bucketizer

2016-09-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14858 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14858: [SPARK-17219][ML] Add NaN value handling in Bucketizer

2016-09-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14858 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65294/ Test FAILed. ---

[GitHub] spark issue #14858: [SPARK-17219][ML] Add NaN value handling in Bucketizer

2016-09-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14858 **[Test build #65294 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65294/consoleFull)** for PR 14858 at commit

[GitHub] spark pull request #15024: [SPARK-17470][SQL] unify path for data source tab...

2016-09-12 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/15024#discussion_r78487932 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/ddl.scala --- @@ -665,15 +665,7 @@ case class AlterTableSetLocationCommand(

[GitHub] spark issue #15070: [SPARK-17515] CollectLimit.execute() should perform per-...

2016-09-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15070 **[Test build #65296 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65296/consoleFull)** for PR 15070 at commit

[GitHub] spark issue #14547: [SPARK-16718][MLlib] gbm-style treeboost

2016-09-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14547 **[Test build #65297 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65297/consoleFull)** for PR 14547 at commit

[GitHub] spark pull request #15070: [SPARK-17515] CollectLimit.execute() should perfo...

2016-09-12 Thread JoshRosen
GitHub user JoshRosen opened a pull request: https://github.com/apache/spark/pull/15070 [SPARK-17515] CollectLimit.execute() should perform per-partition limits ## What changes were proposed in this pull request? CollectLimit.execute() incorrectly omits per-partition

[GitHub] spark issue #14858: [SPARK-17219][ML] Add NaN value handling in Bucketizer

2016-09-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14858 **[Test build #65295 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65295/consoleFull)** for PR 14858 at commit

[GitHub] spark issue #14858: [SPARK-17219][ML] Add NaN value handling in Bucketizer

2016-09-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14858 **[Test build #65294 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65294/consoleFull)** for PR 14858 at commit

[GitHub] spark issue #12819: [SPARK-14077][ML] Refactor NaiveBayes to support weighte...

2016-09-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/12819 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #12819: [SPARK-14077][ML] Refactor NaiveBayes to support weighte...

2016-09-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/12819 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65289/ Test PASSed. ---

[GitHub] spark issue #12819: [SPARK-14077][ML] Refactor NaiveBayes to support weighte...

2016-09-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/12819 **[Test build #65289 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65289/consoleFull)** for PR 12819 at commit

[GitHub] spark issue #14659: [SPARK-16757] Set up Spark caller context to HDFS

2016-09-12 Thread Sherry302
Github user Sherry302 commented on the issue: https://github.com/apache/spark/pull/14659 Hi, @tgravescs Could you please review this PR? Thank you very much. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #13758: [SPARK-16043][SQL] Prepare GenericArrayData implementati...

2016-09-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13758 **[Test build #65293 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65293/consoleFull)** for PR 13758 at commit

[GitHub] spark issue #14547: [SPARK-16718][MLlib] gbm-style treeboost

2016-09-12 Thread vlad17
Github user vlad17 commented on the issue: https://github.com/apache/spark/pull/14547 @jkbradley I addressed your comments (will be pushing new version after tests run), but I didn't understand what you were referring to in the "test gists" comment. Would you mind clarifying? ---

[GitHub] spark issue #13758: [SPARK-16043][SQL] Prepare GenericArrayData implementati...

2016-09-12 Thread kiszk
Github user kiszk commented on the issue: https://github.com/apache/spark/pull/13758 Jenkins retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #11122: [SPARK-13027][STREAMING] Added batch time as a parameter...

2016-09-12 Thread zzcclp
Github user zzcclp commented on the issue: https://github.com/apache/spark/pull/11122 @aramesh117 you should update code based on master branch to resovlve conflicts, and then, jenkins will test this pr automatically. --- If your project is set up for it, you can reply to this

[GitHub] spark pull request #14547: [SPARK-16718][MLlib] gbm-style treeboost

2016-09-12 Thread vlad17
Github user vlad17 commented on a diff in the pull request: https://github.com/apache/spark/pull/14547#discussion_r78485087 --- Diff: mllib/src/main/scala/org/apache/spark/ml/tree/treeParams.scala --- @@ -465,33 +497,64 @@ private[ml] trait GBTParams extends TreeEnsembleParams

[GitHub] spark pull request #14547: [SPARK-16718][MLlib] gbm-style treeboost

2016-09-12 Thread vlad17
Github user vlad17 commented on a diff in the pull request: https://github.com/apache/spark/pull/14547#discussion_r78485063 --- Diff: mllib/src/main/scala/org/apache/spark/ml/tree/treeParams.scala --- @@ -465,33 +497,64 @@ private[ml] trait GBTParams extends TreeEnsembleParams

[GitHub] spark issue #15066: [SPARK-171114][SQL] Fix literals in GROUP BY 1 columns [...

2016-09-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15066 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15066: [SPARK-171114][SQL] Fix literals in GROUP BY 1 columns [...

2016-09-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15066 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65285/ Test PASSed. ---

[GitHub] spark pull request #14547: [SPARK-16718][MLlib] gbm-style treeboost

2016-09-12 Thread vlad17
Github user vlad17 commented on a diff in the pull request: https://github.com/apache/spark/pull/14547#discussion_r78485041 --- Diff: mllib/src/main/scala/org/apache/spark/ml/tree/treeParams.scala --- @@ -501,36 +564,75 @@ private[ml] trait GBTClassifierParams extends GBTParams

[GitHub] spark pull request #14547: [SPARK-16718][MLlib] gbm-style treeboost

2016-09-12 Thread vlad17
Github user vlad17 commented on a diff in the pull request: https://github.com/apache/spark/pull/14547#discussion_r78484998 --- Diff: mllib/src/main/scala/org/apache/spark/ml/tree/treeParams.scala --- @@ -465,33 +497,64 @@ private[ml] trait GBTParams extends TreeEnsembleParams

[GitHub] spark issue #15069: [SPARK-17511] Yarn Dynamic Allocation: Avoid marking rel...

2016-09-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15069 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #15066: [SPARK-171114][SQL] Fix literals in GROUP BY 1 columns [...

2016-09-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15066 **[Test build #65285 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65285/consoleFull)** for PR 15066 at commit

[GitHub] spark pull request #15069: [SPARK-17511] Yarn Dynamic Allocation: Avoid mark...

2016-09-12 Thread kishorvpatil
GitHub user kishorvpatil opened a pull request: https://github.com/apache/spark/pull/15069 [SPARK-17511] Yarn Dynamic Allocation: Avoid marking released container as Failed ## What changes were proposed in this pull request? Due to race conditions, the `

[GitHub] spark pull request #14547: [SPARK-16718][MLlib] gbm-style treeboost

2016-09-12 Thread vlad17
Github user vlad17 commented on a diff in the pull request: https://github.com/apache/spark/pull/14547#discussion_r78484752 --- Diff: mllib/src/main/scala/org/apache/spark/ml/tree/treeParams.scala --- @@ -220,32 +222,42 @@ private[ml] object TreeClassifierParams { final val

[GitHub] spark pull request #14547: [SPARK-16718][MLlib] gbm-style treeboost

2016-09-12 Thread vlad17
Github user vlad17 commented on a diff in the pull request: https://github.com/apache/spark/pull/14547#discussion_r78484742 --- Diff: mllib/src/main/scala/org/apache/spark/ml/tree/treeParams.scala --- @@ -183,24 +191,18 @@ private[ml] trait DecisionTreeParams extends

[GitHub] spark pull request #14547: [SPARK-16718][MLlib] gbm-style treeboost

2016-09-12 Thread vlad17
Github user vlad17 commented on a diff in the pull request: https://github.com/apache/spark/pull/14547#discussion_r78484674 --- Diff: mllib/src/main/scala/org/apache/spark/ml/tree/treeParams.scala --- @@ -183,24 +191,18 @@ private[ml] trait DecisionTreeParams extends

[GitHub] spark pull request #14547: [SPARK-16718][MLlib] gbm-style treeboost

2016-09-12 Thread vlad17
Github user vlad17 commented on a diff in the pull request: https://github.com/apache/spark/pull/14547#discussion_r78484559 --- Diff: mllib/src/main/scala/org/apache/spark/ml/tree/impurity/ApproxBernoulliImpurity.scala --- @@ -0,0 +1,162 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request #14547: [SPARK-16718][MLlib] gbm-style treeboost

2016-09-12 Thread vlad17
Github user vlad17 commented on a diff in the pull request: https://github.com/apache/spark/pull/14547#discussion_r78484507 --- Diff: mllib/src/main/scala/org/apache/spark/ml/tree/treeParams.scala --- @@ -183,24 +191,18 @@ private[ml] trait DecisionTreeParams extends

[GitHub] spark pull request #15024: [SPARK-17470][SQL] unify path for data source tab...

2016-09-12 Thread clockfly
Github user clockfly commented on a diff in the pull request: https://github.com/apache/spark/pull/15024#discussion_r78484539 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/ddl.scala --- @@ -665,15 +665,7 @@ case class AlterTableSetLocationCommand(

[GitHub] spark pull request #10840: [SPARK-12797] [SQL] Generated TungstenAggregate (...

2016-09-12 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/10840#discussion_r78484215 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/metric/SQLMetricsSuite.scala --- @@ -71,7 +71,9 @@ class SQLMetricsSuite extends

[GitHub] spark pull request #14547: [SPARK-16718][MLlib] gbm-style treeboost

2016-09-12 Thread vlad17
Github user vlad17 commented on a diff in the pull request: https://github.com/apache/spark/pull/14547#discussion_r78484182 --- Diff: mllib/src/main/scala/org/apache/spark/ml/tree/impurity/ApproxBernoulliImpurity.scala --- @@ -0,0 +1,162 @@ +/* + * Licensed to the Apache

[GitHub] spark issue #15064: [SPARK-17509]]When wrapping catalyst datatype to Hive da...

2016-09-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15064 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #14547: [SPARK-16718][MLlib] gbm-style treeboost

2016-09-12 Thread vlad17
Github user vlad17 commented on a diff in the pull request: https://github.com/apache/spark/pull/14547#discussion_r78484135 --- Diff: mllib/src/main/scala/org/apache/spark/ml/tree/impurity/ApproxBernoulliImpurity.scala --- @@ -0,0 +1,162 @@ +/* + * Licensed to the Apache

[GitHub] spark issue #15064: [SPARK-17509]]When wrapping catalyst datatype to Hive da...

2016-09-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15064 **[Test build #65292 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65292/consoleFull)** for PR 15064 at commit

[GitHub] spark issue #15064: [SPARK-17509]]When wrapping catalyst datatype to Hive da...

2016-09-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15064 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65292/ Test FAILed. ---

[GitHub] spark pull request #14547: [SPARK-16718][MLlib] gbm-style treeboost

2016-09-12 Thread vlad17
Github user vlad17 commented on a diff in the pull request: https://github.com/apache/spark/pull/14547#discussion_r78484048 --- Diff: mllib/src/main/scala/org/apache/spark/ml/tree/impl/GradientBoostedTrees.scala --- @@ -258,11 +258,13 @@ private[spark] object GradientBoostedTrees

[GitHub] spark pull request #14547: [SPARK-16718][MLlib] gbm-style treeboost

2016-09-12 Thread vlad17
Github user vlad17 commented on a diff in the pull request: https://github.com/apache/spark/pull/14547#discussion_r78483990 --- Diff: mllib/src/main/scala/org/apache/spark/ml/tree/impl/GradientBoostedTrees.scala --- @@ -258,11 +258,13 @@ private[spark] object GradientBoostedTrees

[GitHub] spark pull request #14834: [SPARK-17163][ML] Unified LogisticRegression inte...

2016-09-12 Thread dbtsai
Github user dbtsai commented on a diff in the pull request: https://github.com/apache/spark/pull/14834#discussion_r78483816 --- Diff: mllib/src/main/scala/org/apache/spark/ml/classification/LogisticRegression.scala --- @@ -460,33 +577,74 @@ class LogisticRegression

[GitHub] spark issue #15064: [SPARK-17509]]When wrapping catalyst datatype to Hive da...

2016-09-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15064 **[Test build #65292 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65292/consoleFull)** for PR 15064 at commit

[GitHub] spark issue #15064: [SPARK-17509]]When wrapping catalyst datatype to Hive da...

2016-09-12 Thread sitalkedia
Github user sitalkedia commented on the issue: https://github.com/apache/spark/pull/15064 Fix build. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark issue #11122: [SPARK-13027][STREAMING] Added batch time as a parameter...

2016-09-12 Thread aramesh117
Github user aramesh117 commented on the issue: https://github.com/apache/spark/pull/11122 @zzcclp This pr was completed and approved by @zsxwing but hasn't been merged for some reason. I've tried to reach @tdas but he hasn't responded. What should we do? Now, there appear to be merge

[GitHub] spark pull request #14547: [SPARK-16718][MLlib] gbm-style treeboost

2016-09-12 Thread vlad17
Github user vlad17 commented on a diff in the pull request: https://github.com/apache/spark/pull/14547#discussion_r78483380 --- Diff: mllib/src/main/scala/org/apache/spark/ml/tree/impl/DTStatsAggregator.scala --- @@ -33,11 +34,13 @@ private[spark] class DTStatsAggregator(

[GitHub] spark issue #11122: [SPARK-13027][STREAMING] Added batch time as a parameter...

2016-09-12 Thread zzcclp
Github user zzcclp commented on the issue: https://github.com/apache/spark/pull/11122 ping @zsxwing @tdas --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark pull request #14547: [SPARK-16718][MLlib] gbm-style treeboost

2016-09-12 Thread vlad17
Github user vlad17 commented on a diff in the pull request: https://github.com/apache/spark/pull/14547#discussion_r78482838 --- Diff: mllib/src/main/scala/org/apache/spark/ml/regression/GBTRegressor.scala --- @@ -134,11 +146,15 @@ class GBTRegressor @Since("1.4.0")

[GitHub] spark pull request #14547: [SPARK-16718][MLlib] gbm-style treeboost

2016-09-12 Thread vlad17
Github user vlad17 commented on a diff in the pull request: https://github.com/apache/spark/pull/14547#discussion_r78482844 --- Diff: mllib/src/main/scala/org/apache/spark/ml/regression/GBTRegressor.scala --- @@ -17,13 +17,13 @@ package org.apache.spark.ml.regression

[GitHub] spark pull request #14547: [SPARK-16718][MLlib] gbm-style treeboost

2016-09-12 Thread vlad17
Github user vlad17 commented on a diff in the pull request: https://github.com/apache/spark/pull/14547#discussion_r78482842 --- Diff: mllib/src/main/scala/org/apache/spark/ml/regression/GBTRegressor.scala --- @@ -38,25 +38,35 @@ import org.apache.spark.sql.{DataFrame, Dataset}

  1   2   3   4   5   6   >