[GitHub] spark pull request #14079: [SPARK-8425][CORE] New Blacklist Mechanism

2016-07-18 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/14079#discussion_r71232039 --- Diff: docs/configuration.md --- @@ -1149,6 +1149,20 @@ Apart from these, the following properties are also available, and may be useful

[GitHub] spark pull request #14079: [SPARK-8425][CORE] New Blacklist Mechanism

2016-07-18 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/14079#discussion_r71232011 --- Diff: docs/configuration.md --- @@ -1149,6 +1149,20 @@ Apart from these, the following properties are also available, and may be useful

[GitHub] spark issue #14250: [SPARKR][DOCS] minor code sample update in R programming...

2016-07-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14250 **[Test build #62492 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62492/consoleFull)** for PR 14250 at commit

[GitHub] spark pull request #14250: [SPARKR][DOCS] minor code sample update in R prog...

2016-07-18 Thread felixcheung
GitHub user felixcheung opened a pull request: https://github.com/apache/spark/pull/14250 [SPARKR][DOCS] minor code sample update in R programming guide ## What changes were proposed in this pull request? Fix code style from ad hoc review of RC4 doc ## How was

[GitHub] spark issue #14235: [SPARK-16590][SQL] Improve LogicalPlanToSQLSuite to chec...

2016-07-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14235 **[Test build #62486 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62486/consoleFull)** for PR 14235 at commit

[GitHub] spark issue #14235: [SPARK-16590][SQL] Improve LogicalPlanToSQLSuite to chec...

2016-07-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14235 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62486/ Test FAILed. ---

[GitHub] spark issue #14235: [SPARK-16590][SQL] Improve LogicalPlanToSQLSuite to chec...

2016-07-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14235 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #12836: [SPARK-12922][SparkR][WIP] Implement gapply() on DataFra...

2016-07-18 Thread shivaram
Github user shivaram commented on the issue: https://github.com/apache/spark/pull/12836 @NarineK Not as far as I know --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #11105: [SPARK-12469][CORE] Data Property accumulators for Spark

2016-07-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/11105 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #11105: [SPARK-12469][CORE] Data Property accumulators for Spark

2016-07-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/11105 **[Test build #62480 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62480/consoleFull)** for PR 11105 at commit

[GitHub] spark issue #11105: [SPARK-12469][CORE] Data Property accumulators for Spark

2016-07-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/11105 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62480/ Test PASSed. ---

[GitHub] spark issue #14132: [SPARK-16475][SQL] Broadcast Hint for SQL Queries

2016-07-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14132 **[Test build #62491 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62491/consoleFull)** for PR 14132 at commit

[GitHub] spark issue #14174: [SPARK-16524][SQL] Add RowBatch and RowBasedHashMapGener...

2016-07-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14174 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14174: [SPARK-16524][SQL] Add RowBatch and RowBasedHashMapGener...

2016-07-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14174 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62483/ Test PASSed. ---

[GitHub] spark pull request #14169: [SPARK-16515][SQL]set default record reader and w...

2016-07-18 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14169 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #14174: [SPARK-16524][SQL] Add RowBatch and RowBasedHashMapGener...

2016-07-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14174 **[Test build #62483 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62483/consoleFull)** for PR 14174 at commit

[GitHub] spark pull request #14249: [SPARK-16515][SQL]set default record reader and w...

2016-07-18 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14249 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #14201: [SPARK-14702] Make environment of SparkLauncher launched...

2016-07-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14201 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62481/ Test PASSed. ---

[GitHub] spark issue #14201: [SPARK-14702] Make environment of SparkLauncher launched...

2016-07-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14201 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #9207: [SPARK-11171][SPARK-11237][SPARK-11241][ML] Try adding PM...

2016-07-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/9207 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #9207: [SPARK-11171][SPARK-11237][SPARK-11241][ML] Try adding PM...

2016-07-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/9207 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62478/ Test PASSed. ---

[GitHub] spark issue #14201: [SPARK-14702] Make environment of SparkLauncher launched...

2016-07-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14201 **[Test build #62481 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62481/consoleFull)** for PR 14201 at commit

[GitHub] spark issue #9207: [SPARK-11171][SPARK-11237][SPARK-11241][ML] Try adding PM...

2016-07-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/9207 **[Test build #62478 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62478/consoleFull)** for PR 9207 at commit

[GitHub] spark issue #14249: [SPARK-16515][SQL]set default record reader and writer f...

2016-07-18 Thread yhuai
Github user yhuai commented on the issue: https://github.com/apache/spark/pull/14249 I am merging this PR to master and branch 2.0. Thanks @adrian-wang --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #14176: [SPARK-16525][SQL] Enable Row Based HashMap in HashAggre...

2016-07-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14176 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62482/ Test PASSed. ---

[GitHub] spark pull request #14249: [SPARK-16515][SQL]set default record reader and w...

2016-07-18 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/14249#discussion_r71227856 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkSqlParser.scala --- @@ -1329,7 +1332,7 @@ class SparkSqlAstBuilder(conf: SQLConf)

[GitHub] spark issue #14132: [SPARK-16475][SQL] Broadcast Hint for SQL Queries

2016-07-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14132 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62490/ Test FAILed. ---

[GitHub] spark issue #14176: [SPARK-16525][SQL] Enable Row Based HashMap in HashAggre...

2016-07-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14176 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #14132: [SPARK-16475][SQL] Broadcast Hint for SQL Queries

2016-07-18 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/14132#discussion_r71227811 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/catalyst/LogicalPlanToSQLSuite.scala --- @@ -988,9 +988,88 @@ class LogicalPlanToSQLSuite

[GitHub] spark issue #14132: [SPARK-16475][SQL] Broadcast Hint for SQL Queries

2016-07-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14132 **[Test build #62490 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62490/consoleFull)** for PR 14132 at commit

[GitHub] spark issue #14132: [SPARK-16475][SQL] Broadcast Hint for SQL Queries

2016-07-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14132 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14176: [SPARK-16525][SQL] Enable Row Based HashMap in HashAggre...

2016-07-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14176 **[Test build #62482 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62482/consoleFull)** for PR 14176 at commit

[GitHub] spark pull request #14132: [SPARK-16475][SQL] Broadcast Hint for SQL Queries

2016-07-18 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/14132#discussion_r71227405 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/catalyst/LogicalPlanToSQLSuite.scala --- @@ -988,9 +988,88 @@ class LogicalPlanToSQLSuite

[GitHub] spark pull request #14079: [SPARK-8425][CORE] New Blacklist Mechanism

2016-07-18 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/14079#discussion_r71227377 --- Diff: core/src/main/scala/org/apache/spark/scheduler/BlacklistTracker.scala --- @@ -0,0 +1,221 @@ +/* + * Licensed to the Apache Software

[GitHub] spark issue #14132: [SPARK-16475][SQL] Broadcast Hint for SQL Queries

2016-07-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14132 **[Test build #62490 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62490/consoleFull)** for PR 14132 at commit

[GitHub] spark issue #14132: [SPARK-16475][SQL] Broadcast Hint for SQL Queries

2016-07-18 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/14132 Now, `window/rollup/groupingset` testcases are added. For `GlobalLimit`, I added that but I'm not sure about the testcase for it. --- If your project is set up for it, you can reply to this

[GitHub] spark pull request #14079: [SPARK-8425][CORE] New Blacklist Mechanism

2016-07-18 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/14079#discussion_r71226362 --- Diff: core/src/main/scala/org/apache/spark/scheduler/BlacklistTracker.scala --- @@ -0,0 +1,221 @@ +/* + * Licensed to the Apache Software

[GitHub] spark issue #14249: [SPARK-16515][SQL]set default record reader and writer f...

2016-07-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14249 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62479/ Test PASSed. ---

[GitHub] spark issue #14249: [SPARK-16515][SQL]set default record reader and writer f...

2016-07-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14249 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14249: [SPARK-16515][SQL]set default record reader and writer f...

2016-07-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14249 **[Test build #62479 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62479/consoleFull)** for PR 14249 at commit

[GitHub] spark issue #14022: [SPARK-16272][core] Allow config values to reference con...

2016-07-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14022 **[Test build #62489 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62489/consoleFull)** for PR 14022 at commit

[GitHub] spark issue #14022: [SPARK-16272][core] Allow config values to reference con...

2016-07-18 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/14022 > I really think you should keep the "spark." requirement. I reverted my last change since I forgot to change the test code anyway. I'll spend some time to see if it's easy to

[GitHub] spark issue #14022: [SPARK-16272][core] Allow config values to reference con...

2016-07-18 Thread ericl
Github user ericl commented on the issue: https://github.com/apache/spark/pull/14022 It looks good to me, except I really think you should keep the "spark." requirement. It seems plausible that some reason a string like '${x}' can show up in spark confs, perhaps things like

[GitHub] spark issue #14022: [SPARK-16272][core] Allow config values to reference con...

2016-07-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14022 **[Test build #62488 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62488/consoleFull)** for PR 14022 at commit

[GitHub] spark issue #14235: [SPARK-16590][SQL] Improve LogicalPlanToSQLSuite to chec...

2016-07-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14235 **[Test build #62487 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62487/consoleFull)** for PR 14235 at commit

[GitHub] spark issue #14235: [SPARK-16590][SQL] Improve LogicalPlanToSQLSuite to chec...

2016-07-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14235 **[Test build #62486 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62486/consoleFull)** for PR 14235 at commit

[GitHub] spark pull request #14235: [SPARK-16590][SQL] Improve LogicalPlanToSQLSuite ...

2016-07-18 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/14235#discussion_r71216783 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/catalyst/SQLBuilder.scala --- @@ -45,7 +46,12 @@ class SQLBuilder(logicalPlan: LogicalPlan)

[GitHub] spark issue #14235: [SPARK-16590][SQL] Improve LogicalPlanToSQLSuite to chec...

2016-07-18 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/14235 Hi, @rxin and @liancheng . I will update this PR one more time. Please wait a moment. I can use stable identifiers for `gen_attr`, too. --- If your project is set up for it, you can

[GitHub] spark issue #14022: [SPARK-16272][core] Allow config values to reference con...

2016-07-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14022 **[Test build #62485 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62485/consoleFull)** for PR 14022 at commit

[GitHub] spark pull request #14079: [SPARK-8425][CORE] New Blacklist Mechanism

2016-07-18 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/14079#discussion_r71215223 --- Diff: core/src/main/scala/org/apache/spark/internal/config/package.scala --- @@ -97,6 +97,49 @@ package object config { .toSequence

[GitHub] spark pull request #13704: [SPARK-15985][SQL] Eliminate redundant cast from ...

2016-07-18 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/13704#discussion_r71215193 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/SimplifyCastsSuite.scala --- @@ -0,0 +1,119 @@ +/* + * Licensed to the

[GitHub] spark issue #14225: [WIP][SPARK-16334] Maintain single dictionary per row-ba...

2016-07-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14225 **[Test build #62484 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62484/consoleFull)** for PR 14225 at commit

[GitHub] spark pull request #14225: [WIP][SPARK-16334] Maintain single dictionary per...

2016-07-18 Thread sameeragarwal
Github user sameeragarwal commented on a diff in the pull request: https://github.com/apache/spark/pull/14225#discussion_r71214583 --- Diff: sql/core/src/main/java/org/apache/spark/sql/execution/datasources/parquet/VectorizedColumnReader.java --- @@ -146,10 +153,8 @@ void

[GitHub] spark pull request #14054: [SPARK-16226] [SQL] Weaken JDBC isolation level t...

2016-07-18 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/14054#discussion_r71213696 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/JdbcUtils.scala --- @@ -158,25 +159,41 @@ object JdbcUtils extends Logging

[GitHub] spark issue #14248: [SPARK-16589][PYTHON] Chained cartesian produces incorre...

2016-07-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14248 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62477/ Test PASSed. ---

[GitHub] spark issue #14248: [SPARK-16589][PYTHON] Chained cartesian produces incorre...

2016-07-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14248 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14248: [SPARK-16589][PYTHON] Chained cartesian produces incorre...

2016-07-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14248 **[Test build #62477 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62477/consoleFull)** for PR 14248 at commit

[GitHub] spark issue #14243: [SPARK-10683][SPARK-16510][SPARKR] Move SparkR include j...

2016-07-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14243 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62474/ Test PASSed. ---

[GitHub] spark issue #14243: [SPARK-10683][SPARK-16510][SPARKR] Move SparkR include j...

2016-07-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14243 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14243: [SPARK-10683][SPARK-16510][SPARKR] Move SparkR include j...

2016-07-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14243 **[Test build #62474 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62474/consoleFull)** for PR 14243 at commit

[GitHub] spark issue #14028: [SPARK-16351][SQL] Avoid per-record type dispatch in JSO...

2016-07-18 Thread yhuai
Github user yhuai commented on the issue: https://github.com/apache/spark/pull/14028 Merged to master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark issue #14176: [SPARK-16525][SQL] Enable Row Based HashMap in HashAggre...

2016-07-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14176 **[Test build #62482 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62482/consoleFull)** for PR 14176 at commit

[GitHub] spark issue #14201: [SPARK-14702] Make environment of SparkLauncher launched...

2016-07-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14201 **[Test build #62481 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62481/consoleFull)** for PR 14201 at commit

[GitHub] spark issue #14174: [SPARK-16524][SQL] Add RowBatch and RowBasedHashMapGener...

2016-07-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14174 **[Test build #62483 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62483/consoleFull)** for PR 14174 at commit

[GitHub] spark issue #14201: [SPARK-14702] Make environment of SparkLauncher launched...

2016-07-18 Thread andreweduffy
Github user andreweduffy commented on the issue: https://github.com/apache/spark/pull/14201 Yuck, sorry, switching between projects my style settings were being carried over, that should be it for indentation fixes --- If your project is set up for it, you can reply to this email

[GitHub] spark issue #14065: [SPARK-14743][YARN] Add a configurable token manager for...

2016-07-18 Thread tgravescs
Github user tgravescs commented on the issue: https://github.com/apache/spark/pull/14065 sorry I haven't had time to review fully, taking a quick look I think it would be nice to add at least a blurb to the docs (running on yarn) about how to use this and pointer to scaladocs for

[GitHub] spark issue #9207: [SPARK-11171][SPARK-11237][SPARK-11241][ML] Try adding PM...

2016-07-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/9207 **[Test build #62478 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62478/consoleFull)** for PR 9207 at commit

[GitHub] spark issue #14249: [SPARK-16515][SQL]set default record reader and writer f...

2016-07-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14249 **[Test build #62479 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62479/consoleFull)** for PR 14249 at commit

[GitHub] spark issue #11105: [SPARK-12469][CORE] Data Property accumulators for Spark

2016-07-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/11105 **[Test build #62480 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62480/consoleFull)** for PR 11105 at commit

[GitHub] spark pull request #14249: [SPARK-16515][SQL]set default record reader and w...

2016-07-18 Thread yhuai
GitHub user yhuai opened a pull request: https://github.com/apache/spark/pull/14249 [SPARK-16515][SQL]set default record reader and writer for script transformation ## What changes were proposed in this pull request? In ScriptInputOutputSchema, we read default RecordReader and

[GitHub] spark issue #12914: [SPARK-15130][PySpark][ML][DOCS] pyspark expose default ...

2016-07-18 Thread holdenk
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/12914 So I'll circle back up with everyone after 2.0 is shipped - I think we should try and one the approaches (either this or @MLnick's solution) for 2.1+ because not having it in the docs just really

[GitHub] spark issue #12836: [SPARK-12922][SparkR][WIP] Implement gapply() on DataFra...

2016-07-18 Thread NarineK
Github user NarineK commented on the issue: https://github.com/apache/spark/pull/12836 @shivaram, @sun-rui , I was wondering if someone created a jira for the issue described here: https://github.com/apache/spark/pull/12836#issuecomment-225403054 --- If your project is set up

[GitHub] spark issue #13320: [SPARK-13184][SQL] Add a datasource-specific option minP...

2016-07-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13320 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13320: [SPARK-13184][SQL] Add a datasource-specific option minP...

2016-07-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13320 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62473/ Test PASSed. ---

[GitHub] spark issue #13320: [SPARK-13184][SQL] Add a datasource-specific option minP...

2016-07-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13320 **[Test build #62473 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62473/consoleFull)** for PR 13320 at commit

[GitHub] spark issue #14248: [SPARK-16589][PYTHON] Chained cartesian produces incorre...

2016-07-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14248 **[Test build #62477 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62477/consoleFull)** for PR 14248 at commit

[GitHub] spark pull request #14132: [SPARK-16475][SQL] Broadcast Hint for SQL Queries

2016-07-18 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/14132#discussion_r71203247 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/catalyst/LogicalPlanToSQLSuite.scala --- @@ -755,4 +755,243 @@ class LogicalPlanToSQLSuite

[GitHub] spark pull request #14132: [SPARK-16475][SQL] Broadcast Hint for SQL Queries

2016-07-18 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/14132#discussion_r71203038 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala --- @@ -1774,6 +1775,51 @@ class Analyzer( }

[GitHub] spark pull request #14132: [SPARK-16475][SQL] Broadcast Hint for SQL Queries

2016-07-18 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/14132#discussion_r71202999 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/catalyst/SQLBuilder.scala --- @@ -425,6 +452,49 @@ class SQLBuilder(logicalPlan: LogicalPlan)

[GitHub] spark pull request #14132: [SPARK-16475][SQL] Broadcast Hint for SQL Queries

2016-07-18 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/14132#discussion_r71202822 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/catalyst/SQLBuilder.scala --- @@ -425,6 +452,49 @@ class SQLBuilder(logicalPlan: LogicalPlan)

[GitHub] spark issue #14248: [SPARK-16589][PYTHON] Chained cartesian produces incorre...

2016-07-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14248 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62476/ Test FAILed. ---

[GitHub] spark issue #14248: [SPARK-16589][PYTHON] Chained cartesian produces incorre...

2016-07-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14248 **[Test build #62476 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62476/consoleFull)** for PR 14248 at commit

[GitHub] spark issue #14248: [SPARK-16589][PYTHON] Chained cartesian produces incorre...

2016-07-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14248 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14248: [SPARK-16589][PYTHON] Chained cartesian produces incorre...

2016-07-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14248 **[Test build #62476 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62476/consoleFull)** for PR 14248 at commit

[GitHub] spark pull request #14132: [SPARK-16475][SQL] Broadcast Hint for SQL Queries

2016-07-18 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/14132#discussion_r71202124 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/catalyst/SQLBuilder.scala --- @@ -425,6 +452,49 @@ class SQLBuilder(logicalPlan: LogicalPlan)

[GitHub] spark pull request #14132: [SPARK-16475][SQL] Broadcast Hint for SQL Queries

2016-07-18 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/14132#discussion_r71201300 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala --- @@ -1774,6 +1775,51 @@ class Analyzer( }

[GitHub] spark pull request #14132: [SPARK-16475][SQL] Broadcast Hint for SQL Queries

2016-07-18 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/14132#discussion_r71200265 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala --- @@ -87,6 +87,7 @@ class Analyzer(

[GitHub] spark issue #14223: [SPARK-10614][CORE] Change SystemClock to derive time fr...

2016-07-18 Thread markgrover
Github user markgrover commented on the issue: https://github.com/apache/spark/pull/14223 Thanks @vanzin Yeah, I noticed that too. Will take a look. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request #14022: [SPARK-16272][core] Allow config values to refere...

2016-07-18 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/14022#discussion_r71197993 --- Diff: core/src/main/scala/org/apache/spark/internal/config/ConfigEntry.scala --- @@ -99,13 +133,66 @@ private class FallbackConfigEntry[T] (

[GitHub] spark pull request #14022: [SPARK-16272][core] Allow config values to refere...

2016-07-18 Thread ericl
Github user ericl commented on a diff in the pull request: https://github.com/apache/spark/pull/14022#discussion_r71197308 --- Diff: core/src/main/scala/org/apache/spark/internal/config/ConfigEntry.scala --- @@ -99,13 +133,66 @@ private class FallbackConfigEntry[T] ( key:

[GitHub] spark issue #14248: [SPARK-16589][PYTHON] Chained cartesian produces incorre...

2016-07-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14248 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14248: [SPARK-16589][PYTHON] Chained cartesian produces incorre...

2016-07-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14248 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62475/ Test PASSed. ---

[GitHub] spark issue #14248: [SPARK-16589][PYTHON] Chained cartesian produces incorre...

2016-07-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14248 **[Test build #62475 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62475/consoleFull)** for PR 14248 at commit

[GitHub] spark issue #13051: [SPARK-15271] [MESOS] Allow force pulling executor docke...

2016-07-18 Thread mgummelt
Github user mgummelt commented on the issue: https://github.com/apache/spark/pull/13051 @andrewor14 This LGTM. Can you take a look and merge? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request #13051: [SPARK-15271] [MESOS] Allow force pulling executo...

2016-07-18 Thread mgummelt
Github user mgummelt commented on a diff in the pull request: https://github.com/apache/spark/pull/13051#discussion_r71193952 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosSchedulerBackendUtil.scala --- @@ -119,21 +122,25 @@ private[mesos] object

[GitHub] spark pull request #13051: [SPARK-15271] [MESOS] Allow force pulling executo...

2016-07-18 Thread mgummelt
Github user mgummelt commented on a diff in the pull request: https://github.com/apache/spark/pull/13051#discussion_r71193899 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosSchedulerBackendUtil.scala --- @@ -105,11 +105,14 @@ private[mesos] object

[GitHub] spark pull request #14169: [SPARK-16515][SQL]set default record reader and w...

2016-07-18 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/14169#discussion_r71192358 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkSqlParser.scala --- @@ -1306,7 +1306,7 @@ class SparkSqlAstBuilder(conf: SQLConf)

[GitHub] spark issue #13670: [SPARK-15951] Change Executors Page to use datatables to...

2016-07-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13670 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62472/ Test PASSed. ---

[GitHub] spark issue #14201: [SPARK-14702] Make environment of SparkLauncher launched...

2016-07-18 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/14201 LGTM pending a few remaining style issues. @andreweduffy our merge scripts squash PRs into a single commit, so history stays clean regardless of how you update the PR. --- If your project

[GitHub] spark pull request #14201: [SPARK-14702] Make environment of SparkLauncher l...

2016-07-18 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/14201#discussion_r71189179 --- Diff: core/src/test/java/org/apache/spark/launcher/SparkLauncherSuite.java --- @@ -85,14 +91,67 @@ public void testSparkArgumentHandling() throws

<    1   2   3   4   5   6   >