[GitHub] spark issue #16248: [SPARK-18810][SPARKR] SparkR install.spark does not work...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16248 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16248: [SPARK-18810][SPARKR] SparkR install.spark does not work...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16248 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69980/ Test FAILed. ---

[GitHub] spark issue #16248: [SPARK-18810][SPARKR] SparkR install.spark does not work...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16248 **[Test build #69980 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69980/consoleFull)** for PR 16248 at commit

[GitHub] spark issue #16248: [SPARK-18810][SPARKR] SparkR install.spark does not work...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16248 **[Test build #69982 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69982/consoleFull)** for PR 16248 at commit

[GitHub] spark issue #16220: [SPARK-18796][SS]StreamingQueryManager should not block ...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16220 **[Test build #69981 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69981/consoleFull)** for PR 16220 at commit

[GitHub] spark issue #16220: [SPARK-18796][SS]StreamingQueryManager should not block ...

Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/16220 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark pull request #16135: [SPARK-18700][SQL] Add StripedLock for each table...

Github user ericl commented on a diff in the pull request: https://github.com/apache/spark/pull/16135#discussion_r91849717 --- Diff: core/src/main/scala/org/apache/spark/metrics/source/StaticSources.scala --- @@ -97,6 +97,12 @@ object HiveCatalogMetrics extends Source {

[GitHub] spark pull request #16135: [SPARK-18700][SQL] Add StripedLock for each table...

Github user ericl commented on a diff in the pull request: https://github.com/apache/spark/pull/16135#discussion_r91849698 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/PartitionedTablePerfStatsSuite.scala --- @@ -352,4 +353,28 @@ class

[GitHub] spark pull request #16135: [SPARK-18700][SQL] Add StripedLock for each table...

Github user ericl commented on a diff in the pull request: https://github.com/apache/spark/pull/16135#discussion_r91849704 --- Diff: core/src/main/scala/org/apache/spark/metrics/source/StaticSources.scala --- @@ -105,6 +111,7 @@ object HiveCatalogMetrics extends Source {

[GitHub] spark issue #16248: [SPARK-18810][SPARKR] SparkR install.spark does not work...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16248 **[Test build #69980 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69980/consoleFull)** for PR 16248 at commit

[GitHub] spark pull request #16248: [SPARK-18810][SPARKR] SparkR install.spark does n...

GitHub user felixcheung opened a pull request: https://github.com/apache/spark/pull/16248 [SPARK-18810][SPARKR] SparkR install.spark does not work for RCs, snapshots ## What changes were proposed in this pull request? Support overriding the download url (include version

[GitHub] spark pull request #16135: [SPARK-18700][SQL] Add StripedLock for each table...

Github user xuanyuanking commented on a diff in the pull request: https://github.com/apache/spark/pull/16135#discussion_r91849598 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/PartitionedTablePerfStatsSuite.scala --- @@ -352,4 +353,28 @@ class

[GitHub] spark pull request #16135: [SPARK-18700][SQL] Add StripedLock for each table...

Github user xuanyuanking commented on a diff in the pull request: https://github.com/apache/spark/pull/16135#discussion_r91849563 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveMetastoreCatalog.scala --- @@ -53,6 +56,18 @@ private[hive] class

[GitHub] spark pull request #16135: [SPARK-18700][SQL] Add StripedLock for each table...

Github user xuanyuanking commented on a diff in the pull request: https://github.com/apache/spark/pull/16135#discussion_r91849565 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/PartitionedTablePerfStatsSuite.scala --- @@ -352,4 +353,28 @@ class

[GitHub] spark pull request #16135: [SPARK-18700][SQL] Add StripedLock for each table...

Github user xuanyuanking commented on a diff in the pull request: https://github.com/apache/spark/pull/16135#discussion_r91849561 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveMetastoreCatalog.scala --- @@ -53,6 +56,18 @@ private[hive] class

[GitHub] spark pull request #16135: [SPARK-18700][SQL] Add StripedLock for each table...

Github user xuanyuanking commented on a diff in the pull request: https://github.com/apache/spark/pull/16135#discussion_r91849557 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveMetastoreCatalog.scala --- @@ -53,6 +56,18 @@ private[hive] class

[GitHub] spark pull request #16135: [SPARK-18700][SQL] Add StripedLock for each table...

Github user xuanyuanking commented on a diff in the pull request: https://github.com/apache/spark/pull/16135#discussion_r91849543 --- Diff: core/src/main/scala/org/apache/spark/metrics/source/StaticSources.scala --- @@ -97,6 +97,12 @@ object HiveCatalogMetrics extends Source {

[GitHub] spark pull request #16135: [SPARK-18700][SQL] Add StripedLock for each table...

Github user xuanyuanking commented on a diff in the pull request: https://github.com/apache/spark/pull/16135#discussion_r91849544 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveMetastoreCatalog.scala --- @@ -33,6 +35,7 @@ import

[GitHub] spark issue #16135: [SPARK-18700][SQL] Add StripedLock for each table's rela...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16135 **[Test build #69979 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69979/consoleFull)** for PR 16135 at commit

[GitHub] spark issue #14638: [SPARK-11374][SQL] Support `skip.header.line.count` opti...

Github user jamartinh commented on the issue: https://github.com/apache/spark/pull/14638 My humble comment is simply that an external Hive table still is a Hive Table, and as such it should be transparent for whichever user how to work with it, even for spark users like me. The

[GitHub] spark issue #16244: [SQL][minor] simplify a test to fix the maven tests

Github user rxin commented on the issue: https://github.com/apache/spark/pull/16244 sgtm --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] spark issue #16246: [SPARK-18814][SQL] CheckAnalysis rejects TPCDS query 32

Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16246 cc @hvanhovell @ericl --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #16246: [SPARK-18814][SQL] CheckAnalysis rejects TPCDS qu...

Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16246#discussion_r91848250 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala --- @@ -1225,15 +1225,37 @@ class Analyzer( }

[GitHub] spark pull request #16246: [SPARK-18814][SQL] CheckAnalysis rejects TPCDS qu...

Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16246#discussion_r91848198 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala --- @@ -1225,15 +1225,37 @@ class Analyzer( }

[GitHub] spark pull request #16246: [SPARK-18814][SQL] CheckAnalysis rejects TPCDS qu...

Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16246#discussion_r91848190 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala --- @@ -1225,15 +1225,37 @@ class Analyzer( }

[GitHub] spark pull request #16243: [SPARK-18815] [SQL] Fix NPE when collecting colum...

Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16243 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #16243: [SPARK-18815] [SQL] Fix NPE when collecting column stats...

Github user rxin commented on the issue: https://github.com/apache/spark/pull/16243 Merging in master/branch-2.1. Thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #16204: [SPARK-18775][SQL] Limit the max number of record...

Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/16204#discussion_r91848018 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/FileFormatWriter.scala --- @@ -311,7 +335,10 @@ object FileFormatWriter extends

[GitHub] spark pull request #16145: [MINOR][CORE][SQL] Remove explicit RDD and Partit...

Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/16145#discussion_r91847976 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/ShuffledRowRDD.scala --- @@ -117,7 +113,7 @@ class CoalescedPartitioner(val parent:

[GitHub] spark issue #16246: [SPARK-18814][SQL] CheckAnalysis rejects TPCDS query 32

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16246 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69978/ Test PASSed. ---

[GitHub] spark issue #16246: [SPARK-18814][SQL] CheckAnalysis rejects TPCDS query 32

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16246 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16246: [SPARK-18814][SQL] CheckAnalysis rejects TPCDS query 32

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16246 **[Test build #69978 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69978/consoleFull)** for PR 16246 at commit

[GitHub] spark issue #16245: [SQL][WIP] Add optimizer rule to reorder Filter predicat...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16245 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69977/ Test PASSed. ---

[GitHub] spark issue #16245: [SQL][WIP] Add optimizer rule to reorder Filter predicat...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16245 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16245: [SQL][WIP] Add optimizer rule to reorder Filter predicat...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16245 **[Test build #69977 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69977/consoleFull)** for PR 16245 at commit

[GitHub] spark issue #16247: [SPARK-18817][SparkR] set default spark-warehouse path t...

Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/16247 ... that's actually what I meant with "we might want to pass the R tempdir() along as a property" <-- this would be a new property and not `spark.sql.warehouse.dir` --- If your project is set

[GitHub] spark issue #16233: [SPARK-18801][SQL] Add `View` operator to help resolve a...

Github user nsyca commented on the issue: https://github.com/apache/spark/pull/16233 @jiangxb1987: Let's hear other people's feedback. My thoughts are: - According to the function prologue, `lookupRelations` seems to be a perfect place to return a `LogicalPlan` representing

[GitHub] spark issue #16228: [WIP] [SPARK-17076] [SQL] Cardinality estimation for joi...

Github user Tagar commented on the issue: https://github.com/apache/spark/pull/16228 @wzhfy, thanks for the feedback. For outer joins, cardinaility estimates should be: - left_outer_join_cardinality(table_A, table_B) = MAX(cardinality(A), inner_join_cardinality(table_A,

[GitHub] spark pull request #16179: [SPARK-18752][hive] "isSrcLocal" value should be ...

Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16179#discussion_r91846277 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveCommandSuite.scala --- @@ -190,87 +258,39 @@ class HiveCommandSuite extends

[GitHub] spark issue #16179: [SPARK-18752][hive] "isSrcLocal" value should be set fro...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16179 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16179: [SPARK-18752][hive] "isSrcLocal" value should be set fro...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16179 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69976/ Test PASSed. ---

[GitHub] spark issue #16179: [SPARK-18752][hive] "isSrcLocal" value should be set fro...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16179 **[Test build #69976 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69976/consoleFull)** for PR 16179 at commit

[GitHub] spark issue #16246: [SPARK-18814][SQL] CheckAnalysis rejects TPCDS query 32

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16246 **[Test build #69978 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69978/consoleFull)** for PR 16246 at commit

[GitHub] spark issue #16247: [SPARK-18817][SparkR] set default spark-warehouse path t...

Github user shivaram commented on the issue: https://github.com/apache/spark/pull/16247 Or we could introduce a new property say spark.sql.default.warehouse and set that to tmpdir() On Dec 10, 2016 16:53, "Felix Cheung" wrote: > I think

[GitHub] spark issue #16247: [SPARK-18817][SparkR] set default spark-warehouse path t...

Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/16247 I think we should only change `spark.sql.warehouse.dir` when we are loading SparkR as a package. This should minimize changes in the case where we are running in cluster mode and so on.

[GitHub] spark pull request #16247: [SPARK-18817][SparkR] set default spark-warehouse...

Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/16247#discussion_r91845399 --- Diff: R/pkg/R/sparkR.R --- @@ -362,6 +362,10 @@ sparkR.session <- function( enableHiveSupport = TRUE, ...) { + if

[GitHub] spark issue #16245: [SQL][WIP] Add optimizer rule to reorder Filter predicat...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16245 **[Test build #69977 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69977/consoleFull)** for PR 16245 at commit

[GitHub] spark issue #16149: [SPARK-18715][ML]Fix AIC calculations in Binomial GLM

Github user actuaryzhang commented on the issue: https://github.com/apache/spark/pull/16149 @sethah Would you please review this? Thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request #16245: [SQL][WIP] Add optimizer rule to reorder Filter p...

Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/16245#discussion_r91845297 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/expressions.scala --- @@ -514,6 +514,19 @@ case class

[GitHub] spark pull request #16245: [SQL][WIP] Add optimizer rule to reorder Filter p...

Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/16245#discussion_r91845272 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/expressions.scala --- @@ -514,6 +514,19 @@ case class OptimizeCodegen(conf:

[GitHub] spark issue #16179: [SPARK-18752][hive] "isSrcLocal" value should be set fro...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16179 **[Test build #69976 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69976/consoleFull)** for PR 16179 at commit

[GitHub] spark issue #16236: SPARK-18809: KCL version to 1.6.2 on master

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16236 **[Test build #3492 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3492/consoleFull)** for PR 16236 at commit

[GitHub] spark issue #16179: [SPARK-18752][hive] "isSrcLocal" value should be set fro...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16179 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69973/ Test PASSed. ---

[GitHub] spark issue #16179: [SPARK-18752][hive] "isSrcLocal" value should be set fro...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16179 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16179: [SPARK-18752][hive] "isSrcLocal" value should be set fro...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16179 **[Test build #69973 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69973/consoleFull)** for PR 16179 at commit

[GitHub] spark issue #16247: [SPARK-18817][SparkR] set default spark-warehouse path t...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16247 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16247: [SPARK-18817][SparkR] set default spark-warehouse path t...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16247 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69975/ Test PASSed. ---

[GitHub] spark issue #16247: [SPARK-18817][SparkR] set default spark-warehouse path t...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16247 **[Test build #69975 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69975/consoleFull)** for PR 16247 at commit

[GitHub] spark issue #16056: [SPARK-18623][SQL] Add `returnNullable` to `StaticInvoke...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16056 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69972/ Test PASSed. ---

[GitHub] spark issue #16056: [SPARK-18623][SQL] Add `returnNullable` to `StaticInvoke...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16056 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16056: [SPARK-18623][SQL] Add `returnNullable` to `StaticInvoke...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16056 **[Test build #69972 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69972/consoleFull)** for PR 16056 at commit

[GitHub] spark issue #16247: [SPARK-18817][SparkR] set default spark-warehouse path t...

Github user shivaram commented on the issue: https://github.com/apache/spark/pull/16247 @bdwyer2 One more thing: Is there a good way to test this ? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request #16247: [SPARK-18817][SparkR] set default spark-warehouse...

Github user shivaram commented on a diff in the pull request: https://github.com/apache/spark/pull/16247#discussion_r91843477 --- Diff: R/pkg/R/sparkR.R --- @@ -362,6 +362,10 @@ sparkR.session <- function( enableHiveSupport = TRUE, ...) { + if

[GitHub] spark issue #16247: [MINOR][SparkR] set default spark-warehouse path to temp...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16247 **[Test build #69975 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69975/consoleFull)** for PR 16247 at commit

[GitHub] spark issue #16247: [MINOR][SparkR] set default spark-warehouse path to temp...

Github user shivaram commented on the issue: https://github.com/apache/spark/pull/16247 @bdwyer2 Feel free to open a JIRA as a sub-task under SPARK-15799 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark issue #16247: [MINOR][SparkR] set default spark-warehouse path to temp...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16247 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16247: [MINOR][SparkR] set default spark-warehouse path to temp...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16247 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69974/ Test FAILed. ---

[GitHub] spark issue #16247: [MINOR][SparkR] set default spark-warehouse path to temp...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16247 **[Test build #69974 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69974/consoleFull)** for PR 16247 at commit

[GitHub] spark issue #16247: [MINOR][SparkR] set default spark-warehouse path to temp...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16247 **[Test build #69974 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69974/consoleFull)** for PR 16247 at commit

[GitHub] spark issue #16247: [MINOR][SparkR] set default spark-warehouse path to temp...

Github user bdwyer2 commented on the issue: https://github.com/apache/spark/pull/16247 Should I open a JIRA under SPARK-15799 myself or leave that to one of the admins? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark issue #16247: [MINOR][SparkR] set default spark-warehouse path to temp...

Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/16247 I see. Thank you both for your comments. (BTW, this should have a JIRA I think.) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark issue #16240: [SPARK-16792][SQL] Dataset containing a Case Class with ...

Github user michalsenkyr commented on the issue: https://github.com/apache/spark/pull/16240 Added support for arbitrary sequences. Now also Queues, ArrayBuffers and such can be used in datasets (all are serialized into ArrayType). I had to alter and add new implicit

[GitHub] spark issue #16247: [MINOR][SparkR] set default spark-warehouse path to temp...

Github user shivaram commented on the issue: https://github.com/apache/spark/pull/16247 @HyukjinKwon That is a good point. As @bdwyer2 says the question is one of defaults. If the user does specify a more permanent location we will use that. I wonder if we should print a warning or

[GitHub] spark issue #16247: [MINOR][SparkR] set default spark-warehouse path to temp...

Github user bdwyer2 commented on the issue: https://github.com/apache/spark/pull/16247 @HyukjinKwon yes but we are restricted by CRAN policies > Packages should not write in the users’ home filespace, nor anywhere else on the file system apart from the R session’s

[GitHub] spark issue #16247: [MINOR][SparkR] set default spark-warehouse path to temp...

Github user shivaram commented on the issue: https://github.com/apache/spark/pull/16247 Jenkins, ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #16247: [MINOR][SparkR] set default spark-warehouse path to temp...

Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/16247 I may missed something but isn't tmpdir per R's session? Maybe I should have tried it first but I guess it wouldn't be accessible after the R session is ended and another one is started. Is

[GitHub] spark issue #12257: [SPARK-14483][WEBUI] Display user name for each job and ...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/12257 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69971/ Test PASSed. ---

[GitHub] spark issue #12257: [SPARK-14483][WEBUI] Display user name for each job and ...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/12257 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #12257: [SPARK-14483][WEBUI] Display user name for each job and ...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/12257 **[Test build #69971 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69971/consoleFull)** for PR 12257 at commit

[GitHub] spark issue #16247: [MINOR][SparkR] set default spark-warehouse path to temp...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16247 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #16247: [MINOR][SparkR] set default spark-warehouse path ...

GitHub user bdwyer2 opened a pull request: https://github.com/apache/spark/pull/16247 [MINOR][SparkR] set default spark-warehouse path to tempdir() ## What changes were proposed in this pull request? Set the default location of `spark.sql.warehouse.dir` to be compliant with

[GitHub] spark issue #16242: [SPARK-18628][ML] Update Scala param and Python param to...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16242 **[Test build #3491 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3491/consoleFull)** for PR 16242 at commit

[GitHub] spark issue #16179: [SPARK-18752][hive] "isSrcLocal" value should be set fro...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16179 **[Test build #69973 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69973/consoleFull)** for PR 16179 at commit

[GitHub] spark issue #16236: SPARK-18809: KCL version to 1.6.2 on master

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16236 **[Test build #3492 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3492/consoleFull)** for PR 16236 at commit

[GitHub] spark pull request #16145: [MINOR][CORE][SQL] Remove explicit RDD and Partit...

Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/16145#discussion_r91841529 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/ShuffledRowRDD.scala --- @@ -117,7 +113,7 @@ class CoalescedPartitioner(val parent:

[GitHub] spark pull request #16157: [SPARK-18723][DOC] Expanded programming guide inf...

Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/16157#discussion_r91841458 --- Diff: docs/programming-guide.md --- @@ -347,7 +347,7 @@ Some notes on reading files with Spark: Apart from text files, Spark's Scala API also

[GitHub] spark issue #16033: SPARK-18607 get a result on a percent of the tasks succe...

Github user srowen commented on the issue: https://github.com/apache/spark/pull/16033 Hm, I am just concerned about all the questions this raises. These jobs wouldn't be deterministic anymore, and this isn't really a way to deal with skew. I don't think this is something we shoudl

[GitHub] spark issue #16210: [Core][SPARK-18778]Fix the scala classpath under some en...

Github user srowen commented on the issue: https://github.com/apache/spark/pull/16210 I'm still not clear how to reproduce this. I can't repro with Java 8, Debian, on 2.x. Is this really necessary or somehow band-aiding some other deployment problem? that is, why does this work for

[GitHub] spark issue #16212: [SPARK-18782] [BUILD] Bump Hadoop 2.6 version to use Had...

Github user srowen commented on the issue: https://github.com/apache/spark/pull/16212 Let's close this if there's no pressing need to update. Spark actually doesn't touch most of Hadoop, just client APIs. --- If your project is set up for it, you can reply to this email and have

[GitHub] spark issue #16056: [SPARK-18623][SQL] Add `returnNullable` to `StaticInvoke...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16056 **[Test build #69972 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69972/consoleFull)** for PR 16056 at commit

[GitHub] spark issue #16180: [DOCS][MINOR] Clarify Where AccumulatorV2s are Displayed

Github user srowen commented on the issue: https://github.com/apache/spark/pull/16180 Ping @anabranch for one more round of edits --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #16234: [SPARK-18803][TESTS] Fix JarEntry-related & path-...

Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16234 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #16201: [SPARK-3359][DOCS] Fix greater-than symbols in Ja...

Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16201 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #16234: [SPARK-18803][TESTS] Fix JarEntry-related & path-related...

Github user srowen commented on the issue: https://github.com/apache/spark/pull/16234 Merged to master --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark issue #16201: [SPARK-3359][DOCS] Fix greater-than symbols in Javadoc t...

Github user srowen commented on the issue: https://github.com/apache/spark/pull/16201 Merged to master/2.1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #16242: [SPARK-18628][ML] Update Scala param and Python param to...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16242 **[Test build #3491 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3491/consoleFull)** for PR 16242 at commit

[GitHub] spark issue #16134: [SPARK-18703] [SQL] Drop Staging Directories and Data Fi...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16134 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16134: [SPARK-18703] [SQL] Drop Staging Directories and Data Fi...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16134 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69970/ Test PASSed. ---

[GitHub] spark issue #16134: [SPARK-18703] [SQL] Drop Staging Directories and Data Fi...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16134 **[Test build #69970 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69970/consoleFull)** for PR 16134 at commit

[GitHub] spark issue #13909: [SPARK-16213][SQL] Reduce runtime overhead of a program ...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13909 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

  1   2   >