[jira] [Created] (SPARK-4194) Exceptions thrown during SparkContext or SparkEnv construction might lead to resource leaks or corrupted global state

Josh Rosen created SPARK-4194: - Summary: Exceptions thrown during SparkContext or SparkEnv construction might lead to resource leaks or corrupted global state Key: SPARK-4194 URL:

[jira] [Commented] (SPARK-4194) Exceptions thrown during SparkContext or SparkEnv construction might lead to resource leaks or corrupted global state

[ https://issues.apache.org/jira/browse/SPARK-4194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193732#comment-14193732 ] Josh Rosen commented on SPARK-4194: --- I've marked this a blocker of SPARK-4180, an issue

[jira] [Updated] (SPARK-4180) SparkContext constructor should throw exception if another SparkContext is already running

[ https://issues.apache.org/jira/browse/SPARK-4180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-4180: -- Labels: (was: starter) SparkContext constructor should throw exception if another SparkContext is

[jira] [Resolved] (SPARK-3466) Limit size of results that a driver collects for each action

[ https://issues.apache.org/jira/browse/SPARK-3466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia resolved SPARK-3466. -- Resolution: Fixed Fix Version/s: 1.2.0 Limit size of results that a driver collects for

[jira] [Commented] (SPARK-4180) SparkContext constructor should throw exception if another SparkContext is already running

[ https://issues.apache.org/jira/browse/SPARK-4180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193747#comment-14193747 ] Patrick Wendell commented on SPARK-4180: Yeah [~adav] just ran into an issue where

[jira] [Commented] (SPARK-4195) retry to fetch blocks's result when fetchfailed's reason is connection timeout

[ https://issues.apache.org/jira/browse/SPARK-4195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193827#comment-14193827 ] Apache Spark commented on SPARK-4195: - User 'lianhuiwang' has created a pull request

[jira] [Updated] (SPARK-1406) PMML model evaluation support via MLib

[ https://issues.apache.org/jira/browse/SPARK-1406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vincenzo Selvaggio updated SPARK-1406: -- Attachment: kmeans.xml SPARK-1406.pdf PMML model evaluation support

[jira] [Commented] (SPARK-1406) PMML model evaluation support via MLib

[ https://issues.apache.org/jira/browse/SPARK-1406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193829#comment-14193829 ] Vincenzo Selvaggio commented on SPARK-1406: --- Hi, based on what Sean suggested I

[jira] [Commented] (SPARK-1406) PMML model evaluation support via MLib

[ https://issues.apache.org/jira/browse/SPARK-1406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193830#comment-14193830 ] Apache Spark commented on SPARK-1406: - User 'selvinsource' has created a pull request

[jira] [Resolved] (SPARK-3914) InMemoryRelation should inherit statistics of its child to enable broadcast join

[ https://issues.apache.org/jira/browse/SPARK-3914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-3914. --- Resolution: Fixed InMemoryRelation should inherit statistics of its child to enable broadcast join

[jira] [Created] (SPARK-4196) Streaming + checkpointing yields NotSerializableException for Hadoop Configuration from saveAsNewAPIHadoopFiles ?

Sean Owen created SPARK-4196: Summary: Streaming + checkpointing yields NotSerializableException for Hadoop Configuration from saveAsNewAPIHadoopFiles ? Key: SPARK-4196 URL:

[jira] [Resolved] (SPARK-4166) Display the executor ID in the Web UI when ExecutorLostFailure happens

[ https://issues.apache.org/jira/browse/SPARK-4166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-4166. --- Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 3033

[jira] [Updated] (SPARK-3436) Streaming SVM

[ https://issues.apache.org/jira/browse/SPARK-3436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-3436: - Target Version/s: (was: 1.2.0) Streaming SVM -- Key:

[jira] [Updated] (SPARK-3436) Streaming SVM

[ https://issues.apache.org/jira/browse/SPARK-3436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-3436: - Affects Version/s: (was: 1.2.0) Streaming SVM -- Key:

[jira] [Updated] (SPARK-3147) Implement A/B testing

[ https://issues.apache.org/jira/browse/SPARK-3147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-3147: - Target Version/s: 1.3.0 (was: 1.2.0) Implement A/B testing -

[jira] [Updated] (SPARK-3974) Block matrix abstracitons and partitioners

[ https://issues.apache.org/jira/browse/SPARK-3974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-3974: - Target Version/s: 1.3.0 (was: 1.2.0) Block matrix abstracitons and partitioners

[jira] [Updated] (SPARK-3188) Add Robust Regression Algorithm with Tukey bisquare weight function (Biweight Estimates)

[ https://issues.apache.org/jira/browse/SPARK-3188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-3188: - Target Version/s: 1.3.0 (was: 1.2.0) Add Robust Regression Algorithm with Tukey bisquare weight

[jira] [Commented] (SPARK-3080) ArrayIndexOutOfBoundsException in ALS for Large datasets

[ https://issues.apache.org/jira/browse/SPARK-3080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14194058#comment-14194058 ] Daniel Erenrich commented on SPARK-3080: Bumping RAM and changing parallelism did

[jira] [Resolved] (SPARK-3247) Improved support for external data sources

[ https://issues.apache.org/jira/browse/SPARK-3247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3247. - Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 2475

[jira] [Resolved] (SPARK-4182) Caching tables containing boolean, binary, array, struct and/or map columns doesn't work

[ https://issues.apache.org/jira/browse/SPARK-4182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-4182. - Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 3059

[jira] [Resolved] (SPARK-4185) JSON schema inference failed when dealing with type conflicts in arrays

[ https://issues.apache.org/jira/browse/SPARK-4185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-4185. - Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 3056

[jira] [Commented] (SPARK-3572) Support register UserType in SQL

[ https://issues.apache.org/jira/browse/SPARK-3572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14194113#comment-14194113 ] Apache Spark commented on SPARK-3572: - User 'marmbrus' has created a pull request for

[jira] [Resolved] (SPARK-2189) Method for removing temp tables created by registerAsTable

[ https://issues.apache.org/jira/browse/SPARK-2189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-2189. - Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 3039

[jira] [Resolved] (SPARK-4183) Enable Netty-based BlockTransferService by default

[ https://issues.apache.org/jira/browse/SPARK-4183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-4183. Resolution: Fixed Resolved a second time via: https://github.com/apache/spark/pull/3053

[jira] [Created] (SPARK-4197) Gradient Boosting API cleanups

Joseph K. Bradley created SPARK-4197: Summary: Gradient Boosting API cleanups Key: SPARK-4197 URL: https://issues.apache.org/jira/browse/SPARK-4197 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-4198) Refactor BlockManager's doPut and doGetLocal into smaller pieces

Aaron Davidson created SPARK-4198: - Summary: Refactor BlockManager's doPut and doGetLocal into smaller pieces Key: SPARK-4198 URL: https://issues.apache.org/jira/browse/SPARK-4198 Project: Spark

[jira] [Commented] (SPARK-4198) Refactor BlockManager's doPut and doGetLocal into smaller pieces

[ https://issues.apache.org/jira/browse/SPARK-4198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14194212#comment-14194212 ] Apache Spark commented on SPARK-4198: - User 'aarondav' has created a pull request for

[jira] [Updated] (SPARK-4131) Support Writing data into the filesystem from queries

[ https://issues.apache.org/jira/browse/SPARK-4131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiaoJing wang updated SPARK-4131: - Description: Writing data into the filesystem from queries,SparkSql is not support . eg:

[jira] [Updated] (SPARK-4199) Drop table if exists raises table not found exception in HiveContext

[ https://issues.apache.org/jira/browse/SPARK-4199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jianshi Huang updated SPARK-4199: - Summary: Drop table if exists raises table not found exception in HiveContext (was: Drop table

[jira] [Created] (SPARK-4199) Drop table if exists raises table not found exception

Jianshi Huang created SPARK-4199: Summary: Drop table if exists raises table not found exception Key: SPARK-4199 URL: https://issues.apache.org/jira/browse/SPARK-4199 Project: Spark Issue

[jira] [Created] (SPARK-4200) akka.loglevel

SuYan created SPARK-4200: Summary: akka.loglevel Key: SPARK-4200 URL: https://issues.apache.org/jira/browse/SPARK-4200 Project: Spark Issue Type: Question Components: Spark Core

[jira] [Commented] (SPARK-4192) Support UDT in Python

[ https://issues.apache.org/jira/browse/SPARK-4192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14194237#comment-14194237 ] Apache Spark commented on SPARK-4192: - User 'mengxr' has created a pull request for

[jira] [Resolved] (SPARK-4200) akka.loglevel

[ https://issues.apache.org/jira/browse/SPARK-4200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-4200. Resolution: Invalid Hi There, For issues like this do you mind e-mailing the spark user

[jira] [Resolved] (SPARK-4109) Task.stageId is not been deserialized correctly

[ https://issues.apache.org/jira/browse/SPARK-4109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-4109. Resolution: Fixed Task.stageId is not been deserialized correctly

[jira] [Reopened] (SPARK-4165) Actor with Companion throws ambiguous reference error in REPL

[ https://issues.apache.org/jira/browse/SPARK-4165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma reopened SPARK-4165: Assignee: Prashant Sharma This is not a duplicate of SPARK-3200. It happens that the

[jira] [Updated] (SPARK-4165) Actor with Companion throws ambiguous reference error in REPL

[ https://issues.apache.org/jira/browse/SPARK-4165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-4165: --- Component/s: Spark Shell Actor with Companion throws ambiguous reference error in REPL

[jira] [Commented] (SPARK-4165) Actor with Companion throws ambiguous reference error in REPL

[ https://issues.apache.org/jira/browse/SPARK-4165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14194290#comment-14194290 ] Prashant Sharma commented on SPARK-4165: I think this should happen when we create

[jira] [Resolved] (SPARK-4177) update build doc for already supporting hive 13 in jdbc/cli

[ https://issues.apache.org/jira/browse/SPARK-4177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-4177. Resolution: Fixed Assignee: wangfei update build doc for already supporting hive 13

[jira] [Updated] (SPARK-4165) Actor with Companion throws ambiguous reference error in REPL

[ https://issues.apache.org/jira/browse/SPARK-4165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-4165: --- Affects Version/s: (was: 1.2.0) Actor with Companion throws ambiguous reference error in

[jira] [Updated] (SPARK-3572) Internal API for User-Defined Types

[ https://issues.apache.org/jira/browse/SPARK-3572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3572: --- Summary: Internal API for User-Defined Types (was: Support register UserType in SQL)

[jira] [Updated] (SPARK-4165) Using Companion Objects throws ambiguous reference error in REPL when an instance of Class is initialized

[ https://issues.apache.org/jira/browse/SPARK-4165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shiti Saxena updated SPARK-4165: Summary: Using Companion Objects throws ambiguous reference error in REPL when an instance of Class

[jira] [Updated] (SPARK-4165) Using Companion Objects throws ambiguous reference error in REPL when an instance of Class isinitialized

[ https://issues.apache.org/jira/browse/SPARK-4165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shiti Saxena updated SPARK-4165: Summary: Using Companion Objects throws ambiguous reference error in REPL when an instance of Class

[jira] [Updated] (SPARK-4165) Using Companion Objects throws ambiguous reference error in REPL when an instance of Class is initialized

[ https://issues.apache.org/jira/browse/SPARK-4165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shiti Saxena updated SPARK-4165: Description: Tried the following in the master branch REPL. {noformat} Spark context available as

[jira] [Updated] (SPARK-4165) Using Companion Objects throws ambiguous reference error in REPL when an instance of Class is initialized

[ https://issues.apache.org/jira/browse/SPARK-4165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shiti Saxena updated SPARK-4165: Description: Tried the following in the master branch REPL. {noformat} Spark context available as

[jira] [Commented] (SPARK-3573) Dataset

[ https://issues.apache.org/jira/browse/SPARK-3573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14194311#comment-14194311 ] Apache Spark commented on SPARK-3573: - User 'mengxr' has created a pull request for

[jira] [Commented] (SPARK-1406) PMML model evaluation support via MLib

[ https://issues.apache.org/jira/browse/SPARK-1406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14194315#comment-14194315 ] Sean Owen commented on SPARK-1406: -- I put some comments on the PR. Thanks for starting on

[jira] [Commented] (SPARK-1704) Support EXPLAIN in Spark SQL

[ https://issues.apache.org/jira/browse/SPARK-1704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14194322#comment-14194322 ] Apache Spark commented on SPARK-1704: - User 'concretevitamin' has created a pull

[jira] [Commented] (SPARK-2691) Allow Spark on Mesos to be launched with Docker

[ https://issues.apache.org/jira/browse/SPARK-2691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14194329#comment-14194329 ] Eduardo Jimenez commented on SPARK-2691: I was looking at this, and I came up with

[jira] [Created] (SPARK-4201) Can't use concat() on partition column in where condition (Hive compatibility problem)

dongxu created SPARK-4201: - Summary: Can't use concat() on partition column in where condition (Hive compatibility problem) Key: SPARK-4201 URL: https://issues.apache.org/jira/browse/SPARK-4201 Project:

[jira] [Updated] (SPARK-4201) Can't use concat() on partition column in where condition (Hive compatibility problem)

[ https://issues.apache.org/jira/browse/SPARK-4201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dongxu updated SPARK-4201: -- Description: The team used hive to query,we try to move it to spark-sql. when I search sentences like that.

[jira] [Created] (SPARK-4202) DSL support for Scala UDF

Cheng Lian created SPARK-4202: - Summary: DSL support for Scala UDF Key: SPARK-4202 URL: https://issues.apache.org/jira/browse/SPARK-4202 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-4202) DSL support for Scala UDF

[ https://issues.apache.org/jira/browse/SPARK-4202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14194341#comment-14194341 ] Apache Spark commented on SPARK-4202: - User 'liancheng' has created a pull request for