[jira] [Commented] (SPARK-5991) Python API for ML model import/export

[ https://issues.apache.org/jira/browse/SPARK-5991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14339853#comment-14339853 ] Apache Spark commented on SPARK-5991: - User 'mengxr' has created a pull request for th

[jira] [Created] (SPARK-6056) Unlimit offHeap memory use cause RM killing the container

SaintBacchus created SPARK-6056: --- Summary: Unlimit offHeap memory use cause RM killing the container Key: SPARK-6056 URL: https://issues.apache.org/jira/browse/SPARK-6056 Project: Spark Issue T

[jira] [Commented] (SPARK-6055) memory leak in pyspark sql

[ https://issues.apache.org/jira/browse/SPARK-6055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14339850#comment-14339850 ] Apache Spark commented on SPARK-6055: - User 'davies' has created a pull request for th

[jira] [Commented] (SPARK-5556) Latent Dirichlet Allocation (LDA) using Gibbs sampler

[ https://issues.apache.org/jira/browse/SPARK-5556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14339849#comment-14339849 ] Pedro Rodriguez commented on SPARK-5556: Based on initial testing, I recall FastLD

[jira] [Commented] (SPARK-5556) Latent Dirichlet Allocation (LDA) using Gibbs sampler

[ https://issues.apache.org/jira/browse/SPARK-5556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14339847#comment-14339847 ] Guoqiang Li commented on SPARK-5556: [This branch|https://github.com/witgo/spark/tree/

[jira] [Commented] (SPARK-6055) memory leak in pyspark sql

[ https://issues.apache.org/jira/browse/SPARK-6055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14339846#comment-14339846 ] Apache Spark commented on SPARK-6055: - User 'davies' has created a pull request for th

[jira] [Commented] (SPARK-6055) memory leak in pyspark sql

[ https://issues.apache.org/jira/browse/SPARK-6055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14339840#comment-14339840 ] Apache Spark commented on SPARK-6055: - User 'davies' has created a pull request for th

[jira] [Created] (SPARK-6054) SQL UDF returning object of case class; regression from 1.2.0

Spiro Michaylov created SPARK-6054: -- Summary: SQL UDF returning object of case class; regression from 1.2.0 Key: SPARK-6054 URL: https://issues.apache.org/jira/browse/SPARK-6054 Project: Spark

[jira] [Created] (SPARK-6055) memory leak in pyspark sql

Davies Liu created SPARK-6055: - Summary: memory leak in pyspark sql Key: SPARK-6055 URL: https://issues.apache.org/jira/browse/SPARK-6055 Project: Spark Issue Type: Bug Components: PySp

[jira] [Updated] (SPARK-6036) EventLog process logic has race condition with Akka actor system

[ https://issues.apache.org/jira/browse/SPARK-6036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-6036: - Labels: backport-needed (was: ) > EventLog process logic has race condition with Akka actor system >

[jira] [Updated] (SPARK-6036) EventLog process logic has race condition with Akka actor system

[ https://issues.apache.org/jira/browse/SPARK-6036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-6036: - Target Version/s: 1.4.0, 1.3.1 Fix Version/s: 1.4.0 Assignee: Zhang, Liye > EventLog pr

[jira] [Commented] (SPARK-6050) Spark on YARN does not work --executor-cores is specified

[ https://issues.apache.org/jira/browse/SPARK-6050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14339798#comment-14339798 ] Mridul Muralidharan commented on SPARK-6050: With more verbose debug added, th

[jira] [Created] (SPARK-6053) Support model save/load in Python's ALS.

Xiangrui Meng created SPARK-6053: Summary: Support model save/load in Python's ALS. Key: SPARK-6053 URL: https://issues.apache.org/jira/browse/SPARK-6053 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-5991) Python API for ML model import/export

[ https://issues.apache.org/jira/browse/SPARK-5991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-5991: - Issue Type: Umbrella (was: Sub-task) Parent: (was: SPARK-4587) > Python API for ML mo

[jira] [Updated] (SPARK-5991) Python API for ML model import/export

[ https://issues.apache.org/jira/browse/SPARK-5991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-5991: - Target Version/s: (was: 1.4.0) > Python API for ML model import/export > ---

[jira] [Commented] (SPARK-5845) Time to cleanup spilled shuffle files not included in shuffle write time

[ https://issues.apache.org/jira/browse/SPARK-5845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14339794#comment-14339794 ] Ilya Ganelin commented on SPARK-5845: - I'm code complete on this, will submit a PR sho

[jira] [Commented] (SPARK-5281) Registering table on RDD is giving MissingRequirementError

[ https://issues.apache.org/jira/browse/SPARK-5281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14339779#comment-14339779 ] Sangkyoon Nam commented on SPARK-5281: -- I have same problem. In my case, I used CDH 5

[jira] [Commented] (SPARK-5556) Latent Dirichlet Allocation (LDA) using Gibbs sampler

[ https://issues.apache.org/jira/browse/SPARK-5556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14339772#comment-14339772 ] Pedro Rodriguez commented on SPARK-5556: See PR for info, TLDR: contains refactori

[jira] [Commented] (SPARK-5556) Latent Dirichlet Allocation (LDA) using Gibbs sampler

[ https://issues.apache.org/jira/browse/SPARK-5556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14339767#comment-14339767 ] Apache Spark commented on SPARK-5556: - User 'EntilZha' has created a pull request for

[jira] [Commented] (SPARK-6052) In JSON schema inference, we should always set containsNull of an ArrayType to true

[ https://issues.apache.org/jira/browse/SPARK-6052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14339761#comment-14339761 ] Apache Spark commented on SPARK-6052: - User 'yhuai' has created a pull request for thi

[jira] [Commented] (SPARK-6051) Add an option for DirectKafkaInputDStream to commit the offsets into ZK

[ https://issues.apache.org/jira/browse/SPARK-6051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14339758#comment-14339758 ] Apache Spark commented on SPARK-6051: - User 'jerryshao' has created a pull request for

[jira] [Comment Edited] (SPARK-6050) Spark on YARN does not work --executor-cores is specified

[ https://issues.apache.org/jira/browse/SPARK-6050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14339686#comment-14339686 ] Mridul Muralidharan edited comment on SPARK-6050 at 2/27/15 5:24 AM: ---

[jira] [Created] (SPARK-6052) In JSON schema inference, we should always set containsNull of an ArrayType to true

Yin Huai created SPARK-6052: --- Summary: In JSON schema inference, we should always set containsNull of an ArrayType to true Key: SPARK-6052 URL: https://issues.apache.org/jira/browse/SPARK-6052 Project: Spar

[jira] [Created] (SPARK-6051) Add an option for DirectKafkaInputDStream to commit the offsets into ZK

Saisai Shao created SPARK-6051: -- Summary: Add an option for DirectKafkaInputDStream to commit the offsets into ZK Key: SPARK-6051 URL: https://issues.apache.org/jira/browse/SPARK-6051 Project: Spark

[jira] [Resolved] (SPARK-6024) When a data source table has too many columns, it's schema cannot be stored in metastore.

[ https://issues.apache.org/jira/browse/SPARK-6024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-6024. Resolution: Fixed Fix Version/s: 1.3.0 Assignee: Yin Huai > When a data source table

[jira] [Commented] (SPARK-5984) TimSort broken

[ https://issues.apache.org/jira/browse/SPARK-5984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14339706#comment-14339706 ] Apache Spark commented on SPARK-5984: - User 'hotou' has created a pull request for thi

[jira] [Resolved] (SPARK-3664) Graduate GraphX from alpha to stable

[ https://issues.apache.org/jira/browse/SPARK-3664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Dave resolved SPARK-3664. --- Resolution: Fixed Fix Version/s: 1.2.0 > Graduate GraphX from alpha to stable > ---

[jira] [Comment Edited] (SPARK-1015) Visualize the DAG of RDD

[ https://issues.apache.org/jira/browse/SPARK-1015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14339690#comment-14339690 ] Jeff Zhang edited comment on SPARK-1015 at 2/27/15 4:03 AM: [~

[jira] [Commented] (SPARK-1015) Visualize the DAG of RDD

[ https://issues.apache.org/jira/browse/SPARK-1015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14339690#comment-14339690 ] Jeff Zhang commented on SPARK-1015: --- [~sowen] I may not have time for this recently. bq

[jira] [Comment Edited] (SPARK-6050) Spark on YARN does not work --executor-cores is specified

[ https://issues.apache.org/jira/browse/SPARK-6050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14339686#comment-14339686 ] Mridul Muralidharan edited comment on SPARK-6050 at 2/27/15 3:50 AM: ---

[jira] [Commented] (SPARK-6050) Spark on YARN does not work --executor-cores is specified

[ https://issues.apache.org/jira/browse/SPARK-6050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14339686#comment-14339686 ] Mridul Muralidharan commented on SPARK-6050: Thanks to [~tgraves] for helping

[jira] [Commented] (SPARK-6033) the description abou the "spark.worker.cleanup.enabled" is not matched with the code

[ https://issues.apache.org/jira/browse/SPARK-6033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14339684#comment-14339684 ] pengxu commented on SPARK-6033: --- I've already made a PR. Can you help me to review it, thx

[jira] [Commented] (SPARK-6033) the description abou the "spark.worker.cleanup.enabled" is not matched with the code

[ https://issues.apache.org/jira/browse/SPARK-6033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14339683#comment-14339683 ] Apache Spark commented on SPARK-6033: - User 'hseagle' has created a pull request for t

[jira] [Created] (SPARK-6050) Spark on YARN does not work --executor-cores is specified

Mridul Muralidharan created SPARK-6050: -- Summary: Spark on YARN does not work --executor-cores is specified Key: SPARK-6050 URL: https://issues.apache.org/jira/browse/SPARK-6050 Project: Spark

[jira] [Commented] (SPARK-6033) the description abou the "spark.worker.cleanup.enabled" is not matched with the code

[ https://issues.apache.org/jira/browse/SPARK-6033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14339667#comment-14339667 ] pengxu commented on SPARK-6033: --- Ok, I'll do it. > the description abou the "spark.worker.c

[jira] [Resolved] (SPARK-6037) Avoiding duplicate Parquet schema merging

[ https://issues.apache.org/jira/browse/SPARK-6037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-6037. --- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4786 [https://github.com/

[jira] [Updated] (SPARK-6037) Avoiding duplicate Parquet schema merging

[ https://issues.apache.org/jira/browse/SPARK-6037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6037: -- Assignee: Liang-Chi Hsieh > Avoiding duplicate Parquet schema merging >

[jira] [Commented] (SPARK-5710) Combines two adjacent `Cast` expressions into one

[ https://issues.apache.org/jira/browse/SPARK-5710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14339649#comment-14339649 ] guowei commented on SPARK-5710: --- How about limit merging adjacent casts that are only added

[jira] [Closed] (SPARK-5529) BlockManager heartbeat expiration does not kill executor

[ https://issues.apache.org/jira/browse/SPARK-5529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-5529. Resolution: Fixed Fix Version/s: 1.4.0 Target Version/s: 1.4.0 > BlockManager heartbeat exp

[jira] [Comment Edited] (SPARK-6048) SparkConf.translateConfKey should translate on get, not set

[ https://issues.apache.org/jira/browse/SPARK-6048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14339629#comment-14339629 ] Patrick Wendell edited comment on SPARK-6048 at 2/27/15 2:33 AM: ---

[jira] [Commented] (SPARK-6048) SparkConf.translateConfKey should translate on get, not set

[ https://issues.apache.org/jira/browse/SPARK-6048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14339629#comment-14339629 ] Patrick Wendell commented on SPARK-6048: Hey All, No options on which design we c

[jira] [Commented] (SPARK-6048) SparkConf.translateConfKey should translate on get, not set

[ https://issues.apache.org/jira/browse/SPARK-6048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14339624#comment-14339624 ] Andrew Or commented on SPARK-6048: -- bq. What do you mean by "duplicates the translation"

[jira] [Commented] (SPARK-5979) `--packages` should not exclude spark streaming assembly jars for kafka and flume

[ https://issues.apache.org/jira/browse/SPARK-5979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14339620#comment-14339620 ] Apache Spark commented on SPARK-5979: - User 'brkyvz' has created a pull request for th

[jira] [Commented] (SPARK-6032) Move ivy logging to System.err in --packages

[ https://issues.apache.org/jira/browse/SPARK-6032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14339621#comment-14339621 ] Apache Spark commented on SPARK-6032: - User 'brkyvz' has created a pull request for th

[jira] [Created] (SPARK-6049) HiveThriftServer2 may expose Inheritable methods

Littlestar created SPARK-6049: - Summary: HiveThriftServer2 may expose Inheritable methods Key: SPARK-6049 URL: https://issues.apache.org/jira/browse/SPARK-6049 Project: Spark Issue Type: Improvem

[jira] [Commented] (SPARK-5537) Expand user guide for multinomial logistic regression

[ https://issues.apache.org/jira/browse/SPARK-5537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14339602#comment-14339602 ] Apache Spark commented on SPARK-5537: - User 'dbtsai' has created a pull request for th

[jira] [Commented] (SPARK-6048) SparkConf.translateConfKey should translate on get, not set

[ https://issues.apache.org/jira/browse/SPARK-6048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14339591#comment-14339591 ] Marcelo Vanzin commented on SPARK-6048: --- What do you mean by "duplicates the transla

[jira] [Commented] (SPARK-5771) Number of Cores in Completed Applications of Standalone Master Web Page always be 0 if sc.stop() is called

[ https://issues.apache.org/jira/browse/SPARK-5771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14339590#comment-14339590 ] Apache Spark commented on SPARK-5771: - User 'jerryshao' has created a pull request for

[jira] [Assigned] (SPARK-4897) Python 3 support

[ https://issues.apache.org/jira/browse/SPARK-4897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reassigned SPARK-4897: - Assignee: Davies Liu > Python 3 support > > > Key: SPARK-4897 >

[jira] [Commented] (SPARK-5950) Insert array into a metastore table saved as parquet should work when using datasource api

[ https://issues.apache.org/jira/browse/SPARK-5950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14339557#comment-14339557 ] Liang-Chi Hsieh commented on SPARK-5950: Let me explain on github pull. > Insert

[jira] [Closed] (SPARK-4579) Scheduling Delay appears negative

[ https://issues.apache.org/jira/browse/SPARK-4579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-4579. Resolution: Fixed Fix Version/s: 1.2.2 1.3.0 Assignee: Sean Ow

[jira] [Commented] (SPARK-6048) SparkConf.translateConfKey should translate on get, not set

[ https://issues.apache.org/jira/browse/SPARK-6048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14339544#comment-14339544 ] Andrew Or commented on SPARK-6048: -- [~vanzin] Note that (3) is orthogonal to this change

[jira] [Commented] (SPARK-5950) Insert array into a metastore table saved as parquet should work when using datasource api

[ https://issues.apache.org/jira/browse/SPARK-5950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14339542#comment-14339542 ] Yin Huai commented on SPARK-5950: - If it is just the part of the problem, mind explain wha

[jira] [Commented] (SPARK-5950) Insert array into a metastore table saved as parquet should work when using datasource api

[ https://issues.apache.org/jira/browse/SPARK-5950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14339534#comment-14339534 ] Liang-Chi Hsieh commented on SPARK-5950: Yes. This is just the part of the problem

[jira] [Updated] (SPARK-5508) Arrays and Maps stored with Hive Parquet Serde may not be able to read by the Parquet support in the Data Souce API

[ https://issues.apache.org/jira/browse/SPARK-5508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-5508: Summary: Arrays and Maps stored with Hive Parquet Serde may not be able to read by the Parquet support in th

[jira] [Updated] (SPARK-5950) Insert array into a metastore table saved as parquet should work when using datasource api

[ https://issues.apache.org/jira/browse/SPARK-5950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-5950: Priority: Blocker (was: Major) > Insert array into a metastore table saved as parquet should work when usin

[jira] [Updated] (SPARK-5508) [hive context] java.lang.IndexOutOfBoundsException: Index: 0, Size: 0

[ https://issues.apache.org/jira/browse/SPARK-5508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-5508: Target Version/s: 1.3.0 > [hive context] java.lang.IndexOutOfBoundsException: Index: 0, Size: 0 > --

[jira] [Commented] (SPARK-5950) Insert array into a metastore table saved as parquet should work when using datasource api

[ https://issues.apache.org/jira/browse/SPARK-5950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14339530#comment-14339530 ] Yin Huai commented on SPARK-5950: - OK. Now, I understand what's going on. For this JIRA,

[jira] [Reopened] (SPARK-5508) [hive context] java.lang.IndexOutOfBoundsException: Index: 0, Size: 0

[ https://issues.apache.org/jira/browse/SPARK-5508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai reopened SPARK-5508: - I am reopening it since it is different from SPARK-5950. > [hive context] java.lang.IndexOutOfBoundsException

[jira] [Updated] (SPARK-5950) Insert array into a metastore table saved as parquet should work when using datasource api

[ https://issues.apache.org/jira/browse/SPARK-5950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-5950: Summary: Insert array into a metastore table saved as parquet should work when using datasource api (was: I

[jira] [Updated] (SPARK-5950) Insert array into a metastore table should work when using datasource api

[ https://issues.apache.org/jira/browse/SPARK-5950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-5950: Summary: Insert array into a metastore table should work when using datasource api (was: Insert array into

[jira] [Updated] (SPARK-6048) SparkConf.translateConfKey should translate on get, not set

[ https://issues.apache.org/jira/browse/SPARK-6048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-6048: - Priority: Blocker (was: Critical) > SparkConf.translateConfKey should translate on get, not set > ---

[jira] [Updated] (SPARK-5950) Insert array into a metastore table saved as parquet should work when using datasource api

[ https://issues.apache.org/jira/browse/SPARK-5950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-5950: Summary: Insert array into a metastore table saved as parquet should work when using datasource api (was: I

[jira] [Updated] (SPARK-5950) Insert array into table saved as parquet should work when using datasource api

[ https://issues.apache.org/jira/browse/SPARK-5950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-5950: Summary: Insert array into table saved as parquet should work when using datasource api (was: Arrays and Ma

[jira] [Commented] (SPARK-6048) SparkConf.translateConfKey should translate on get, not set

[ https://issues.apache.org/jira/browse/SPARK-6048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14339519#comment-14339519 ] Marcelo Vanzin commented on SPARK-6048: --- I sort of agree with (1). But I think it's

[jira] [Updated] (SPARK-6048) SparkConf.translateConfKey should translate on get, not set

[ https://issues.apache.org/jira/browse/SPARK-6048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-6048: - Description: There are several issues with translating on set. (1) The most serious one is that if the us

[jira] [Commented] (SPARK-6048) SparkConf.translateConfKey should translate on get, not set

[ https://issues.apache.org/jira/browse/SPARK-6048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14339498#comment-14339498 ] Apache Spark commented on SPARK-6048: - User 'andrewor14' has created a pull request fo

[jira] [Updated] (SPARK-6048) SparkConf.translateConfKey should translate on get, not set

[ https://issues.apache.org/jira/browse/SPARK-6048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-6048: - Description: There are several issues with translating on set. (1) The most serious one is that if the us

[jira] [Created] (SPARK-6048) SparkConf.translateConfKey should translate on get, not set

Andrew Or created SPARK-6048: Summary: SparkConf.translateConfKey should translate on get, not set Key: SPARK-6048 URL: https://issues.apache.org/jira/browse/SPARK-6048 Project: Spark Issue Type

[jira] [Commented] (SPARK-5775) GenericRow cannot be cast to SpecificMutableRow when nested data and partitioned table

[ https://issues.apache.org/jira/browse/SPARK-5775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14339457#comment-14339457 ] Apache Spark commented on SPARK-5775: - User 'yhuai' has created a pull request for thi

[jira] [Commented] (SPARK-6047) pyspark - class loading on driver failing with --jars and --packages

[ https://issues.apache.org/jira/browse/SPARK-6047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14339453#comment-14339453 ] Apache Spark commented on SPARK-6047: - User 'brkyvz' has created a pull request for th

[jira] [Updated] (SPARK-6047) pyspark - class loading on driver failing with --jars and --packages

[ https://issues.apache.org/jira/browse/SPARK-6047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Yavuz updated SPARK-6047: --- Description: Because py4j uses the system ClassLoader instead of the contextClassLoader of the thread

[jira] [Created] (SPARK-6047) pyspark - class loading on driver failing with --jars and --packages

Burak Yavuz created SPARK-6047: -- Summary: pyspark - class loading on driver failing with --jars and --packages Key: SPARK-6047 URL: https://issues.apache.org/jira/browse/SPARK-6047 Project: Spark

[jira] [Closed] (SPARK-5942) DataFrame should not do query optimization when dataFrameEagerAnalysis is off

[ https://issues.apache.org/jira/browse/SPARK-5942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang-Chi Hsieh closed SPARK-5942. -- Resolution: Won't Fix > DataFrame should not do query optimization when dataFrameEagerAnalysis i

[jira] [Updated] (SPARK-2989) Error sending message to BlockManagerMaster

[ https://issues.apache.org/jira/browse/SPARK-2989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-2989: - Component/s: (was: Deploy) Priority: Major (was: Critical) I'm not sure if there's enough info

[jira] [Resolved] (SPARK-5066) Can not get all key that has same hashcode when reading key ordered from different Streaming.

[ https://issues.apache.org/jira/browse/SPARK-5066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5066. -- Resolution: Not a Problem > Can not get all key that has same hashcode when reading key ordered from

[jira] [Updated] (SPARK-2356) Exception: Could not locate executable null\bin\winutils.exe in the Hadoop

[ https://issues.apache.org/jira/browse/SPARK-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-2356: - Component/s: (was: Spark Core) Windows > Exception: Could not locate executable null\

[jira] [Updated] (SPARK-2348) In Windows having a enviorinment variable named 'classpath' gives error

[ https://issues.apache.org/jira/browse/SPARK-2348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-2348: - Component/s: (was: Spark Core) Windows Priority: Major (was: Critical) I thin

[jira] [Commented] (SPARK-6046) Provide an easier way for developers to handle deprecated configs

[ https://issues.apache.org/jira/browse/SPARK-6046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14339420#comment-14339420 ] Apache Spark commented on SPARK-6046: - User 'andrewor14' has created a pull request fo

[jira] [Updated] (SPARK-6043) Error when trying to rename table with alter table after using INSERT OVERWITE to populate the table

[ https://issues.apache.org/jira/browse/SPARK-6043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6043: - Component/s: SQL > Error when trying to rename table with alter table after using INSERT > OVERWITE to po

[jira] [Updated] (SPARK-6046) Provide an easier way for developers to handle deprecated configs

[ https://issues.apache.org/jira/browse/SPARK-6046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-6046: - Priority: Minor (was: Major) > Provide an easier way for developers to handle deprecated configs > --

[jira] [Commented] (SPARK-4579) Scheduling Delay appears negative

[ https://issues.apache.org/jira/browse/SPARK-4579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14339412#comment-14339412 ] Apache Spark commented on SPARK-4579: - User 'srowen' has created a pull request for th

[jira] [Updated] (SPARK-4579) Scheduling Delay appears negative

[ https://issues.apache.org/jira/browse/SPARK-4579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-4579: - Priority: Major (was: Critical) > Scheduling Delay appears negative > - >

[jira] [Resolved] (SPARK-4571) History server shows negative time

[ https://issues.apache.org/jira/browse/SPARK-4571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-4571. -- Resolution: Fixed Fix Version/s: 1.3.0 Assignee: Masayoshi TSUZUKI I'm quite sure this w

[jira] [Updated] (SPARK-6045) RecordWriter should be checked against null in PairRDDFunctions#saveAsNewAPIHadoopDataset

[ https://issues.apache.org/jira/browse/SPARK-6045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6045: - Component/s: Input/Output Assignee: Ted Yu > RecordWriter should be checked against null in > Pair

[jira] [Resolved] (SPARK-6045) RecordWriter should be checked against null in PairRDDFunctions#saveAsNewAPIHadoopDataset

[ https://issues.apache.org/jira/browse/SPARK-6045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6045. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 4794 [https://github.com/ap

[jira] [Commented] (SPARK-5977) PySpark SPARK_CLASSPATH doesn't distribute jars to executors

[ https://issues.apache.org/jira/browse/SPARK-5977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14339344#comment-14339344 ] Michael Nazario commented on SPARK-5977: I tried setting spark.executor.extraClass

[jira] [Commented] (SPARK-1673) GLMNET implementation in Spark

[ https://issues.apache.org/jira/browse/SPARK-1673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14339331#comment-14339331 ] Joseph K. Bradley commented on SPARK-1673: -- That sounds good---I'll look forward

[jira] [Commented] (SPARK-1673) GLMNET implementation in Spark

[ https://issues.apache.org/jira/browse/SPARK-1673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14339320#comment-14339320 ] mike bowles commented on SPARK-1673: Good discussion. I can see how it might be faste

[jira] [Closed] (SPARK-5951) Remove unreachable driver memory properties in yarn client mode (YarnClientSchedulerBackend)

[ https://issues.apache.org/jira/browse/SPARK-5951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-5951. Resolution: Fixed Target Version/s: 1.3.0 > Remove unreachable driver memory properties in yarn cl

[jira] [Updated] (SPARK-5951) Remove unreachable driver memory properties in yarn client mode (YarnClientSchedulerBackend)

[ https://issues.apache.org/jira/browse/SPARK-5951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5951: - Assignee: Shekhar Bansal > Remove unreachable driver memory properties in yarn client mode > (YarnClientS

[jira] [Updated] (SPARK-4300) Race condition during SparkWorker shutdown

[ https://issues.apache.org/jira/browse/SPARK-4300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4300: - Labels: backport-needed (was: ) > Race condition during SparkWorker shutdown > --

[jira] [Updated] (SPARK-794) Remove sleep() in ClusterScheduler.stop

[ https://issues.apache.org/jira/browse/SPARK-794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-794: Target Version/s: (was: 1.2.1) Fix Version/s: 1.2.2 Assignee: Brennon York

[jira] [Resolved] (SPARK-794) Remove sleep() in ClusterScheduler.stop

[ https://issues.apache.org/jira/browse/SPARK-794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-794. - Resolution: Fixed > Remove sleep() in ClusterScheduler.stop > --- > >

[jira] [Closed] (SPARK-4300) Race condition during SparkWorker shutdown

[ https://issues.apache.org/jira/browse/SPARK-4300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-4300. Resolution: Fixed Fix Version/s: 1.4.0 1.2.2 Assignee: Sean Ow

[jira] [Reopened] (SPARK-4300) Race condition during SparkWorker shutdown

[ https://issues.apache.org/jira/browse/SPARK-4300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reopened SPARK-4300: -- > Race condition during SparkWorker shutdown > -- > >

[jira] [Updated] (SPARK-5546) Improve path to Kafka assembly when trying Kafka Python API

[ https://issues.apache.org/jira/browse/SPARK-5546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5546: - Affects Version/s: 1.3.0 > Improve path to Kafka assembly when trying Kafka Python API > -

[jira] [Updated] (SPARK-6018) NoSuchMethodError in Spark app is swallowed by YARN AM

[ https://issues.apache.org/jira/browse/SPARK-6018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-6018: - Assignee: Cheolsoo Park > NoSuchMethodError in Spark app is swallowed by YARN AM > ---

[jira] [Updated] (SPARK-6018) NoSuchMethodError in Spark app is swallowed by YARN AM

[ https://issues.apache.org/jira/browse/SPARK-6018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-6018: - Affects Version/s: 1.2.0 > NoSuchMethodError in Spark app is swallowed by YARN AM > --

[jira] [Closed] (SPARK-6018) NoSuchMethodError in Spark app is swallowed by YARN AM

[ https://issues.apache.org/jira/browse/SPARK-6018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-6018. Resolution: Fixed Fix Version/s: 1.2.2 1.3.0 Target Version/s: 1.3.0,

  1   2   3   >