[jira] [Resolved] (SPARK-7784) Check 1.3-> 1.4 SQL API compliance using java-compliance-checker

2015-05-21 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-7784. Resolution: Fixed Fix Version/s: 1.4.0 I went through them quickly. Everything looks fine.

[jira] [Created] (SPARK-7785) Add missing items to pyspark.mllib.linalg.Matrices

2015-05-21 Thread Manoj Kumar (JIRA)
Manoj Kumar created SPARK-7785: -- Summary: Add missing items to pyspark.mllib.linalg.Matrices Key: SPARK-7785 URL: https://issues.apache.org/jira/browse/SPARK-7785 Project: Spark Issue Type: Sub-

[jira] [Commented] (SPARK-7785) Add missing items to pyspark.mllib.linalg.Matrices

2015-05-21 Thread Manoj Kumar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14553769#comment-14553769 ] Manoj Kumar commented on SPARK-7785: ping [~josephkb] > Add missing items to pyspark.

[jira] [Assigned] (SPARK-7394) Add Pandas style cast (astype)

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7394: --- Assignee: Apache Spark > Add Pandas style cast (astype) > -- > >

[jira] [Assigned] (SPARK-7394) Add Pandas style cast (astype)

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7394: --- Assignee: (was: Apache Spark) > Add Pandas style cast (astype) >

[jira] [Commented] (SPARK-7394) Add Pandas style cast (astype)

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14553772#comment-14553772 ] Apache Spark commented on SPARK-7394: - User 'kaka1992' has created a pull request for

[jira] [Assigned] (SPARK-6013) Add more Python ML examples for spark.ml

2015-05-21 Thread Ram Sriharsha (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ram Sriharsha reassigned SPARK-6013: Assignee: Ram Sriharsha > Add more Python ML examples for spark.ml > --

[jira] [Assigned] (SPARK-7404) Add RegressionEvaluator to spark.ml

2015-05-21 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng reassigned SPARK-7404: Assignee: Xiangrui Meng > Add RegressionEvaluator to spark.ml > ---

[jira] [Resolved] (SPARK-7745) Replace assertions with requires (IllegalArgumentException) and modify other state checks

2015-05-21 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-7745. -- Resolution: Fixed Fix Version/s: 1.4.0 > Replace assertions with requires (IllegalArgumen

[jira] [Updated] (SPARK-7745) Replace assertions with requires (IllegalArgumentException) and modify other state checks

2015-05-21 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-7745: - Assignee: Burak Yavuz > Replace assertions with requires (IllegalArgumentException) and modify oth

[jira] [Assigned] (SPARK-7758) Failed to start thrift server when metastore is postgre sql

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7758: --- Assignee: Apache Spark > Failed to start thrift server when metastore is postgre sql > --

[jira] [Commented] (SPARK-7758) Failed to start thrift server when metastore is postgre sql

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14553791#comment-14553791 ] Apache Spark commented on SPARK-7758: - User 'WangTaoTheTonic' has created a pull reque

[jira] [Assigned] (SPARK-7758) Failed to start thrift server when metastore is postgre sql

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7758: --- Assignee: (was: Apache Spark) > Failed to start thrift server when metastore is postgre s

[jira] [Created] (SPARK-7786) Allow StreamingListener to be specified in SparkConf and loaded when creating StreamingContext

2015-05-21 Thread yangping wu (JIRA)
yangping wu created SPARK-7786: -- Summary: Allow StreamingListener to be specified in SparkConf and loaded when creating StreamingContext Key: SPARK-7786 URL: https://issues.apache.org/jira/browse/SPARK-7786

[jira] [Updated] (SPARK-7786) Allow StreamingListener to be specified in SparkConf and loaded when creating StreamingContext

2015-05-21 Thread yangping wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yangping wu updated SPARK-7786: --- Priority: Minor (was: Major) > Allow StreamingListener to be specified in SparkConf and loaded when c

[jira] [Assigned] (SPARK-7604) Python API for PCA and PCAModel

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7604: --- Assignee: (was: Apache Spark) > Python API for PCA and PCAModel > ---

[jira] [Commented] (SPARK-7604) Python API for PCA and PCAModel

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14553821#comment-14553821 ] Apache Spark commented on SPARK-7604: - User 'yanboliang' has created a pull request fo

[jira] [Assigned] (SPARK-7604) Python API for PCA and PCAModel

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7604: --- Assignee: Apache Spark > Python API for PCA and PCAModel > --- >

[jira] [Created] (SPARK-7787) SerializableAWSCredentials in KinesisReceiver cannot be deserialized

2015-05-21 Thread Tathagata Das (JIRA)
Tathagata Das created SPARK-7787: Summary: SerializableAWSCredentials in KinesisReceiver cannot be deserialized Key: SPARK-7787 URL: https://issues.apache.org/jira/browse/SPARK-7787 Project: Spark

[jira] [Assigned] (SPARK-7787) SerializableAWSCredentials in KinesisReceiver cannot be deserialized

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7787: --- Assignee: Apache Spark (was: Tathagata Das) > SerializableAWSCredentials in KinesisReceiver

[jira] [Commented] (SPARK-7787) SerializableAWSCredentials in KinesisReceiver cannot be deserialized

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14553841#comment-14553841 ] Apache Spark commented on SPARK-7787: - User 'tdas' has created a pull request for this

[jira] [Assigned] (SPARK-7787) SerializableAWSCredentials in KinesisReceiver cannot be deserialized

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7787: --- Assignee: Tathagata Das (was: Apache Spark) > SerializableAWSCredentials in KinesisReceiver

[jira] [Commented] (SPARK-7754) Use PartialFunction literals instead of objects in Catalyst

2015-05-21 Thread Edoardo Vacchi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14553849#comment-14553849 ] Edoardo Vacchi commented on SPARK-7754: --- That's a fair observation; on the other han

[jira] [Comment Edited] (SPARK-7754) Use PartialFunction literals instead of objects in Catalyst

2015-05-21 Thread Edoardo Vacchi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14553849#comment-14553849 ] Edoardo Vacchi edited comment on SPARK-7754 at 5/21/15 8:15 AM:

[jira] [Updated] (SPARK-7322) Add DataFrame DSL for window function support

2015-05-21 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7322: --- Description: Here's a proposal for supporting window functions in the DataFrame DSL: 1. Add an over f

[jira] [Commented] (SPARK-7322) Add DataFrame DSL for window function support

2015-05-21 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14553857#comment-14553857 ] Reynold Xin commented on SPARK-7322: [~chenghao] I updated the API design. Can you imp

[jira] [Commented] (SPARK-7322) Add DataFrame DSL for window function support

2015-05-21 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14553865#comment-14553865 ] Reynold Xin commented on SPARK-7322: Also please make sure you add a unit test to Java

[jira] [Comment Edited] (SPARK-7754) Use PartialFunction literals instead of objects in Catalyst

2015-05-21 Thread Edoardo Vacchi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14553849#comment-14553849 ] Edoardo Vacchi edited comment on SPARK-7754 at 5/21/15 8:24 AM:

[jira] [Created] (SPARK-7788) Streaming | Kinesis | KinesisReceiver blocks in onStart

2015-05-21 Thread Aniket Bhatnagar (JIRA)
Aniket Bhatnagar created SPARK-7788: --- Summary: Streaming | Kinesis | KinesisReceiver blocks in onStart Key: SPARK-7788 URL: https://issues.apache.org/jira/browse/SPARK-7788 Project: Spark I

[jira] [Commented] (SPARK-7765) Input vector should divide with the norm in Word2Vec's findSynonyms

2015-05-21 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14553889#comment-14553889 ] Liang-Chi Hsieh commented on SPARK-7765: I will try to close some obsolete PRs. So

[jira] [Assigned] (SPARK-7788) Streaming | Kinesis | KinesisReceiver blocks in onStart

2015-05-21 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das reassigned SPARK-7788: Assignee: Tathagata Das > Streaming | Kinesis | KinesisReceiver blocks in onStart > ---

[jira] [Assigned] (SPARK-7717) Spark Standalone Web UI showing incorrect total memory, workers and cores

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7717: --- Assignee: Apache Spark > Spark Standalone Web UI showing incorrect total memory, workers and

[jira] [Commented] (SPARK-7717) Spark Standalone Web UI showing incorrect total memory, workers and cores

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14553890#comment-14553890 ] Apache Spark commented on SPARK-7717: - User 'zhichao-li' has created a pull request fo

[jira] [Assigned] (SPARK-7717) Spark Standalone Web UI showing incorrect total memory, workers and cores

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7717: --- Assignee: (was: Apache Spark) > Spark Standalone Web UI showing incorrect total memory, w

[jira] [Updated] (SPARK-7788) Streaming | Kinesis | KinesisReceiver blocks in onStart

2015-05-21 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-7788: - Target Version/s: 1.4.0 > Streaming | Kinesis | KinesisReceiver blocks in onStart > --

[jira] [Updated] (SPARK-7788) Streaming | Kinesis | KinesisReceiver blocks in onStart

2015-05-21 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-7788: - Priority: Blocker (was: Major) > Streaming | Kinesis | KinesisReceiver blocks in onStart > --

[jira] [Commented] (SPARK-7788) Streaming | Kinesis | KinesisReceiver blocks in onStart

2015-05-21 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14553893#comment-14553893 ] Tathagata Das commented on SPARK-7788: -- This may be a good catch. I will try to look

[jira] [Created] (SPARK-7789) sql on security hbase:Token generation only allowed for Kerberos authenticated clients

2015-05-21 Thread meiyoula (JIRA)
meiyoula created SPARK-7789: --- Summary: sql on security hbase:Token generation only allowed for Kerberos authenticated clients Key: SPARK-7789 URL: https://issues.apache.org/jira/browse/SPARK-7789 Project:

[jira] [Updated] (SPARK-7789) sql on security hbase:Token generation only allowed for Kerberos authenticated clients

2015-05-21 Thread meiyoula (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] meiyoula updated SPARK-7789: Description: After creating a hbase table in beeline, then execute select sql statement, Executor occurs th

[jira] [Updated] (SPARK-7789) sql on security hbase:Token generation only allowed for Kerberos authenticated clients

2015-05-21 Thread meiyoula (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] meiyoula updated SPARK-7789: Description: After creating a hbase table in beeline, then execute select sql statement, Executor occurs th

[jira] [Commented] (SPARK-7789) sql on security hbase:Token generation only allowed for Kerberos authenticated clients

2015-05-21 Thread meiyoula (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14553958#comment-14553958 ] meiyoula commented on SPARK-7789: - I use the hive source of https://github.com/pwendell/hi

[jira] [Commented] (SPARK-7600) Stopping Streaming Context (sometimes) crashes master

2015-05-21 Thread Marius Soutier (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14553999#comment-14553999 ] Marius Soutier commented on SPARK-7600: --- Yes it is, that might be the problem indeed

[jira] [Comment Edited] (SPARK-7600) Stopping Streaming Context (sometimes) crashes master

2015-05-21 Thread Marius Soutier (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14553999#comment-14553999 ] Marius Soutier edited comment on SPARK-7600 at 5/21/15 9:52 AM:

[jira] [Created] (SPARK-7790) when use dynamic partitions, the partition string can be wrong without looking at the type

2015-05-21 Thread Adrian Wang (JIRA)
Adrian Wang created SPARK-7790: -- Summary: when use dynamic partitions, the partition string can be wrong without looking at the type Key: SPARK-7790 URL: https://issues.apache.org/jira/browse/SPARK-7790

[jira] [Assigned] (SPARK-7790) when use dynamic partitions, the partition string can be wrong without looking at the type

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7790: --- Assignee: (was: Apache Spark) > when use dynamic partitions, the partition string can be

[jira] [Commented] (SPARK-7790) when use dynamic partitions, the partition string can be wrong without looking at the type

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14554021#comment-14554021 ] Apache Spark commented on SPARK-7790: - User 'adrian-wang' has created a pull request f

[jira] [Assigned] (SPARK-7790) when use dynamic partitions, the partition string can be wrong without looking at the type

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7790: --- Assignee: Apache Spark > when use dynamic partitions, the partition string can be wrong witho

[jira] [Updated] (SPARK-7754) Use PartialFunction literals instead of objects in Catalyst

2015-05-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-7754: - Component/s: SQL > Use PartialFunction literals instead of objects in Catalyst > -

[jira] [Updated] (SPARK-7616) Column order can be corrupted when saving DataFrame as a partitioned table

2015-05-21 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-7616: -- Summary: Column order can be corrupted when saving DataFrame as a partitioned table (was: Overwriting a

[jira] [Updated] (SPARK-7616) Column order can be corrupted when saving DataFrame as a partitioned table

2015-05-21 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-7616: -- Description: When saved as a partitioned table, partition columns of a DataFrame are appended after dat

[jira] [Commented] (SPARK-7727) Avoid inner classes in RuleExecutor

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14554311#comment-14554311 ] Apache Spark commented on SPARK-7727: - User 'His-name-is-Joof' has created a pull requ

[jira] [Assigned] (SPARK-7727) Avoid inner classes in RuleExecutor

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7727: --- Assignee: Apache Spark > Avoid inner classes in RuleExecutor > --

[jira] [Assigned] (SPARK-7727) Avoid inner classes in RuleExecutor

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7727: --- Assignee: (was: Apache Spark) > Avoid inner classes in RuleExecutor > ---

[jira] [Updated] (SPARK-7754) [SQL] Use PartialFunction literals instead of objects in Catalyst

2015-05-21 Thread Edoardo Vacchi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edoardo Vacchi updated SPARK-7754: -- Summary: [SQL] Use PartialFunction literals instead of objects in Catalyst (was: Use PartialFun

[jira] [Updated] (SPARK-7754) Use PartialFunction literals instead of objects in Catalyst

2015-05-21 Thread Edoardo Vacchi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edoardo Vacchi updated SPARK-7754: -- Priority: Minor (was: Major) > Use PartialFunction literals instead of objects in Catalyst > --

[jira] [Created] (SPARK-7791) Set user for executors in standalone-mode

2015-05-21 Thread JIRA
Tomasz Früboes created SPARK-7791: - Summary: Set user for executors in standalone-mode Key: SPARK-7791 URL: https://issues.apache.org/jira/browse/SPARK-7791 Project: Spark Issue Type: New Fea

[jira] [Commented] (SPARK-7507) pyspark.sql.types.StructType and Row should implement __iter__()

2015-05-21 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14554550#comment-14554550 ] Nicholas Chammas commented on SPARK-7507: - Related: A Stack Overflow question abou

[jira] [Created] (SPARK-7792) HiveContext registerTempTable not thread safe

2015-05-21 Thread Yana Kadiyska (JIRA)
Yana Kadiyska created SPARK-7792: Summary: HiveContext registerTempTable not thread safe Key: SPARK-7792 URL: https://issues.apache.org/jira/browse/SPARK-7792 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-7792) HiveContext registerTempTable not thread safe

2015-05-21 Thread Yana Kadiyska (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yana Kadiyska updated SPARK-7792: - Description: {code:java} public class ThreadRepro { public static void main(String[] args) thr

[jira] [Commented] (SPARK-6189) Pandas to DataFrame conversion should check field names for periods

2015-05-21 Thread natalya (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14554609#comment-14554609 ] natalya commented on SPARK-6189: Figuring out what is wrong is not the difficulty. The cu

[jira] [Assigned] (SPARK-7616) Column order can be corrupted when saving DataFrame as a partitioned table

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7616: --- Assignee: Apache Spark (was: Cheng Lian) > Column order can be corrupted when saving DataFra

[jira] [Commented] (SPARK-7616) Column order can be corrupted when saving DataFrame as a partitioned table

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14554622#comment-14554622 ] Apache Spark commented on SPARK-7616: - User 'liancheng' has created a pull request for

[jira] [Assigned] (SPARK-7616) Column order can be corrupted when saving DataFrame as a partitioned table

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7616: --- Assignee: Cheng Lian (was: Apache Spark) > Column order can be corrupted when saving DataFra

[jira] [Commented] (SPARK-7535) Audit Pipeline APIs for 1.4

2015-05-21 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14554629#comment-14554629 ] Xiangrui Meng commented on SPARK-7535: -- Some notes: 1. Estimator/Transformer/ doesn’

[jira] [Commented] (SPARK-7712) Native Spark Window Functions & Performance Improvements

2015-05-21 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14554642#comment-14554642 ] Yin Huai commented on SPARK-7712: - It will be great if you can explain your design in more

[jira] [Comment Edited] (SPARK-7535) Audit Pipeline APIs for 1.4

2015-05-21 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14554629#comment-14554629 ] Xiangrui Meng edited comment on SPARK-7535 at 5/21/15 4:56 PM: -

[jira] [Updated] (SPARK-7498) Params.setDefault should keep varargs annotation

2015-05-21 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-7498: - Summary: Params.setDefault should keep varargs annotation (was: Params.setDefault should not use

[jira] [Commented] (SPARK-7498) Params.setDefault should not use varargs annotation

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14554655#comment-14554655 ] Apache Spark commented on SPARK-7498: - User 'mengxr' has created a pull request for th

[jira] [Resolved] (SPARK-7565) Broken maps in jsonRDD

2015-05-21 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-7565. - Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 6299 [https://github.com/apac

[jira] [Commented] (SPARK-7498) Params.setDefault should keep varargs annotation

2015-05-21 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14554657#comment-14554657 ] Xiangrui Meng commented on SPARK-7498: -- I renamed to JIRA title to `keep varargs`.

[jira] [Created] (SPARK-7793) Use getOrElse for getting the threshold of SVM model

2015-05-21 Thread Shuo Xiang (JIRA)
Shuo Xiang created SPARK-7793: - Summary: Use getOrElse for getting the threshold of SVM model Key: SPARK-7793 URL: https://issues.apache.org/jira/browse/SPARK-7793 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-7793) Use getOrElse for getting the threshold of SVM model

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7793: --- Assignee: (was: Apache Spark) > Use getOrElse for getting the threshold of SVM model > --

[jira] [Commented] (SPARK-7793) Use getOrElse for getting the threshold of SVM model

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14554665#comment-14554665 ] Apache Spark commented on SPARK-7793: - User 'coderxiang' has created a pull request fo

[jira] [Assigned] (SPARK-7793) Use getOrElse for getting the threshold of SVM model

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7793: --- Assignee: Apache Spark > Use getOrElse for getting the threshold of SVM model > -

[jira] [Commented] (SPARK-7322) Add DataFrame DSL for window function support

2015-05-21 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14554681#comment-14554681 ] Cheng Hao commented on SPARK-7322: -- I've updated the code, but are we going to support ca

[jira] [Commented] (SPARK-7535) Audit Pipeline APIs for 1.4

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14554687#comment-14554687 ] Apache Spark commented on SPARK-7535: - User 'mengxr' has created a pull request for th

[jira] [Updated] (SPARK-7404) Add RegressionEvaluator to spark.ml

2015-05-21 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-7404: - Assignee: (was: Xiangrui Meng) > Add RegressionEvaluator to spark.ml > ---

[jira] [Comment Edited] (SPARK-7535) Audit Pipeline APIs for 1.4

2015-05-21 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14554629#comment-14554629 ] Xiangrui Meng edited comment on SPARK-7535 at 5/21/15 5:23 PM: -

[jira] [Created] (SPARK-7794) Update RegexTokenizer default settings.

2015-05-21 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-7794: Summary: Update RegexTokenizer default settings. Key: SPARK-7794 URL: https://issues.apache.org/jira/browse/SPARK-7794 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-7752) NaiveBayes.modelType should use lowercase letters

2015-05-21 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-7752. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 6277 [https

[jira] [Created] (SPARK-7795) Speed up task serialization in standalone mode

2015-05-21 Thread Akshat Aranya (JIRA)
Akshat Aranya created SPARK-7795: Summary: Speed up task serialization in standalone mode Key: SPARK-7795 URL: https://issues.apache.org/jira/browse/SPARK-7795 Project: Spark Issue Type: Impr

[jira] [Commented] (SPARK-7795) Speed up task serialization in standalone mode

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14554721#comment-14554721 ] Apache Spark commented on SPARK-7795: - User 'coolfrood' has created a pull request for

[jira] [Assigned] (SPARK-7795) Speed up task serialization in standalone mode

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7795: --- Assignee: (was: Apache Spark) > Speed up task serialization in standalone mode >

[jira] [Updated] (SPARK-7780) The intercept in LogisticRegressionWithLBFGS should not be regularized

2015-05-21 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-7780: - Target Version/s: 1.5.0 > The intercept in LogisticRegressionWithLBFGS should not be regul

[jira] [Assigned] (SPARK-7795) Speed up task serialization in standalone mode

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7795: --- Assignee: Apache Spark > Speed up task serialization in standalone mode > ---

[jira] [Updated] (SPARK-7781) GradientBoostedTrees.trainRegressor is missing maxBins parameter in pyspark

2015-05-21 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-7781: - Target Version/s: 1.5.0 > GradientBoostedTrees.trainRegressor is missing maxBins parameter

[jira] [Created] (SPARK-7796) Use the new RPC implementation by default

2015-05-21 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-7796: --- Summary: Use the new RPC implementation by default Key: SPARK-7796 URL: https://issues.apache.org/jira/browse/SPARK-7796 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-7797) Remove "actorSystem" from SparkEnv

2015-05-21 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-7797: --- Summary: Remove "actorSystem" from SparkEnv Key: SPARK-7797 URL: https://issues.apache.org/jira/browse/SPARK-7797 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-7798) Move "AkkaRpcEnv" to a separate project

2015-05-21 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-7798: --- Summary: Move "AkkaRpcEnv" to a separate project Key: SPARK-7798 URL: https://issues.apache.org/jira/browse/SPARK-7798 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-7796) Use the new RPC implementation by default

2015-05-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-7796: - Fix Version/s: (was: 1.6.0) [~zsxwing] don't set Fix Version > Use the new RPC implementation by defa

[jira] [Updated] (SPARK-7797) Remove "actorSystem" from SparkEnv

2015-05-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-7797: - Fix Version/s: (was: 1.5.0) > Remove "actorSystem" from SparkEnv > --

[jira] [Created] (SPARK-7799) Move "StreamingContext.actorStream" to a separate project

2015-05-21 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-7799: --- Summary: Move "StreamingContext.actorStream" to a separate project Key: SPARK-7799 URL: https://issues.apache.org/jira/browse/SPARK-7799 Project: Spark Issue T

[jira] [Resolved] (SPARK-7749) Parquet metastore conversion does not use metastore cache

2015-05-21 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-7749. - Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 6287 [https://github.com/apac

[jira] [Created] (SPARK-7800) isDefined should not marked too early in putNewKey

2015-05-21 Thread Liang-Chi Hsieh (JIRA)
Liang-Chi Hsieh created SPARK-7800: -- Summary: isDefined should not marked too early in putNewKey Key: SPARK-7800 URL: https://issues.apache.org/jira/browse/SPARK-7800 Project: Spark Issue Ty

[jira] [Assigned] (SPARK-7800) isDefined should not marked too early in putNewKey

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7800: --- Assignee: Apache Spark > isDefined should not marked too early in putNewKey > ---

[jira] [Updated] (SPARK-7712) Native Spark Window Functions & Performance Improvements

2015-05-21 Thread Herman van Hovell tot Westerflier (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell tot Westerflier updated SPARK-7712: - Description: Hi All, After playing with the current spark

[jira] [Updated] (SPARK-7797) Remove "actorSystem" from SparkEnv

2015-05-21 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-7797: Target Version/s: 1.6.0 > Remove "actorSystem" from SparkEnv > -- >

[jira] [Assigned] (SPARK-7800) isDefined should not marked too early in putNewKey

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7800: --- Assignee: (was: Apache Spark) > isDefined should not marked too early in putNewKey >

[jira] [Commented] (SPARK-7800) isDefined should not marked too early in putNewKey

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14554746#comment-14554746 ] Apache Spark commented on SPARK-7800: - User 'viirya' has created a pull request for th

[jira] [Updated] (SPARK-7712) Native Spark Window Functions & Performance Improvements

2015-05-21 Thread Herman van Hovell tot Westerflier (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell tot Westerflier updated SPARK-7712: - Description: Hi All, After playing with the current spark

  1   2   3   4   >