[jira] [Assigned] (SPARK-7604) Python API for PCA and PCAModel

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7604: --- Assignee: Apache Spark Python API for PCA and PCAModel ---

[jira] [Assigned] (SPARK-7604) Python API for PCA and PCAModel

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7604: --- Assignee: (was: Apache Spark) Python API for PCA and PCAModel

[jira] [Commented] (SPARK-7604) Python API for PCA and PCAModel

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14553821#comment-14553821 ] Apache Spark commented on SPARK-7604: - User 'yanboliang' has created a pull request

[jira] [Commented] (SPARK-7322) Add DataFrame DSL for window function support

2015-05-21 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14553865#comment-14553865 ] Reynold Xin commented on SPARK-7322: Also please make sure you add a unit test to

[jira] [Commented] (SPARK-7717) Spark Standalone Web UI showing incorrect total memory, workers and cores

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14553890#comment-14553890 ] Apache Spark commented on SPARK-7717: - User 'zhichao-li' has created a pull request

[jira] [Assigned] (SPARK-7717) Spark Standalone Web UI showing incorrect total memory, workers and cores

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7717: --- Assignee: (was: Apache Spark) Spark Standalone Web UI showing incorrect total memory,

[jira] [Updated] (SPARK-7788) Streaming | Kinesis | KinesisReceiver blocks in onStart

2015-05-21 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-7788: - Target Version/s: 1.4.0 Streaming | Kinesis | KinesisReceiver blocks in onStart

[jira] [Updated] (SPARK-7788) Streaming | Kinesis | KinesisReceiver blocks in onStart

2015-05-21 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-7788: - Priority: Blocker (was: Major) Streaming | Kinesis | KinesisReceiver blocks in onStart

[jira] [Assigned] (SPARK-7758) Failed to start thrift server when metastore is postgre sql

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7758: --- Assignee: Apache Spark Failed to start thrift server when metastore is postgre sql

[jira] [Created] (SPARK-7787) SerializableAWSCredentials in KinesisReceiver cannot be deserialized

2015-05-21 Thread Tathagata Das (JIRA)
Tathagata Das created SPARK-7787: Summary: SerializableAWSCredentials in KinesisReceiver cannot be deserialized Key: SPARK-7787 URL: https://issues.apache.org/jira/browse/SPARK-7787 Project: Spark

[jira] [Commented] (SPARK-7787) SerializableAWSCredentials in KinesisReceiver cannot be deserialized

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14553841#comment-14553841 ] Apache Spark commented on SPARK-7787: - User 'tdas' has created a pull request for this

[jira] [Assigned] (SPARK-7787) SerializableAWSCredentials in KinesisReceiver cannot be deserialized

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7787: --- Assignee: Tathagata Das (was: Apache Spark) SerializableAWSCredentials in KinesisReceiver

[jira] [Assigned] (SPARK-7787) SerializableAWSCredentials in KinesisReceiver cannot be deserialized

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7787: --- Assignee: Apache Spark (was: Tathagata Das) SerializableAWSCredentials in KinesisReceiver

[jira] [Comment Edited] (SPARK-7754) Use PartialFunction literals instead of objects in Catalyst

2015-05-21 Thread Edoardo Vacchi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14553849#comment-14553849 ] Edoardo Vacchi edited comment on SPARK-7754 at 5/21/15 8:15 AM:

[jira] [Created] (SPARK-7788) Streaming | Kinesis | KinesisReceiver blocks in onStart

2015-05-21 Thread Aniket Bhatnagar (JIRA)
Aniket Bhatnagar created SPARK-7788: --- Summary: Streaming | Kinesis | KinesisReceiver blocks in onStart Key: SPARK-7788 URL: https://issues.apache.org/jira/browse/SPARK-7788 Project: Spark

[jira] [Assigned] (SPARK-7788) Streaming | Kinesis | KinesisReceiver blocks in onStart

2015-05-21 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das reassigned SPARK-7788: Assignee: Tathagata Das Streaming | Kinesis | KinesisReceiver blocks in onStart

[jira] [Assigned] (SPARK-7717) Spark Standalone Web UI showing incorrect total memory, workers and cores

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7717: --- Assignee: Apache Spark Spark Standalone Web UI showing incorrect total memory, workers and

[jira] [Commented] (SPARK-7765) Input vector should divide with the norm in Word2Vec's findSynonyms

2015-05-21 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14553889#comment-14553889 ] Liang-Chi Hsieh commented on SPARK-7765: I will try to close some obsolete PRs.

[jira] [Commented] (SPARK-7758) Failed to start thrift server when metastore is postgre sql

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14553791#comment-14553791 ] Apache Spark commented on SPARK-7758: - User 'WangTaoTheTonic' has created a pull

[jira] [Assigned] (SPARK-7758) Failed to start thrift server when metastore is postgre sql

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7758: --- Assignee: (was: Apache Spark) Failed to start thrift server when metastore is postgre

[jira] [Created] (SPARK-7786) Allow StreamingListener to be specified in SparkConf and loaded when creating StreamingContext

2015-05-21 Thread yangping wu (JIRA)
yangping wu created SPARK-7786: -- Summary: Allow StreamingListener to be specified in SparkConf and loaded when creating StreamingContext Key: SPARK-7786 URL: https://issues.apache.org/jira/browse/SPARK-7786

[jira] [Updated] (SPARK-7786) Allow StreamingListener to be specified in SparkConf and loaded when creating StreamingContext

2015-05-21 Thread yangping wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yangping wu updated SPARK-7786: --- Priority: Minor (was: Major) Allow StreamingListener to be specified in SparkConf and loaded when

[jira] [Commented] (SPARK-7754) Use PartialFunction literals instead of objects in Catalyst

2015-05-21 Thread Edoardo Vacchi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14553849#comment-14553849 ] Edoardo Vacchi commented on SPARK-7754: --- That's a fair observation; on the other

[jira] [Updated] (SPARK-7322) Add DataFrame DSL for window function support

2015-05-21 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7322: --- Description: Here's a proposal for supporting window functions in the DataFrame DSL: 1. Add an over

[jira] [Comment Edited] (SPARK-7754) Use PartialFunction literals instead of objects in Catalyst

2015-05-21 Thread Edoardo Vacchi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14553849#comment-14553849 ] Edoardo Vacchi edited comment on SPARK-7754 at 5/21/15 8:24 AM:

[jira] [Commented] (SPARK-7788) Streaming | Kinesis | KinesisReceiver blocks in onStart

2015-05-21 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14553893#comment-14553893 ] Tathagata Das commented on SPARK-7788: -- This may be a good catch. I will try to look

[jira] [Resolved] (SPARK-7606) Document all PySpark SQL/DataFrame public methods with @since tag

2015-05-21 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-7606. Resolution: Fixed Fix Version/s: 1.4.0 Document all PySpark SQL/DataFrame public methods

[jira] [Created] (SPARK-7784) Check 1.3- 1.4 SQL API compliance using java-compliance-checker

2015-05-21 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-7784: Summary: Check 1.3- 1.4 SQL API compliance using java-compliance-checker Key: SPARK-7784 URL: https://issues.apache.org/jira/browse/SPARK-7784 Project: Spark

[jira] [Commented] (SPARK-5389) spark-shell.cmd does not run from DOS Windows 7

2015-05-21 Thread Kaveen Raajan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14553733#comment-14553733 ] Kaveen Raajan commented on SPARK-5389: -- I had the same problem. I found the root

[jira] [Assigned] (SPARK-6013) Add more Python ML examples for spark.ml

2015-05-21 Thread Ram Sriharsha (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ram Sriharsha reassigned SPARK-6013: Assignee: Ram Sriharsha Add more Python ML examples for spark.ml

[jira] [Updated] (SPARK-7784) Check 1.3- 1.4 SQL API compliance using java-compliance-checker

2015-05-21 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-7784: - Attachment: compat_report.html There are lots of false positives since package private

[jira] [Resolved] (SPARK-7753) Improve kernel density API

2015-05-21 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-7753. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 6279

[jira] [Resolved] (SPARK-7784) Check 1.3- 1.4 SQL API compliance using java-compliance-checker

2015-05-21 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-7784. Resolution: Fixed Fix Version/s: 1.4.0 I went through them quickly. Everything looks fine.

[jira] [Created] (SPARK-7785) Add missing items to pyspark.mllib.linalg.Matrices

2015-05-21 Thread Manoj Kumar (JIRA)
Manoj Kumar created SPARK-7785: -- Summary: Add missing items to pyspark.mllib.linalg.Matrices Key: SPARK-7785 URL: https://issues.apache.org/jira/browse/SPARK-7785 Project: Spark Issue Type:

[jira] [Commented] (SPARK-7785) Add missing items to pyspark.mllib.linalg.Matrices

2015-05-21 Thread Manoj Kumar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14553769#comment-14553769 ] Manoj Kumar commented on SPARK-7785: ping [~josephkb] Add missing items to

[jira] [Commented] (SPARK-7320) Add rollup and cube support to DataFrame Java/Scala DSL

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14553696#comment-14553696 ] Apache Spark commented on SPARK-7320: - User 'chenghao-intel' has created a pull

[jira] [Commented] (SPARK-6197) handle json parse exception for eventlog file not finished writing

2015-05-21 Thread Xia Hu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14553703#comment-14553703 ] Xia Hu commented on SPARK-6197: --- Ok, get it. Thank you very much~~ handle json parse

[jira] [Assigned] (SPARK-7394) Add Pandas style cast (astype)

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7394: --- Assignee: Apache Spark Add Pandas style cast (astype) --

[jira] [Assigned] (SPARK-7394) Add Pandas style cast (astype)

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7394: --- Assignee: (was: Apache Spark) Add Pandas style cast (astype)

[jira] [Commented] (SPARK-7394) Add Pandas style cast (astype)

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14553772#comment-14553772 ] Apache Spark commented on SPARK-7394: - User 'kaka1992' has created a pull request for

[jira] [Assigned] (SPARK-7404) Add RegressionEvaluator to spark.ml

2015-05-21 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng reassigned SPARK-7404: Assignee: Xiangrui Meng Add RegressionEvaluator to spark.ml

[jira] [Resolved] (SPARK-7745) Replace assertions with requires (IllegalArgumentException) and modify other state checks

2015-05-21 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-7745. -- Resolution: Fixed Fix Version/s: 1.4.0 Replace assertions with requires

[jira] [Updated] (SPARK-7745) Replace assertions with requires (IllegalArgumentException) and modify other state checks

2015-05-21 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-7745: - Assignee: Burak Yavuz Replace assertions with requires (IllegalArgumentException) and modify

[jira] [Updated] (SPARK-7789) sql on security hbase:Token generation only allowed for Kerberos authenticated clients

2015-05-21 Thread meiyoula (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] meiyoula updated SPARK-7789: Description: After creating a hbase table in beeline, then execute select sql statement, Executor occurs

[jira] [Created] (SPARK-7789) sql on security hbase:Token generation only allowed for Kerberos authenticated clients

2015-05-21 Thread meiyoula (JIRA)
meiyoula created SPARK-7789: --- Summary: sql on security hbase:Token generation only allowed for Kerberos authenticated clients Key: SPARK-7789 URL: https://issues.apache.org/jira/browse/SPARK-7789 Project:

[jira] [Commented] (SPARK-7789) sql on security hbase:Token generation only allowed for Kerberos authenticated clients

2015-05-21 Thread meiyoula (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14553958#comment-14553958 ] meiyoula commented on SPARK-7789: - I use the hive source of

[jira] [Updated] (SPARK-7789) sql on security hbase:Token generation only allowed for Kerberos authenticated clients

2015-05-21 Thread meiyoula (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] meiyoula updated SPARK-7789: Description: After creating a hbase table in beeline, then execute select sql statement, Executor occurs

[jira] [Created] (SPARK-7796) Use the new RPC implementation by default

2015-05-21 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-7796: --- Summary: Use the new RPC implementation by default Key: SPARK-7796 URL: https://issues.apache.org/jira/browse/SPARK-7796 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-7722) Style checks do not run for Kinesis on Jenkins

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7722: --- Assignee: Tathagata Das (was: Apache Spark) Style checks do not run for Kinesis on Jenkins

[jira] [Comment Edited] (SPARK-7708) Incorrect task serialization with Kryo closure serializer

2015-05-21 Thread Akshat Aranya (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14554797#comment-14554797 ] Akshat Aranya edited comment on SPARK-7708 at 5/21/15 6:22 PM:

[jira] [Assigned] (SPARK-7722) Style checks do not run for Kinesis on Jenkins

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7722: --- Assignee: Apache Spark (was: Tathagata Das) Style checks do not run for Kinesis on Jenkins

[jira] [Commented] (SPARK-6764) Add wheel package support for PySpark

2015-05-21 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14554825#comment-14554825 ] Davies Liu commented on SPARK-6764: --- My first question is that, can we use wheel package

[jira] [Commented] (SPARK-7724) Add support for Intersect and Except in Catalyst DSL

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14554854#comment-14554854 ] Apache Spark commented on SPARK-7724: - User 'smola' has created a pull request for

[jira] [Commented] (SPARK-7795) Speed up task serialization in standalone mode

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14554721#comment-14554721 ] Apache Spark commented on SPARK-7795: - User 'coolfrood' has created a pull request for

[jira] [Assigned] (SPARK-7795) Speed up task serialization in standalone mode

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7795: --- Assignee: (was: Apache Spark) Speed up task serialization in standalone mode

[jira] [Updated] (SPARK-7780) The intercept in LogisticRegressionWithLBFGS should not be regularized

2015-05-21 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-7780: - Target Version/s: 1.5.0 The intercept in LogisticRegressionWithLBFGS should not be

[jira] [Created] (SPARK-7797) Remove actorSystem from SparkEnv

2015-05-21 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-7797: --- Summary: Remove actorSystem from SparkEnv Key: SPARK-7797 URL: https://issues.apache.org/jira/browse/SPARK-7797 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-7800) isDefined should not marked too early in putNewKey

2015-05-21 Thread Liang-Chi Hsieh (JIRA)
Liang-Chi Hsieh created SPARK-7800: -- Summary: isDefined should not marked too early in putNewKey Key: SPARK-7800 URL: https://issues.apache.org/jira/browse/SPARK-7800 Project: Spark Issue

[jira] [Updated] (SPARK-7737) parquet schema discovery should not fail because of empty _temporary dir

2015-05-21 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-7737: Assignee: Yin Huai (was: Cheng Lian) parquet schema discovery should not fail because of empty _temporary

[jira] [Commented] (SPARK-7737) parquet schema discovery should not fail because of empty _temporary dir

2015-05-21 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14554769#comment-14554769 ] Yin Huai commented on SPARK-7737: - Seems https://github.com/apache/spark/pull/6287 still

[jira] [Updated] (SPARK-7800) isDefined should not marked too early in putNewKey

2015-05-21 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-7800: -- Affects Version/s: 1.4.0 isDefined should not marked too early in putNewKey

[jira] [Updated] (SPARK-7800) isDefined should not marked too early in putNewKey

2015-05-21 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-7800: -- Assignee: Liang-Chi Hsieh isDefined should not marked too early in putNewKey

[jira] [Updated] (SPARK-7800) isDefined should not marked too early in putNewKey

2015-05-21 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-7800: -- Priority: Minor (was: Major) isDefined should not marked too early in putNewKey

[jira] [Resolved] (SPARK-7749) Parquet metastore conversion does not use metastore cache

2015-05-21 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-7749. - Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 6287

[jira] [Updated] (SPARK-7712) Native Spark Window Functions Performance Improvements

2015-05-21 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-7712: Shepherd: Yin Huai Native Spark Window Functions Performance Improvements

[jira] [Commented] (SPARK-7712) Native Spark Window Functions Performance Improvements

2015-05-21 Thread Herman van Hovell tot Westerflier (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14554753#comment-14554753 ] Herman van Hovell tot Westerflier commented on SPARK-7712: -- I

[jira] [Updated] (SPARK-7758) Failed to start thrift server when metastore is postgre sql

2015-05-21 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-7758: Target Version/s: 1.4.0 Affects Version/s: 1.4.0 Failed to start thrift server when

[jira] [Closed] (SPARK-7773) Document `spark.dynamicAllocation.initialExecutors`

2015-05-21 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-7773. Resolution: Won't Fix Turns out it was already documented? Document

[jira] [Commented] (SPARK-7708) Incorrect task serialization with Kryo closure serializer

2015-05-21 Thread Akshat Aranya (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14554797#comment-14554797 ] Akshat Aranya commented on SPARK-7708: -- I was able to get this working with a couple

[jira] [Updated] (SPARK-7787) SerializableAWSCredentials in KinesisReceiver cannot be deserialized

2015-05-21 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-7787: - Reporter: Chris Fregly (was: Tathagata Das) SerializableAWSCredentials in KinesisReceiver

[jira] [Resolved] (SPARK-7787) SerializableAWSCredentials in KinesisReceiver cannot be deserialized

2015-05-21 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-7787. -- Resolution: Fixed Fix Version/s: 1.4.0 SerializableAWSCredentials in KinesisReceiver

[jira] [Updated] (SPARK-7712) Native Spark Window Functions Performance Improvements

2015-05-21 Thread Herman van Hovell tot Westerflier (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell tot Westerflier updated SPARK-7712: - Description: Hi All, After playing with the current

[jira] [Commented] (SPARK-7796) Use the new RPC implementation by default

2015-05-21 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14554748#comment-14554748 ] Shixiong Zhu commented on SPARK-7796: - Sorry. Set a wrong field. Use the new RPC

[jira] [Updated] (SPARK-7758) Failed to start thrift server when metastore is postgre sql

2015-05-21 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-7758: Priority: Blocker (was: Critical) Failed to start thrift server when metastore is postgre

[jira] [Commented] (SPARK-7708) Incorrect task serialization with Kryo closure serializer

2015-05-21 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14554779#comment-14554779 ] Josh Rosen commented on SPARK-7708: --- It doesn't surprise me that Kryo doesn't work for

[jira] [Assigned] (SPARK-6740) SQL operator and condition precedence is not honoured

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6740: --- Assignee: (was: Apache Spark) SQL operator and condition precedence is not honoured

[jira] [Commented] (SPARK-6740) SQL operator and condition precedence is not honoured

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14554834#comment-14554834 ] Apache Spark commented on SPARK-6740: - User 'smola' has created a pull request for

[jira] [Assigned] (SPARK-6740) SQL operator and condition precedence is not honoured

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6740: --- Assignee: Apache Spark SQL operator and condition precedence is not honoured

[jira] [Updated] (SPARK-6956) Improve DataFrame API compatibility with Pandas

2015-05-21 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-6956: --- Target Version/s: 1.4.0 (was: 1.5.0) Improve DataFrame API compatibility with Pandas

[jira] [Resolved] (SPARK-7394) Add Pandas style cast (astype)

2015-05-21 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-7394. Resolution: Fixed Fix Version/s: 1.4.0 Assignee: Chen Song Add Pandas style cast

[jira] [Commented] (SPARK-7708) Incorrect task serialization with Kryo closure serializer

2015-05-21 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14554819#comment-14554819 ] Josh Rosen commented on SPARK-7708: --- I can investigate this in more detail later, but is

[jira] [Reopened] (SPARK-7724) Add support for Intersect and Except in Catalyst DSL

2015-05-21 Thread Santiago M. Mola (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Santiago M. Mola reopened SPARK-7724: - Thanks. Here's a PR. Add support for Intersect and Except in Catalyst DSL

[jira] [Updated] (SPARK-7781) GradientBoostedTrees.trainRegressor is missing maxBins parameter in pyspark

2015-05-21 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-7781: - Target Version/s: 1.5.0 GradientBoostedTrees.trainRegressor is missing maxBins parameter

[jira] [Created] (SPARK-7798) Move AkkaRpcEnv to a separate project

2015-05-21 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-7798: --- Summary: Move AkkaRpcEnv to a separate project Key: SPARK-7798 URL: https://issues.apache.org/jira/browse/SPARK-7798 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-7796) Use the new RPC implementation by default

2015-05-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-7796: - Fix Version/s: (was: 1.6.0) [~zsxwing] don't set Fix Version Use the new RPC implementation by

[jira] [Updated] (SPARK-7712) Native Spark Window Functions Performance Improvements

2015-05-21 Thread Herman van Hovell tot Westerflier (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell tot Westerflier updated SPARK-7712: - Description: Hi All, After playing with the current

[jira] [Updated] (SPARK-7797) Remove actorSystem from SparkEnv

2015-05-21 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-7797: Target Version/s: 1.6.0 Remove actorSystem from SparkEnv --

[jira] [Assigned] (SPARK-7800) isDefined should not marked too early in putNewKey

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7800: --- Assignee: (was: Apache Spark) isDefined should not marked too early in putNewKey

[jira] [Commented] (SPARK-7800) isDefined should not marked too early in putNewKey

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14554746#comment-14554746 ] Apache Spark commented on SPARK-7800: - User 'viirya' has created a pull request for

[jira] [Assigned] (SPARK-7800) isDefined should not marked too early in putNewKey

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7800: --- Assignee: Apache Spark isDefined should not marked too early in putNewKey

[jira] [Updated] (SPARK-7758) Failed to start thrift server when metastore is postgre sql

2015-05-21 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-7758: Description: I am using today's master branch to start thrift server with setting metastore

[jira] [Commented] (SPARK-7722) Style checks do not run for Kinesis on Jenkins

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14554802#comment-14554802 ] Apache Spark commented on SPARK-7722: - User 'tdas' has created a pull request for this

[jira] [Updated] (SPARK-7754) Use PartialFunction literals instead of objects in Catalyst

2015-05-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-7754: - Component/s: SQL Use PartialFunction literals instead of objects in Catalyst

[jira] [Commented] (SPARK-7737) parquet schema discovery should not fail because of empty _temporary dir

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14554972#comment-14554972 ] Apache Spark commented on SPARK-7737: - User 'yhuai' has created a pull request for

[jira] [Assigned] (SPARK-7737) parquet schema discovery should not fail because of empty _temporary dir

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7737: --- Assignee: Apache Spark (was: Yin Huai) parquet schema discovery should not fail because of

[jira] [Assigned] (SPARK-7737) parquet schema discovery should not fail because of empty _temporary dir

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7737: --- Assignee: Yin Huai (was: Apache Spark) parquet schema discovery should not fail because of

[jira] [Resolved] (SPARK-7616) Column order can be corrupted when saving DataFrame as a partitioned table

2015-05-21 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-7616. - Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 6285

[jira] [Commented] (SPARK-4924) Factor out code to launch Spark applications into a separate library

2015-05-21 Thread Jonathan Kelly (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14555062#comment-14555062 ] Jonathan Kelly commented on SPARK-4924: --- I tried upgrading my environment to Spark

[jira] [Commented] (SPARK-7446) Inverse transform for StringIndexer

2015-05-21 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14555064#comment-14555064 ] holdenk commented on SPARK-7446: I can do this one :) Inverse transform for

[jira] [Created] (SPARK-7804) Incorrect results from JDBCRDD -- one record repeatly and incorrect field value

2015-05-21 Thread Paul Wu (JIRA)
Paul Wu created SPARK-7804: -- Summary: Incorrect results from JDBCRDD -- one record repeatly and incorrect field value Key: SPARK-7804 URL: https://issues.apache.org/jira/browse/SPARK-7804 Project: Spark

  1   2   3   4   >