[jira] [Commented] (SPARK-4907) Inconsistent loss and gradient in LeastSquaresGradient compared with R

[ https://issues.apache.org/jira/browse/SPARK-4907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14258981#comment-14258981 ] DB Tsai commented on SPARK-4907: [~sowen] It seems that the existing document has 1/2 fact

[jira] [Updated] (SPARK-4868) Twitter DStream.map() throws "Task not serializable"

[ https://issues.apache.org/jira/browse/SPARK-4868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-4868: Environment: * Spark 1.1.1 or 1.2.0 * EC2 cluster with 1 slave spun up using {{spark-e

[jira] [Commented] (SPARK-4787) Resource unreleased during failure in SparkContext initialization

[ https://issues.apache.org/jira/browse/SPARK-4787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14258974#comment-14258974 ] Dale Richardson commented on SPARK-4787: Pretty simple fix - Can somebody assign t

[jira] [Resolved] (SPARK-4608) Reorganize StreamingContext implicit to improve API convenience

[ https://issues.apache.org/jira/browse/SPARK-4608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-4608. -- Resolution: Fixed Fix Version/s: 1.3.0 > Reorganize StreamingContext implicit to improve

[jira] [Resolved] (SPARK-4537) Add 'processing delay' and 'totalDelay' to the metrics reported by the Spark Streaming subsystem

[ https://issues.apache.org/jira/browse/SPARK-4537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-4537. -- Resolution: Fixed Fix Version/s: 1.2.1 1.3.0 > Add 'processing delay'

[jira] [Commented] (SPARK-1507) Spark on Yarn: Add support for user to specify # cores for ApplicationMaster

[ https://issues.apache.org/jira/browse/SPARK-1507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14258904#comment-14258904 ] Apache Spark commented on SPARK-1507: - User 'XuTingjun' has created a pull request for

[jira] [Commented] (SPARK-4971) fix typo in BlockGenerator

[ https://issues.apache.org/jira/browse/SPARK-4971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14258903#comment-14258903 ] Apache Spark commented on SPARK-4971: - User 'CodingCat' has created a pull request for

[jira] [Created] (SPARK-4971) fix typo in BlockGenerator

Nan Zhu created SPARK-4971: -- Summary: fix typo in BlockGenerator Key: SPARK-4971 URL: https://issues.apache.org/jira/browse/SPARK-4971 Project: Spark Issue Type: Improvement Components: St

[jira] [Commented] (SPARK-4970) Fix an implicit bug in SparkSubmitSuite

[ https://issues.apache.org/jira/browse/SPARK-4970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14258884#comment-14258884 ] Apache Spark commented on SPARK-4970: - User 'maropu' has created a pull request for th

[jira] [Created] (SPARK-4970) Fix an implicit bug in SparkSubmitSuite

Takeshi Yamamuro created SPARK-4970: --- Summary: Fix an implicit bug in SparkSubmitSuite Key: SPARK-4970 URL: https://issues.apache.org/jira/browse/SPARK-4970 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-3522) Make spark-ec2 verbosity configurable

[ https://issues.apache.org/jira/browse/SPARK-3522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-3522: Labels: starter (was: ) > Make spark-ec2 verbosity configurable > -

[jira] [Updated] (SPARK-2528) Default spark-ec2 security group permissions are too open

[ https://issues.apache.org/jira/browse/SPARK-2528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-2528: Summary: Default spark-ec2 security group permissions are too open (was: spark-ec2 security

[jira] [Updated] (SPARK-2528) Default spark-ec2 security group permissions are too open

[ https://issues.apache.org/jira/browse/SPARK-2528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-2528: Description: {{spark-ec2}} by default configures EC2 security groups with ports [open to the

[jira] [Commented] (SPARK-4969) Add binaryRecords support to streaming

[ https://issues.apache.org/jira/browse/SPARK-4969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14258842#comment-14258842 ] Apache Spark commented on SPARK-4969: - User 'freeman-lab' has created a pull request f

[jira] [Created] (SPARK-4969) Add binaryRecords support to streaming

Jeremy Freeman created SPARK-4969: - Summary: Add binaryRecords support to streaming Key: SPARK-4969 URL: https://issues.apache.org/jira/browse/SPARK-4969 Project: Spark Issue Type: Improvemen

[jira] [Updated] (SPARK-4968) [SparkSQL] java.lang.UnsupportedOperationException when hive partition doesn't exist and order by and limit are used

[ https://issues.apache.org/jira/browse/SPARK-4968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shekhar Bansal updated SPARK-4968: -- Environment: Spark 1.1.1 scala - 2.10.2 hive metastore db - pgsql OS- Linux was: Spark 1.1.1

[jira] [Created] (SPARK-4968) [SparkSQL] java.lang.UnsupportedOperationException when hive partition doesn't exist and order by and limit are used

Shekhar Bansal created SPARK-4968: - Summary: [SparkSQL] java.lang.UnsupportedOperationException when hive partition doesn't exist and order by and limit are used Key: SPARK-4968 URL: https://issues.apache.org/jira

[jira] [Updated] (SPARK-4908) Spark SQL built for Hive 13 fails under concurrent metadata queries

[ https://issues.apache.org/jira/browse/SPARK-4908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4908: --- Priority: Critical (was: Major) > Spark SQL built for Hive 13 fails under concurrent metadata

[jira] [Resolved] (SPARK-4909) "Error communicating with MapOutputTracker" when run a big spark job

[ https://issues.apache.org/jira/browse/SPARK-4909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-4909. Resolution: Duplicate Can you see how this job does with Spark 1.2? there was a lot of work

[jira] [Updated] (SPARK-4908) Spark SQL built for Hive 13 fails under concurrent metadata queries

[ https://issues.apache.org/jira/browse/SPARK-4908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4908: --- Component/s: SQL > Spark SQL built for Hive 13 fails under concurrent metadata queries > -

[jira] [Resolved] (SPARK-4926) Spark manipulate Hbase

[ https://issues.apache.org/jira/browse/SPARK-4926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-4926. Resolution: Invalid Resolving in agreement with [~sowen] > Spark manipulate Hbase > ---

[jira] [Resolved] (SPARK-4953) Fix the description of building Spark with YARN

[ https://issues.apache.org/jira/browse/SPARK-4953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-4953. Resolution: Fixed Fix Version/s: 1.3.0 Assignee: Kousuke Saruta > Fix the de

[jira] [Commented] (SPARK-4957) TaskScheduler: when no resources are available: backoff after # of tries and crash.

[ https://issues.apache.org/jira/browse/SPARK-4957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14258776#comment-14258776 ] Patrick Wendell commented on SPARK-4957: In some cases users may submit applicatio

[jira] [Commented] (SPARK-4923) Maven build should keep publishing spark-repl

[ https://issues.apache.org/jira/browse/SPARK-4923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14258772#comment-14258772 ] Patrick Wendell commented on SPARK-4923: Yes - I can retro-actively publish this o

[jira] [Commented] (SPARK-1600) flaky "recovery with file input stream" test in streaming.CheckpointSuite

[ https://issues.apache.org/jira/browse/SPARK-1600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14258704#comment-14258704 ] Apache Spark commented on SPARK-1600: - User 'JoshRosen' has created a pull request for

[jira] [Issue Comment Deleted] (SPARK-4001) Add Apriori algorithm to Spark MLlib

[ https://issues.apache.org/jira/browse/SPARK-4001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangyouhua updated SPARK-4001: --- Comment: was deleted (was: apriori and FPGrowth are commonly algorithm，there are two mainly method.on

[jira] [Commented] (SPARK-4001) Add Apriori algorithm to Spark MLlib

[ https://issues.apache.org/jira/browse/SPARK-4001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14258696#comment-14258696 ] zhangyouhua commented on SPARK-4001: apriori and FPGrowth are commonly algorithm，there

[jira] [Issue Comment Deleted] (SPARK-4001) Add Apriori algorithm to Spark MLlib

[ https://issues.apache.org/jira/browse/SPARK-4001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangyouhua updated SPARK-4001: --- Comment: was deleted (was: apriori and FPGrowth are commonly algorithm，there are two mainly method.on

[jira] [Commented] (SPARK-4001) Add Apriori algorithm to Spark MLlib

[ https://issues.apache.org/jira/browse/SPARK-4001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14258695#comment-14258695 ] zhangyouhua commented on SPARK-4001: apriori and FPGrowth are commonly algorithm，there

[jira] [Issue Comment Deleted] (SPARK-4001) Add Apriori algorithm to Spark MLlib

[ https://issues.apache.org/jira/browse/SPARK-4001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangyouhua updated SPARK-4001: --- Comment: was deleted (was: apriori and FPGrowth are commonly algorithm，there are two mainly method.on

[jira] [Commented] (SPARK-4001) Add Apriori algorithm to Spark MLlib

[ https://issues.apache.org/jira/browse/SPARK-4001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14258697#comment-14258697 ] zhangyouhua commented on SPARK-4001: apriori and FPGrowth are commonly algorithm，there

[jira] [Created] (SPARK-4967) File name with comma will cause exception for SQLContext.parquetFile

Cheng Hao created SPARK-4967: Summary: File name with comma will cause exception for SQLContext.parquetFile Key: SPARK-4967 URL: https://issues.apache.org/jira/browse/SPARK-4967 Project: Spark I

[jira] [Commented] (SPARK-1507) Spark on Yarn: Add support for user to specify # cores for ApplicationMaster

[ https://issues.apache.org/jira/browse/SPARK-1507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14258677#comment-14258677 ] Apache Spark commented on SPARK-1507: - User 'XuTingjun' has created a pull request for

[jira] [Commented] (SPARK-4966) The MemoryOverhead value is not correct

[ https://issues.apache.org/jira/browse/SPARK-4966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14258675#comment-14258675 ] Apache Spark commented on SPARK-4966: - User 'XuTingjun' has created a pull request for

[jira] [Closed] (SPARK-4965) The MemoryOverhead value is not correct

[ https://issues.apache.org/jira/browse/SPARK-4965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] meiyoula closed SPARK-4965. --- Resolution: Invalid > The MemoryOverhead value is not correct > --- > >