[jira] [Updated] (SPARK-11175) Concurrent execution of JobSet within a batch in Spark streaming

2015-10-18 Thread Yongjia Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjia Wang updated SPARK-11175: - Description: Spark StreamingContext can register multiple independent Input DStreams (such as

[jira] [Created] (SPARK-11175) Concurrent execution of JobSet within a batch in Spark streaming

2015-10-18 Thread Yongjia Wang (JIRA)
Yongjia Wang created SPARK-11175: Summary: Concurrent execution of JobSet within a batch in Spark streaming Key: SPARK-11175 URL: https://issues.apache.org/jira/browse/SPARK-11175 Project: Spark

[jira] [Comment Edited] (SPARK-11087) spark.sql.orc.filterPushdown does not work, No ORC pushdown predicate

2015-10-18 Thread patcharee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14960296#comment-14960296 ] patcharee edited comment on SPARK-11087 at 10/19/15 3:34 AM: - [~zzhan] Below

[jira] [Updated] (SPARK-11126) A memory leak in SQLListener._stageIdToStageMetrics

2015-10-18 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-11126: --- Priority: Blocker (was: Critical) > A memory leak in SQLListener._stageIdToStageMetrics >

[jira] [Updated] (SPARK-11126) A memory leak in SQLListener._stageIdToStageMetrics

2015-10-18 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-11126: --- Affects Version/s: 1.5.0 > A memory leak in SQLListener._stageIdToStageMetrics >

[jira] [Updated] (SPARK-11152) Streaming UI: Input sizes are 0 for makeup batches started from a checkpoint

2015-10-18 Thread Yongjia Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjia Wang updated SPARK-11152: - Priority: Major (was: Minor) > Streaming UI: Input sizes are 0 for makeup batches started from

[jira] [Updated] (SPARK-11175) Concurrent execution of JobSet within a batch in Spark streaming

2015-10-18 Thread Yongjia Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjia Wang updated SPARK-11175: - Description: Spark StreamingContext can register multiple independent Input DStreams (such as

[jira] [Commented] (SPARK-7018) Refactor dev/run-tests-jenkins into Python

2015-10-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14962659#comment-14962659 ] Apache Spark commented on SPARK-7018: - User 'JoshRosen' has created a pull request for this issue:

[jira] [Updated] (SPARK-5250) EOFException in when reading gzipped files from S3 with wholeTextFiles

2015-10-18 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-5250: -- Issue Type: Sub-task (was: Bug) Parent: SPARK-11176 > EOFException in when reading gzipped

[jira] [Created] (SPARK-11176) Umbrella ticket for wholeTextFiles + S3 bugs

2015-10-18 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-11176: -- Summary: Umbrella ticket for wholeTextFiles + S3 bugs Key: SPARK-11176 URL: https://issues.apache.org/jira/browse/SPARK-11176 Project: Spark Issue Type:

[jira] [Updated] (SPARK-10994) Clustering coefficient computation in GraphX

2015-10-18 Thread Yang Yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yang updated SPARK-10994: -- Description: We propose to implement an algorithm to compute the clustering coefficient, in GraphX.

[jira] [Resolved] (SPARK-11126) A memory leak in SQLListener._stageIdToStageMetrics

2015-10-18 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-11126. Resolution: Fixed Fix Version/s: 1.5.2 1.6.0 Issue resolved by pull

[jira] [Updated] (SPARK-10994) Clustering coefficient computation in GraphX

2015-10-18 Thread Yang Yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yang updated SPARK-10994: -- Summary: Clustering coefficient computation in GraphX (was: Local clustering coefficient computation

[jira] [Updated] (SPARK-4414) SparkContext.wholeTextFiles Doesn't work with S3 Buckets

2015-10-18 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-4414: -- Issue Type: Sub-task (was: Bug) Parent: SPARK-11176 > SparkContext.wholeTextFiles Doesn't work

[jira] [Resolved] (SPARK-11102) Uninformative exception when specifing non-exist input for JSON data source

2015-10-18 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-11102. Resolution: Duplicate > Uninformative exception when specifing non-exist input for JSON data

[jira] [Commented] (SPARK-11102) Uninformative exception when specifing non-exist input for JSON data source

2015-10-18 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14962627#comment-14962627 ] Josh Rosen commented on SPARK-11102: This is a duplicate of SPARK-10709 > Uninformative exception

[jira] [Updated] (SPARK-11175) Concurrent execution of JobSet within a batch in Spark streaming

2015-10-18 Thread Yongjia Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjia Wang updated SPARK-11175: - Description: Spark StreamingContext can register multiple independent Input DStreams (such as

[jira] [Commented] (SPARK-10655) Enhance DB2 dialect to handle XML, and DECIMAL , and DECFLOAT

2015-10-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14962704#comment-14962704 ] Apache Spark commented on SPARK-10655: -- User 'sureshthalamati' has created a pull request for this

[jira] [Assigned] (SPARK-10655) Enhance DB2 dialect to handle XML, and DECIMAL , and DECFLOAT

2015-10-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10655: Assignee: (was: Apache Spark) > Enhance DB2 dialect to handle XML, and DECIMAL , and

[jira] [Assigned] (SPARK-10655) Enhance DB2 dialect to handle XML, and DECIMAL , and DECFLOAT

2015-10-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10655: Assignee: Apache Spark > Enhance DB2 dialect to handle XML, and DECIMAL , and DECFLOAT >

[jira] [Updated] (SPARK-11176) Umbrella ticket for wholeTextFiles + S3 bugs

2015-10-18 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-11176: --- Component/s: Spark Core Input/Output > Umbrella ticket for wholeTextFiles + S3 bugs

[jira] [Created] (SPARK-11177) sc.wholeTextFiles throws ArrayIndexOutOfBoundsException when S3 file has zero bytes

2015-10-18 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-11177: -- Summary: sc.wholeTextFiles throws ArrayIndexOutOfBoundsException when S3 file has zero bytes Key: SPARK-11177 URL: https://issues.apache.org/jira/browse/SPARK-11177

[jira] [Commented] (SPARK-11175) Concurrent execution of JobSet within a batch in Spark streaming

2015-10-18 Thread Yongjia Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14962774#comment-14962774 ] Yongjia Wang commented on SPARK-11175: -- nice. should have found this. Thank you > Concurrent

[jira] [Closed] (SPARK-11175) Concurrent execution of JobSet within a batch in Spark streaming

2015-10-18 Thread Yongjia Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjia Wang closed SPARK-11175. Resolution: Not A Problem > Concurrent execution of JobSet within a batch in Spark streaming >

[jira] [Commented] (SPARK-11175) Concurrent execution of JobSet within a batch in Spark streaming

2015-10-18 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14962708#comment-14962708 ] Saisai Shao commented on SPARK-11175: - There's a configuration "spark.streaming.concurrentJobs" that

[jira] [Commented] (SPARK-11126) A memory leak in SQLListener._stageIdToStageMetrics

2015-10-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14962806#comment-14962806 ] Apache Spark commented on SPARK-11126: -- User 'zsxwing' has created a pull request for this issue:

[jira] [Commented] (SPARK-5250) EOFException in when reading gzipped files from S3 with wholeTextFiles

2015-10-18 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14962857#comment-14962857 ] Josh Rosen commented on SPARK-5250: --- I've spent some time trying to reproduce this under various Hadoop

[jira] [Resolved] (SPARK-7018) Refactor dev/run-tests-jenkins into Python

2015-10-18 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-7018. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9161

[jira] [Updated] (SPARK-7018) Refactor dev/run-tests-jenkins into Python

2015-10-18 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-7018: -- Assignee: Brennon York > Refactor dev/run-tests-jenkins into Python >

[jira] [Commented] (SPARK-4414) SparkContext.wholeTextFiles Doesn't work with S3 Buckets

2015-10-18 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14962832#comment-14962832 ] Josh Rosen commented on SPARK-4414: --- I was able to reproduce this under a Hadoop 1.0.4 build of Spark

[jira] [Assigned] (SPARK-4414) SparkContext.wholeTextFiles Doesn't work with S3 Buckets

2015-10-18 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen reassigned SPARK-4414: - Assignee: Josh Rosen > SparkContext.wholeTextFiles Doesn't work with S3 Buckets >

[jira] [Updated] (SPARK-5250) EOFException in when reading gzipped files from S3 with wholeTextFiles

2015-10-18 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-5250: -- Component/s: (was: PySpark) > EOFException in when reading gzipped files from S3 with

[jira] [Commented] (SPARK-11178) Improve naming around task failures in scheduler code

2015-10-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14962872#comment-14962872 ] Apache Spark commented on SPARK-11178: -- User 'kayousterhout' has created a pull request for this

[jira] [Assigned] (SPARK-11178) Improve naming around task failures in scheduler code

2015-10-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11178: Assignee: Kay Ousterhout (was: Apache Spark) > Improve naming around task failures in

[jira] [Assigned] (SPARK-11178) Improve naming around task failures in scheduler code

2015-10-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11178: Assignee: Apache Spark (was: Kay Ousterhout) > Improve naming around task failures in

[jira] [Created] (SPARK-11178) Improve naming around task failures in scheduler code

2015-10-18 Thread Kay Ousterhout (JIRA)
Kay Ousterhout created SPARK-11178: -- Summary: Improve naming around task failures in scheduler code Key: SPARK-11178 URL: https://issues.apache.org/jira/browse/SPARK-11178 Project: Spark

[jira] [Commented] (SPARK-5250) EOFException in when reading gzipped files from S3 with wholeTextFiles

2015-10-18 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14962886#comment-14962886 ] Josh Rosen commented on SPARK-5250: --- I also wonder if this is an S3-specific issue. > EOFException in

[jira] [Commented] (SPARK-11177) sc.wholeTextFiles throws ArrayIndexOutOfBoundsException when S3 file has zero bytes

2015-10-18 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14962821#comment-14962821 ] Josh Rosen commented on SPARK-11177: Reproduced it. This only occurs on Hadoop 1.x. >

[jira] [Assigned] (SPARK-11177) sc.wholeTextFiles throws ArrayIndexOutOfBoundsException when S3 file has zero bytes

2015-10-18 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen reassigned SPARK-11177: -- Assignee: Josh Rosen > sc.wholeTextFiles throws ArrayIndexOutOfBoundsException when S3 file

[jira] [Updated] (SPARK-10994) Clustering coefficient computation in GraphX

2015-10-18 Thread Yang Yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yang updated SPARK-10994: -- Description: The Clustering Coefficient (CC) is a fundamental measure in social (or other type of)

[jira] [Updated] (SPARK-11158) Add more information in Error statment for sql/types _verify_type()

2015-10-18 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-11158: --- Assignee: Mahmoud Lababidi > Add more information in Error statment for sql/types _verify_type() >

[jira] [Updated] (SPARK-11126) A memory leak in SQLListener._stageIdToStageMetrics

2015-10-18 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-11126: --- Target Version/s: 1.5.2, 1.6.0 > A memory leak in SQLListener._stageIdToStageMetrics >

[jira] [Updated] (SPARK-11126) A memory leak in SQLListener._stageIdToStageMetrics

2015-10-18 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-11126: --- Priority: Critical (was: Major) > A memory leak in SQLListener._stageIdToStageMetrics >

[jira] [Updated] (SPARK-11126) A memory leak in SQLListener._stageIdToStageMetrics

2015-10-18 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-11126: --- Affects Version/s: 1.5.1 > A memory leak in SQLListener._stageIdToStageMetrics >

[jira] [Updated] (SPARK-11126) A memory leak in SQLListener._stageIdToStageMetrics

2015-10-18 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-11126: --- Assignee: Shixiong Zhu > A memory leak in SQLListener._stageIdToStageMetrics >

[jira] [Resolved] (SPARK-11172) Close JsonParser/Generator in test

2015-10-18 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-11172. Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9157

[jira] [Updated] (SPARK-11172) Close JsonParser/Generator in test

2015-10-18 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-11172: --- Assignee: Ted Yu > Close JsonParser/Generator in test > -- > >

[jira] [Created] (SPARK-11173) Cannot save data via MSSQL JDBC

2015-10-18 Thread Gianluca Salvo (JIRA)
Gianluca Salvo created SPARK-11173: -- Summary: Cannot save data via MSSQL JDBC Key: SPARK-11173 URL: https://issues.apache.org/jira/browse/SPARK-11173 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-11173) Cannot save data via MSSQL JDBC

2015-10-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11173. --- Resolution: Not A Problem This does not appear to be an issue from Spark. > Cannot save data via

[jira] [Updated] (SPARK-11169) Remove the extra spaces in merge script

2015-10-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11169: -- Priority: Trivial (was: Major) > Remove the extra spaces in merge script >

[jira] [Commented] (SPARK-10757) Java friendly constructor for distributed matrices

2015-10-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14962335#comment-14962335 ] Apache Spark commented on SPARK-10757: -- User 'javelinjs' has created a pull request for this issue:

[jira] [Assigned] (SPARK-11174) Typo in the GraphX programming guide

2015-10-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11174: Assignee: Apache Spark > Typo in the GraphX programming guide >

[jira] [Commented] (SPARK-11174) Typo in the GraphX programming guide

2015-10-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14962356#comment-14962356 ] Apache Spark commented on SPARK-11174: -- User 'lpiepiora' has created a pull request for this issue:

[jira] [Updated] (SPARK-11174) Typo in the GraphX programming guide

2015-10-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11174: -- Assignee: Łukasz Piepiora > Typo in the GraphX programming guide >

[jira] [Resolved] (SPARK-11174) Typo in the GraphX programming guide

2015-10-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11174. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9160

[jira] [Commented] (SPARK-10757) Java friendly constructor for distributed matrices

2015-10-18 Thread Yizhi Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14962338#comment-14962338 ] Yizhi Liu commented on SPARK-10757: --- [~yanboliang] May I ask you to review my PR once you've got a

[jira] [Resolved] (SPARK-11147) HTTP 500 if try to access Spark UI in yarn-cluster

2015-10-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11147. --- Resolution: Not A Problem > HTTP 500 if try to access Spark UI in yarn-cluster >

[jira] [Created] (SPARK-11174) Typo in the GraphX programming guide

2015-10-18 Thread JIRA
Łukasz Piepiora created SPARK-11174: --- Summary: Typo in the GraphX programming guide Key: SPARK-11174 URL: https://issues.apache.org/jira/browse/SPARK-11174 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-11174) Typo in the GraphX programming guide

2015-10-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14962348#comment-14962348 ] Sean Owen commented on SPARK-11174: --- This isn't even worth a JIRA, but please open a pull request. >

[jira] [Assigned] (SPARK-11174) Typo in the GraphX programming guide

2015-10-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11174: Assignee: (was: Apache Spark) > Typo in the GraphX programming guide >

[jira] [Assigned] (SPARK-10757) Java friendly constructor for distributed matrices

2015-10-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10757: Assignee: Apache Spark > Java friendly constructor for distributed matrices >

[jira] [Assigned] (SPARK-10757) Java friendly constructor for distributed matrices

2015-10-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10757: Assignee: (was: Apache Spark) > Java friendly constructor for distributed matrices >

[jira] [Resolved] (SPARK-11161) Viewing the web UI for the first time unpersists a cached RDD

2015-10-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11161. --- Resolution: Not A Problem Good analysis. Yes, GC'ed RDDs are unpersisted. Given I'm 99% sure about

[jira] [Commented] (SPARK-11162) Allow enabling debug logging from the command line

2015-10-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14962355#comment-14962355 ] Sean Owen commented on SPARK-11162: --- Isn't it already possible? that's what the thread shows > Allow

[jira] [Commented] (SPARK-10994) Local clustering coefficient computation in GraphX

2015-10-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14962359#comment-14962359 ] Sean Owen commented on SPARK-10994: --- My honest guess is that this will not be merged. Please have a

[jira] [Updated] (SPARK-11163) Remove unnecessary addPendingTask calls in TaskSetManager.executorLost

2015-10-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11163: -- Target Version/s: 1.5.2, 1.6.0 (was: 1.6.0) Fix Version/s: (was: 1.5.2)

[jira] [Resolved] (SPARK-10893) Lag Analytic function broken

2015-10-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-10893. --- Resolution: Duplicate > Lag Analytic function broken > > >

[jira] [Reopened] (SPARK-11142) org.datanucleus is already registered

2015-10-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reopened SPARK-11142: --- > org.datanucleus is already registered > - > > Key:

[jira] [Resolved] (SPARK-11142) org.datanucleus is already registered

2015-10-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11142. --- Resolution: Fixed Fix Version/s: (was: 1.5.1) Target Version/s: (was: 1.5.1)

[jira] [Resolved] (SPARK-11142) org.datanucleus is already registered

2015-10-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11142. --- Resolution: Invalid > org.datanucleus is already registered > -

[jira] [Resolved] (SPARK-6478) new RDD.pipeWithPartition method

2015-10-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6478. -- Resolution: Won't Fix > new RDD.pipeWithPartition method > > >

[jira] [Resolved] (SPARK-6593) Provide option for HadoopRDD to skip corrupted files

2015-10-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6593. -- Resolution: Won't Fix > Provide option for HadoopRDD to skip corrupted files >

[jira] [Resolved] (SPARK-6639) Create a new script to start multiple masters

2015-10-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6639. -- Resolution: Won't Fix > Create a new script to start multiple masters >

[jira] [Resolved] (SPARK-11169) Remove the extra spaces in merge script

2015-10-18 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-11169. Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9156

[jira] [Resolved] (SPARK-10582) using dynamic-executor-allocation, if AM failed. the new AM will be started. But the new AM does not allocate executors to dirver

2015-10-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-10582. --- Resolution: Won't Fix > using dynamic-executor-allocation, if AM failed. the new AM will be started.

[jira] [Resolved] (SPARK-7300) The temporary generated direcotries are not cleaned while calling the insertinto api in dataframe

2015-10-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-7300. -- Resolution: Won't Fix > The temporary generated direcotries are not cleaned while calling the >