[jira] [Assigned] (SPARK-11179) Push filters through aggregate if filters are subset of 'group by' expressions

[ https://issues.apache.org/jira/browse/SPARK-11179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11179: Assignee: (was: Apache Spark) > Push filters through aggregate if filters are subset o

[jira] [Assigned] (SPARK-11179) Push filters through aggregate if filters are subset of 'group by' expressions

[ https://issues.apache.org/jira/browse/SPARK-11179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11179: Assignee: Apache Spark > Push filters through aggregate if filters are subset of 'group by

[jira] [Commented] (SPARK-11179) Push filters through aggregate if filters are subset of 'group by' expressions

[ https://issues.apache.org/jira/browse/SPARK-11179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14962931#comment-14962931 ] Apache Spark commented on SPARK-11179: -- User 'nitin2goyal' has created a pull reques

[jira] [Commented] (SPARK-10994) Clustering coefficient computation in GraphX

[ https://issues.apache.org/jira/browse/SPARK-10994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14962929#comment-14962929 ] Yang Yang commented on SPARK-10994: --- update with describing our motivation in more deta

[jira] [Updated] (SPARK-10994) Clustering coefficient computation in GraphX

[ https://issues.apache.org/jira/browse/SPARK-10994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yang updated SPARK-10994: -- Description: The Clustering Coefficient (CC) is a fundamental measure in social (or other type of) net

[jira] [Created] (SPARK-11181) Spark Yarn : Spark reducing total executors count even when Dynamic Allocation is disabled.

prakhar jauhari created SPARK-11181: --- Summary: Spark Yarn : Spark reducing total executors count even when Dynamic Allocation is disabled. Key: SPARK-11181 URL: https://issues.apache.org/jira/browse/SPARK-11181

[jira] [Assigned] (SPARK-11180) DataFrame.na.fill does not support Boolean Type:

[ https://issues.apache.org/jira/browse/SPARK-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11180: Assignee: (was: Apache Spark) > DataFrame.na.fill does not support Boolean Type: > --

[jira] [Assigned] (SPARK-11180) DataFrame.na.fill does not support Boolean Type:

[ https://issues.apache.org/jira/browse/SPARK-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11180: Assignee: Apache Spark > DataFrame.na.fill does not support Boolean Type: > -

[jira] [Commented] (SPARK-11180) DataFrame.na.fill does not support Boolean Type:

[ https://issues.apache.org/jira/browse/SPARK-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14962923#comment-14962923 ] Apache Spark commented on SPARK-11180: -- User 'rishabhbhardwaj' has created a pull re

[jira] [Commented] (SPARK-11177) sc.wholeTextFiles throws ArrayIndexOutOfBoundsException when S3 file has zero bytes

[ https://issues.apache.org/jira/browse/SPARK-11177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14962913#comment-14962913 ] Josh Rosen commented on SPARK-11177: It looks like this is caused by MAPREDUCE-4470,

[jira] [Updated] (SPARK-11176) Umbrella ticket for wholeTextFiles bugs

[ https://issues.apache.org/jira/browse/SPARK-11176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-11176: --- Description: This umbrella ticket gathers together several distinct bug reports related to problems

[jira] [Updated] (SPARK-11176) Umbrella ticket for wholeTextFiles bugs

[ https://issues.apache.org/jira/browse/SPARK-11176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-11176: --- Summary: Umbrella ticket for wholeTextFiles bugs (was: Umbrella ticket for wholeTextFiles + S3 bugs)

[jira] [Updated] (SPARK-11180) DataFrame.na.fill does not support Boolean Type:

[ https://issues.apache.org/jira/browse/SPARK-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satya Narayan updated SPARK-11180: -- Description: Currently DataFrame.na.fill does not support Boolean primitive type. We have us

[jira] [Updated] (SPARK-11180) DataFrame.na.fill does not support Boolean Type:

[ https://issues.apache.org/jira/browse/SPARK-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satya Narayan updated SPARK-11180: -- Summary: DataFrame.na.fill does not support Boolean Type: (was: DataFrameNaFunctions fills do

[jira] [Created] (SPARK-11180) DataFrameNaFunctions fills does not support Boolean Type:

Satya Narayan created SPARK-11180: - Summary: DataFrameNaFunctions fills does not support Boolean Type: Key: SPARK-11180 URL: https://issues.apache.org/jira/browse/SPARK-11180 Project: Spark I

[jira] [Commented] (SPARK-11144) Add SparkLauncher for Spark Streaming, Spark SQL, etc

[ https://issues.apache.org/jira/browse/SPARK-11144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14962903#comment-14962903 ] Jean-Baptiste Onofré commented on SPARK-11144: -- Hi Yuhang, just to confirm:

[jira] [Commented] (SPARK-11167) Incorrect type resolution on heterogeneous data structures

[ https://issues.apache.org/jira/browse/SPARK-11167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14962900#comment-14962900 ] Sun Rui commented on SPARK-11167: - For a DataFrame, each column is a collection of values

[jira] [Commented] (SPARK-11157) Allow Spark to be built without assemblies

[ https://issues.apache.org/jira/browse/SPARK-11157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14962897#comment-14962897 ] Jean-Baptiste Onofré commented on SPARK-11157: -- Agree with Marcelo. It's som

[jira] [Assigned] (SPARK-6541) Executor table on Stage page should sort by Executor ID numerically, not lexically

[ https://issues.apache.org/jira/browse/SPARK-6541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6541: --- Assignee: (was: Apache Spark) > Executor table on Stage page should sort by Executor ID n

[jira] [Assigned] (SPARK-6541) Executor table on Stage page should sort by Executor ID numerically, not lexically

[ https://issues.apache.org/jira/browse/SPARK-6541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6541: --- Assignee: Apache Spark > Executor table on Stage page should sort by Executor ID numerically,

[jira] [Commented] (SPARK-6541) Executor table on Stage page should sort by Executor ID numerically, not lexically

[ https://issues.apache.org/jira/browse/SPARK-6541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14962895#comment-14962895 ] Apache Spark commented on SPARK-6541: - User 'jbonofre' has created a pull request for

[jira] [Created] (SPARK-11179) Push filters through aggregate if filters are subset of 'group by' expressions

Nitin Goyal created SPARK-11179: --- Summary: Push filters through aggregate if filters are subset of 'group by' expressions Key: SPARK-11179 URL: https://issues.apache.org/jira/browse/SPARK-11179 Project:

[jira] [Commented] (SPARK-5250) EOFException in when reading gzipped files from S3 with wholeTextFiles

[ https://issues.apache.org/jira/browse/SPARK-5250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14962886#comment-14962886 ] Josh Rosen commented on SPARK-5250: --- I also wonder if this is an S3-specific issue. > E

[jira] [Updated] (SPARK-7018) Refactor dev/run-tests-jenkins into Python

[ https://issues.apache.org/jira/browse/SPARK-7018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-7018: -- Assignee: Brennon York > Refactor dev/run-tests-jenkins into Python > --

[jira] [Resolved] (SPARK-7018) Refactor dev/run-tests-jenkins into Python

[ https://issues.apache.org/jira/browse/SPARK-7018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-7018. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9161 [https://github.com/

[jira] [Commented] (SPARK-11178) Improve naming around task failures in scheduler code

[ https://issues.apache.org/jira/browse/SPARK-11178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14962872#comment-14962872 ] Apache Spark commented on SPARK-11178: -- User 'kayousterhout' has created a pull requ

[jira] [Assigned] (SPARK-11178) Improve naming around task failures in scheduler code

[ https://issues.apache.org/jira/browse/SPARK-11178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11178: Assignee: Kay Ousterhout (was: Apache Spark) > Improve naming around task failures in sch

[jira] [Assigned] (SPARK-11178) Improve naming around task failures in scheduler code

[ https://issues.apache.org/jira/browse/SPARK-11178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11178: Assignee: Apache Spark (was: Kay Ousterhout) > Improve naming around task failures in sch

[jira] [Created] (SPARK-11178) Improve naming around task failures in scheduler code

Kay Ousterhout created SPARK-11178: -- Summary: Improve naming around task failures in scheduler code Key: SPARK-11178 URL: https://issues.apache.org/jira/browse/SPARK-11178 Project: Spark Iss

[jira] [Commented] (SPARK-5250) EOFException in when reading gzipped files from S3 with wholeTextFiles

[ https://issues.apache.org/jira/browse/SPARK-5250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14962857#comment-14962857 ] Josh Rosen commented on SPARK-5250: --- I've spent some time trying to reproduce this under

[jira] [Updated] (SPARK-5250) EOFException in when reading gzipped files from S3 with wholeTextFiles

[ https://issues.apache.org/jira/browse/SPARK-5250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-5250: -- Component/s: (was: PySpark) > EOFException in when reading gzipped files from S3 with wholeTextFiles

[jira] [Assigned] (SPARK-4414) SparkContext.wholeTextFiles Doesn't work with S3 Buckets

[ https://issues.apache.org/jira/browse/SPARK-4414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen reassigned SPARK-4414: - Assignee: Josh Rosen > SparkContext.wholeTextFiles Doesn't work with S3 Buckets > ---

[jira] [Commented] (SPARK-4414) SparkContext.wholeTextFiles Doesn't work with S3 Buckets

[ https://issues.apache.org/jira/browse/SPARK-4414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14962832#comment-14962832 ] Josh Rosen commented on SPARK-4414: --- I was able to reproduce this under a Hadoop 1.0.4 b

[jira] [Assigned] (SPARK-11177) sc.wholeTextFiles throws ArrayIndexOutOfBoundsException when S3 file has zero bytes

[ https://issues.apache.org/jira/browse/SPARK-11177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen reassigned SPARK-11177: -- Assignee: Josh Rosen > sc.wholeTextFiles throws ArrayIndexOutOfBoundsException when S3 file ha

[jira] [Commented] (SPARK-11177) sc.wholeTextFiles throws ArrayIndexOutOfBoundsException when S3 file has zero bytes

[ https://issues.apache.org/jira/browse/SPARK-11177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14962821#comment-14962821 ] Josh Rosen commented on SPARK-11177: Reproduced it. This only occurs on Hadoop 1.x.

[jira] [Commented] (SPARK-11126) A memory leak in SQLListener._stageIdToStageMetrics

[ https://issues.apache.org/jira/browse/SPARK-11126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14962806#comment-14962806 ] Apache Spark commented on SPARK-11126: -- User 'zsxwing' has created a pull request fo

[jira] [Comment Edited] (SPARK-11087) spark.sql.orc.filterPushdown does not work, No ORC pushdown predicate

[ https://issues.apache.org/jira/browse/SPARK-11087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14960296#comment-14960296 ] patcharee edited comment on SPARK-11087 at 10/19/15 3:34 AM: -

[jira] [Updated] (SPARK-10994) Clustering coefficient computation in GraphX

[ https://issues.apache.org/jira/browse/SPARK-10994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yang updated SPARK-10994: -- Description: The Clustering Coefficient (CC) is a fundamental measure in social (or other type of) net

[jira] [Closed] (SPARK-11175) Concurrent execution of JobSet within a batch in Spark streaming

[ https://issues.apache.org/jira/browse/SPARK-11175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjia Wang closed SPARK-11175. Resolution: Not A Problem > Concurrent execution of JobSet within a batch in Spark streaming >

[jira] [Commented] (SPARK-11175) Concurrent execution of JobSet within a batch in Spark streaming

[ https://issues.apache.org/jira/browse/SPARK-11175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14962774#comment-14962774 ] Yongjia Wang commented on SPARK-11175: -- nice. should have found this. Thank you > C

[jira] [Updated] (SPARK-10994) Clustering coefficient computation in GraphX

[ https://issues.apache.org/jira/browse/SPARK-10994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yang updated SPARK-10994: -- Description: We propose to implement an algorithm to compute the clustering coefficient, in GraphX. T

[jira] [Updated] (SPARK-11176) Umbrella ticket for wholeTextFiles + S3 bugs

[ https://issues.apache.org/jira/browse/SPARK-11176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-11176: --- Component/s: Spark Core Input/Output > Umbrella ticket for wholeTextFiles + S3 bugs

[jira] [Created] (SPARK-11177) sc.wholeTextFiles throws ArrayIndexOutOfBoundsException when S3 file has zero bytes

Josh Rosen created SPARK-11177: -- Summary: sc.wholeTextFiles throws ArrayIndexOutOfBoundsException when S3 file has zero bytes Key: SPARK-11177 URL: https://issues.apache.org/jira/browse/SPARK-11177 Proje

[jira] [Updated] (SPARK-10994) Clustering coefficient computation in GraphX

[ https://issues.apache.org/jira/browse/SPARK-10994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yang updated SPARK-10994: -- Summary: Clustering coefficient computation in GraphX (was: Local clustering coefficient computation i

[jira] [Updated] (SPARK-4414) SparkContext.wholeTextFiles Doesn't work with S3 Buckets

[ https://issues.apache.org/jira/browse/SPARK-4414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-4414: -- Issue Type: Sub-task (was: Bug) Parent: SPARK-11176 > SparkContext.wholeTextFiles Doesn't work

[jira] [Updated] (SPARK-5250) EOFException in when reading gzipped files from S3 with wholeTextFiles

[ https://issues.apache.org/jira/browse/SPARK-5250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-5250: -- Issue Type: Sub-task (was: Bug) Parent: SPARK-11176 > EOFException in when reading gzipped file

[jira] [Created] (SPARK-11176) Umbrella ticket for wholeTextFiles + S3 bugs

Josh Rosen created SPARK-11176: -- Summary: Umbrella ticket for wholeTextFiles + S3 bugs Key: SPARK-11176 URL: https://issues.apache.org/jira/browse/SPARK-11176 Project: Spark Issue Type: Umbrella

[jira] [Commented] (SPARK-11175) Concurrent execution of JobSet within a batch in Spark streaming

[ https://issues.apache.org/jira/browse/SPARK-11175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14962708#comment-14962708 ] Saisai Shao commented on SPARK-11175: - There's a configuration "spark.streaming.concu

[jira] [Assigned] (SPARK-10655) Enhance DB2 dialect to handle XML, and DECIMAL , and DECFLOAT

[ https://issues.apache.org/jira/browse/SPARK-10655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10655: Assignee: (was: Apache Spark) > Enhance DB2 dialect to handle XML, and DECIMAL , and D

[jira] [Assigned] (SPARK-10655) Enhance DB2 dialect to handle XML, and DECIMAL , and DECFLOAT

[ https://issues.apache.org/jira/browse/SPARK-10655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10655: Assignee: Apache Spark > Enhance DB2 dialect to handle XML, and DECIMAL , and DECFLOAT > -

[jira] [Commented] (SPARK-10655) Enhance DB2 dialect to handle XML, and DECIMAL , and DECFLOAT

[ https://issues.apache.org/jira/browse/SPARK-10655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14962704#comment-14962704 ] Apache Spark commented on SPARK-10655: -- User 'sureshthalamati' has created a pull re

[jira] [Commented] (SPARK-7018) Refactor dev/run-tests-jenkins into Python

[ https://issues.apache.org/jira/browse/SPARK-7018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14962659#comment-14962659 ] Apache Spark commented on SPARK-7018: - User 'JoshRosen' has created a pull request for

[jira] [Updated] (SPARK-11175) Concurrent execution of JobSet within a batch in Spark streaming

[ https://issues.apache.org/jira/browse/SPARK-11175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjia Wang updated SPARK-11175: - Description: Spark StreamingContext can register multiple independent Input DStreams (such as fr

[jira] [Resolved] (SPARK-11102) Uninformative exception when specifing non-exist input for JSON data source

[ https://issues.apache.org/jira/browse/SPARK-11102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-11102. Resolution: Duplicate > Uninformative exception when specifing non-exist input for JSON data source

[jira] [Commented] (SPARK-11102) Uninformative exception when specifing non-exist input for JSON data source

[ https://issues.apache.org/jira/browse/SPARK-11102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14962627#comment-14962627 ] Josh Rosen commented on SPARK-11102: This is a duplicate of SPARK-10709 > Uninformat

[jira] [Updated] (SPARK-11175) Concurrent execution of JobSet within a batch in Spark streaming

[ https://issues.apache.org/jira/browse/SPARK-11175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjia Wang updated SPARK-11175: - Description: Spark StreamingContext can register multiple independent Input DStreams (such as fr

[jira] [Updated] (SPARK-11175) Concurrent execution of JobSet within a batch in Spark streaming

[ https://issues.apache.org/jira/browse/SPARK-11175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjia Wang updated SPARK-11175: - Description: Spark StreamingContext can register multiple independent Input DStreams (such as fr

[jira] [Created] (SPARK-11175) Concurrent execution of JobSet within a batch in Spark streaming

Yongjia Wang created SPARK-11175: Summary: Concurrent execution of JobSet within a batch in Spark streaming Key: SPARK-11175 URL: https://issues.apache.org/jira/browse/SPARK-11175 Project: Spark

[jira] [Resolved] (SPARK-11126) A memory leak in SQLListener._stageIdToStageMetrics

[ https://issues.apache.org/jira/browse/SPARK-11126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-11126. Resolution: Fixed Fix Version/s: 1.5.2 1.6.0 Issue resolved by pull reque

[jira] [Updated] (SPARK-11126) A memory leak in SQLListener._stageIdToStageMetrics

[ https://issues.apache.org/jira/browse/SPARK-11126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-11126: --- Priority: Blocker (was: Critical) > A memory leak in SQLListener._stageIdToStageMetrics > --

[jira] [Updated] (SPARK-11126) A memory leak in SQLListener._stageIdToStageMetrics

[ https://issues.apache.org/jira/browse/SPARK-11126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-11126: --- Affects Version/s: 1.5.0 > A memory leak in SQLListener._stageIdToStageMetrics >

[jira] [Updated] (SPARK-11152) Streaming UI: Input sizes are 0 for makeup batches started from a checkpoint

[ https://issues.apache.org/jira/browse/SPARK-11152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjia Wang updated SPARK-11152: - Priority: Major (was: Minor) > Streaming UI: Input sizes are 0 for makeup batches started from a

[jira] [Updated] (SPARK-11126) A memory leak in SQLListener._stageIdToStageMetrics

[ https://issues.apache.org/jira/browse/SPARK-11126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-11126: --- Assignee: Shixiong Zhu > A memory leak in SQLListener._stageIdToStageMetrics > --

[jira] [Updated] (SPARK-11126) A memory leak in SQLListener._stageIdToStageMetrics

[ https://issues.apache.org/jira/browse/SPARK-11126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-11126: --- Affects Version/s: 1.5.1 > A memory leak in SQLListener._stageIdToStageMetrics >

[jira] [Updated] (SPARK-11126) A memory leak in SQLListener._stageIdToStageMetrics

[ https://issues.apache.org/jira/browse/SPARK-11126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-11126: --- Priority: Critical (was: Major) > A memory leak in SQLListener._stageIdToStageMetrics >

[jira] [Updated] (SPARK-11126) A memory leak in SQLListener._stageIdToStageMetrics

[ https://issues.apache.org/jira/browse/SPARK-11126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-11126: --- Target Version/s: 1.5.2, 1.6.0 > A memory leak in SQLListener._stageIdToStageMetrics > --

[jira] [Updated] (SPARK-11158) Add more information in Error statment for sql/types _verify_type()

[ https://issues.apache.org/jira/browse/SPARK-11158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-11158: --- Assignee: Mahmoud Lababidi > Add more information in Error statment for sql/types _verify_type() > --

[jira] [Resolved] (SPARK-11158) Add more information in Error statment for sql/types _verify_type()

[ https://issues.apache.org/jira/browse/SPARK-11158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-11158. Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9149 [https://github.c

[jira] [Resolved] (SPARK-7300) The temporary generated direcotries are not cleaned while calling the insertinto api in dataframe

[ https://issues.apache.org/jira/browse/SPARK-7300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-7300. -- Resolution: Won't Fix > The temporary generated direcotries are not cleaned while calling the > insert

[jira] [Resolved] (SPARK-6639) Create a new script to start multiple masters

[ https://issues.apache.org/jira/browse/SPARK-6639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6639. -- Resolution: Won't Fix > Create a new script to start multiple masters >

[jira] [Resolved] (SPARK-9944) hive.metastore.warehouse.dir is not respected

[ https://issues.apache.org/jira/browse/SPARK-9944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-9944. -- Resolution: Won't Fix > hive.metastore.warehouse.dir is not respected >

[jira] [Resolved] (SPARK-10582) using dynamic-executor-allocation, if AM failed. the new AM will be started. But the new AM does not allocate executors to dirver

[ https://issues.apache.org/jira/browse/SPARK-10582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-10582. --- Resolution: Won't Fix > using dynamic-executor-allocation, if AM failed. the new AM will be started.

[jira] [Resolved] (SPARK-6478) new RDD.pipeWithPartition method

[ https://issues.apache.org/jira/browse/SPARK-6478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6478. -- Resolution: Won't Fix > new RDD.pipeWithPartition method > > >

[jira] [Resolved] (SPARK-6593) Provide option for HadoopRDD to skip corrupted files

[ https://issues.apache.org/jira/browse/SPARK-6593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6593. -- Resolution: Won't Fix > Provide option for HadoopRDD to skip corrupted files > -

[jira] [Resolved] (SPARK-11169) Remove the extra spaces in merge script

[ https://issues.apache.org/jira/browse/SPARK-11169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-11169. Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9156 [https://github.c

[jira] [Updated] (SPARK-11163) Remove unnecessary addPendingTask calls in TaskSetManager.executorLost

[ https://issues.apache.org/jira/browse/SPARK-11163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11163: -- Target Version/s: 1.5.2, 1.6.0 (was: 1.6.0) Fix Version/s: (was: 1.5.2)

[jira] [Resolved] (SPARK-11142) org.datanucleus is already registered

[ https://issues.apache.org/jira/browse/SPARK-11142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11142. --- Resolution: Fixed Fix Version/s: (was: 1.5.1) Target Version/s: (was: 1.5.1) [

[jira] [Resolved] (SPARK-11142) org.datanucleus is already registered

[ https://issues.apache.org/jira/browse/SPARK-11142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11142. --- Resolution: Invalid > org.datanucleus is already registered > - >

[jira] [Reopened] (SPARK-11142) org.datanucleus is already registered

[ https://issues.apache.org/jira/browse/SPARK-11142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reopened SPARK-11142: --- > org.datanucleus is already registered > - > > Key:

[jira] [Resolved] (SPARK-10893) Lag Analytic function broken

[ https://issues.apache.org/jira/browse/SPARK-10893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-10893. --- Resolution: Duplicate > Lag Analytic function broken > > >

[jira] [Updated] (SPARK-11174) Typo in the GraphX programming guide

[ https://issues.apache.org/jira/browse/SPARK-11174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11174: -- Assignee: Łukasz Piepiora > Typo in the GraphX programming guide >

[jira] [Resolved] (SPARK-11174) Typo in the GraphX programming guide

[ https://issues.apache.org/jira/browse/SPARK-11174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11174. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9160 [https://github.com

[jira] [Commented] (SPARK-10994) Local clustering coefficient computation in GraphX

[ https://issues.apache.org/jira/browse/SPARK-10994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14962359#comment-14962359 ] Sean Owen commented on SPARK-10994: --- My honest guess is that this will not be merged. P

[jira] [Assigned] (SPARK-11174) Typo in the GraphX programming guide

[ https://issues.apache.org/jira/browse/SPARK-11174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11174: Assignee: (was: Apache Spark) > Typo in the GraphX programming guide > ---

[jira] [Assigned] (SPARK-11174) Typo in the GraphX programming guide

[ https://issues.apache.org/jira/browse/SPARK-11174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11174: Assignee: Apache Spark > Typo in the GraphX programming guide > --

[jira] [Commented] (SPARK-11174) Typo in the GraphX programming guide

[ https://issues.apache.org/jira/browse/SPARK-11174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14962356#comment-14962356 ] Apache Spark commented on SPARK-11174: -- User 'lpiepiora' has created a pull request

[jira] [Commented] (SPARK-11162) Allow enabling debug logging from the command line

[ https://issues.apache.org/jira/browse/SPARK-11162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14962355#comment-14962355 ] Sean Owen commented on SPARK-11162: --- Isn't it already possible? that's what the thread

[jira] [Resolved] (SPARK-11161) Viewing the web UI for the first time unpersists a cached RDD

[ https://issues.apache.org/jira/browse/SPARK-11161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11161. --- Resolution: Not A Problem Good analysis. Yes, GC'ed RDDs are unpersisted. Given I'm 99% sure about th

[jira] [Resolved] (SPARK-11147) HTTP 500 if try to access Spark UI in yarn-cluster

[ https://issues.apache.org/jira/browse/SPARK-11147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11147. --- Resolution: Not A Problem > HTTP 500 if try to access Spark UI in yarn-cluster >

[jira] [Commented] (SPARK-11174) Typo in the GraphX programming guide

[ https://issues.apache.org/jira/browse/SPARK-11174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14962348#comment-14962348 ] Sean Owen commented on SPARK-11174: --- This isn't even worth a JIRA, but please open a pu

[jira] [Created] (SPARK-11174) Typo in the GraphX programming guide

Łukasz Piepiora created SPARK-11174: --- Summary: Typo in the GraphX programming guide Key: SPARK-11174 URL: https://issues.apache.org/jira/browse/SPARK-11174 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-11169) Remove the extra spaces in merge script

[ https://issues.apache.org/jira/browse/SPARK-11169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11169: -- Priority: Trivial (was: Major) > Remove the extra spaces in merge script > ---

[jira] [Resolved] (SPARK-11173) Cannot save data via MSSQL JDBC

[ https://issues.apache.org/jira/browse/SPARK-11173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11173. --- Resolution: Not A Problem This does not appear to be an issue from Spark. > Cannot save data via MSS

[jira] [Commented] (SPARK-10757) Java friendly constructor for distributed matrices

[ https://issues.apache.org/jira/browse/SPARK-10757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14962338#comment-14962338 ] Yizhi Liu commented on SPARK-10757: --- [~yanboliang] May I ask you to review my PR once y

[jira] [Assigned] (SPARK-10757) Java friendly constructor for distributed matrices

[ https://issues.apache.org/jira/browse/SPARK-10757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10757: Assignee: Apache Spark > Java friendly constructor for distributed matrices >

[jira] [Assigned] (SPARK-10757) Java friendly constructor for distributed matrices

[ https://issues.apache.org/jira/browse/SPARK-10757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10757: Assignee: (was: Apache Spark) > Java friendly constructor for distributed matrices > -

[jira] [Commented] (SPARK-10757) Java friendly constructor for distributed matrices

[ https://issues.apache.org/jira/browse/SPARK-10757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14962335#comment-14962335 ] Apache Spark commented on SPARK-10757: -- User 'javelinjs' has created a pull request

[jira] [Resolved] (SPARK-11172) Close JsonParser/Generator in test

[ https://issues.apache.org/jira/browse/SPARK-11172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-11172. Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9157 [https://github.c

[jira] [Updated] (SPARK-11172) Close JsonParser/Generator in test

[ https://issues.apache.org/jira/browse/SPARK-11172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-11172: --- Assignee: Ted Yu > Close JsonParser/Generator in test > -- > >

[jira] [Created] (SPARK-11173) Cannot save data via MSSQL JDBC

Gianluca Salvo created SPARK-11173: -- Summary: Cannot save data via MSSQL JDBC Key: SPARK-11173 URL: https://issues.apache.org/jira/browse/SPARK-11173 Project: Spark Issue Type: Bug

  1   2   >