[jira] [Commented] (SPARK-26821) filters not working with char datatype when querying against hive table

2019-02-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16760058#comment-16760058 ] Sean Owen commented on SPARK-26821: --- I don't know a lot about this, but assuming the padding behavior

[jira] [Resolved] (SPARK-26813) Consolidate java version across language compilers and build tools

2019-02-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26813. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23724

[jira] [Assigned] (SPARK-26813) Consolidate java version across language compilers and build tools

2019-02-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-26813: - Assignee: Chenxiao Mao > Consolidate java version across language compilers and build tools >

[jira] [Updated] (SPARK-26751) HiveSessionImpl might have memory leak since Operation do not close properly

2019-02-03 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-26751: -- Priority: Minor (was: Major) > HiveSessionImpl might have memory leak since Operation do not close

[jira] [Assigned] (SPARK-26751) HiveSessionImpl might have memory leak since Operation do not close properly

2019-02-03 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-26751: - Assignee: zhoukang > HiveSessionImpl might have memory leak since Operation do not close

[jira] [Resolved] (SPARK-26751) HiveSessionImpl might have memory leak since Operation do not close properly

2019-02-03 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26751. --- Resolution: Fixed Fix Version/s: 2.3.4 2.4.1 3.0.0

[jira] [Assigned] (SPARK-26805) Eliminate double checking of stringToDate and stringToTimestamp inputs

2019-02-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-26805: - Assignee: Maxim Gekk > Eliminate double checking of stringToDate and stringToTimestamp inputs

[jira] [Resolved] (SPARK-26805) Eliminate double checking of stringToDate and stringToTimestamp inputs

2019-02-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26805. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23717

[jira] [Resolved] (SPARK-26714) The job whose partiton num is zero not shown in WebUI

2019-02-01 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26714. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23637

[jira] [Assigned] (SPARK-26714) The job whose partiton num is zero not shown in WebUI

2019-02-01 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-26714: - Assignee: deshanxiao > The job whose partiton num is zero not shown in WebUI >

[jira] [Resolved] (SPARK-26771) Make .unpersist(), .destroy() consistently non-blocking by default

2019-02-01 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26771. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23685

[jira] [Assigned] (SPARK-26754) Add hasTrainingSummary to replace duplicate code in PySpark

2019-02-01 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-26754: - Assignee: Huaxin Gao > Add hasTrainingSummary to replace duplicate code in PySpark >

[jira] [Resolved] (SPARK-26754) Add hasTrainingSummary to replace duplicate code in PySpark

2019-02-01 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26754. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23676

[jira] [Resolved] (SPARK-26787) Fix standardization error message in WeightedLeastSquares

2019-01-31 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26787. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23705

[jira] [Updated] (SPARK-26795) Retry remote fileSegmentManagedBuffer when creating inputStream failed during shuffle read phase

2019-01-31 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-26795: -- Flags: (was: Patch) Target Version/s: (was: 2.3.2, 2.4.0) Fix Version/s:

[jira] [Assigned] (SPARK-26787) Fix standardization error message in WeightedLeastSquares

2019-01-31 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-26787: - Assignee: Brian Scannell > Fix standardization error message in WeightedLeastSquares >

[jira] [Resolved] (SPARK-25997) Python example code for Power Iteration Clustering in spark.ml

2019-01-31 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-25997. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 22996

[jira] [Assigned] (SPARK-25997) Python example code for Power Iteration Clustering in spark.ml

2019-01-31 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-25997: - Assignee: Huaxin Gao > Python example code for Power Iteration Clustering in spark.ml >

[jira] [Resolved] (SPARK-26757) GraphX EdgeRDDImpl and VertexRDDImpl `count` method cannot handle empty RDDs

2019-01-31 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26757. --- Resolution: Fixed Fix Version/s: 2.3.4 2.4.1 3.0.0

[jira] [Assigned] (SPARK-26757) GraphX EdgeRDDImpl and VertexRDDImpl `count` method cannot handle empty RDDs

2019-01-31 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-26757: - Assignee: Huon Wilson > GraphX EdgeRDDImpl and VertexRDDImpl `count` method cannot handle

[jira] [Updated] (SPARK-26803) include sbin subdirectory in pyspark

2019-01-31 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-26803: -- Shepherd: (was: Sean Owen) > include sbin subdirectory in pyspark >

[jira] [Commented] (SPARK-26154) Stream-stream joins - left outer join gives inconsistent output

2019-01-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16756716#comment-16756716 ] Sean Owen commented on SPARK-26154: --- Sure, it's a judgment call. If you see people contemplating it as

[jira] [Updated] (SPARK-26154) Stream-stream joins - left outer join gives inconsistent output

2019-01-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-26154: -- Labels: correctness (was: ) Priority: Critical (was: Major) [~kabhwan] I think everyone is

[jira] [Updated] (SPARK-26771) Make .unpersist(), .destroy() consistently non-blocking by default

2019-01-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-26771: -- Docs Text: The RDD and DataFrame .unpersist() method, and Broadcast .destroy() method, take an

[jira] [Resolved] (SPARK-11215) Add multiple columns support to StringIndexer

2019-01-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11215. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 20146

[jira] [Updated] (SPARK-26771) Make .unpersist(), .destroy() consistently non-blocking by default

2019-01-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-26771: -- Docs Text: The RDD and DataFrame .unpersist() method, and Broadcast .destroy() method, take an

[jira] [Updated] (SPARK-11215) Add multiple columns support to StringIndexer

2019-01-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11215: -- Docs Text: When specifying frequencyDesc or frequencyAsc as stringOrderType param in

[jira] [Commented] (SPARK-24959) Do not invoke the CSV/JSON parser for empty schema

2019-01-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16755088#comment-16755088 ] Sean Owen commented on SPARK-24959: --- Looks like this may need to be reverted:

[jira] [Resolved] (SPARK-26728) Make rdd.unpersist blocking configurable

2019-01-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26728. --- Resolution: Won't Fix Closing this in favor of https://issues.apache.org/jira/browse/SPARK-26728 >

[jira] [Comment Edited] (SPARK-26728) Make rdd.unpersist blocking configurable

2019-01-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16755069#comment-16755069 ] Sean Owen edited comment on SPARK-26728 at 1/29/19 2:45 PM: Closing this in

[jira] [Created] (SPARK-26771) Make .unpersist(), .destroy() consistently non-blocking by default

2019-01-29 Thread Sean Owen (JIRA)
Sean Owen created SPARK-26771: - Summary: Make .unpersist(), .destroy() consistently non-blocking by default Key: SPARK-26771 URL: https://issues.apache.org/jira/browse/SPARK-26771 Project: Spark

[jira] [Commented] (SPARK-26651) Use Proleptic Gregorian calendar

2019-01-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16754438#comment-16754438 ] Sean Owen commented on SPARK-26651: --- You can just tag this with release-notes and add release notes

[jira] [Assigned] (SPARK-26713) PipedRDD may holds stdin writer and stdout read threads even if the task is finished

2019-01-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-26713: - Assignee: Xianjin YE > PipedRDD may holds stdin writer and stdout read threads even if the

[jira] [Resolved] (SPARK-26713) PipedRDD may holds stdin writer and stdout read threads even if the task is finished

2019-01-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26713. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23638

[jira] [Assigned] (SPARK-26651) Use Proleptic Gregorian calendar

2019-01-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-26651: - Assignee: Maxim Gekk > Use Proleptic Gregorian calendar > > >

[jira] [Assigned] (SPARK-26719) Get rid of java.util.Calendar in DateTimeUtils

2019-01-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-26719: - Assignee: Maxim Gekk > Get rid of java.util.Calendar in DateTimeUtils >

[jira] [Resolved] (SPARK-26719) Get rid of java.util.Calendar in DateTimeUtils

2019-01-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26719. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23641

[jira] [Assigned] (SPARK-26698) Use ConfigEntry for hardcoded configs for memory and storage categories

2019-01-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-26698: - Assignee: SongYadong > Use ConfigEntry for hardcoded configs for memory and storage categories

[jira] [Resolved] (SPARK-26698) Use ConfigEntry for hardcoded configs for memory and storage categories

2019-01-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26698. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23623

[jira] [Resolved] (SPARK-26442) Use ConfigEntry for hardcoded configs.

2019-01-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26442. --- Resolution: Done > Use ConfigEntry for hardcoded configs. > --

[jira] [Updated] (SPARK-26698) Use ConfigEntry for hardcoded configs for memory and storage categories

2019-01-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-26698: -- Issue Type: Sub-task (was: Improvement) Parent: SPARK-26442 > Use ConfigEntry for hardcoded

[jira] [Commented] (SPARK-26721) Bug in feature importance calculation in GBM (and possibly other decision tree classifiers)

2019-01-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16752905#comment-16752905 ] Sean Owen commented on SPARK-26721: --- I would not call it a Blocker, but I'd welcome a pull request to

[jira] [Resolved] (SPARK-23385) Allow SparkUITab to be customized adding in SparkConf and loaded when creating SparkUI

2019-01-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-23385. --- Resolution: Won't Fix > Allow SparkUITab to be customized adding in SparkConf and loaded when >

[jira] [Updated] (SPARK-26731) remove EOLed spark jobs from jenkins

2019-01-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-26731: -- Target Version/s: 3.0.0 Priority: Major (was: Critical) Let's, eh, delete them when 3.0

[jira] [Resolved] (SPARK-26710) ImageSchemaSuite has some errors when running it in local laptop

2019-01-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26710. --- Resolution: Not A Problem > ImageSchemaSuite has some errors when running it in local laptop >

[jira] [Assigned] (SPARK-26725) Fix the input values of UnifiedMemoryManager constructor in test suites

2019-01-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-26725: - Assignee: Sean Owen > Fix the input values of UnifiedMemoryManager constructor in test suites

[jira] [Updated] (SPARK-26725) Fix the input values of UnifiedMemoryManager constructor in test suites

2019-01-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-26725: -- Priority: Minor (was: Major) > Fix the input values of UnifiedMemoryManager constructor in test

[jira] [Resolved] (SPARK-19591) Add sample weights to decision trees

2019-01-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-19591. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 21632

[jira] [Resolved] (SPARK-25101) Creating leaderLatch with id for getting info about spark master nodes from zk

2019-01-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-25101. --- Resolution: Won't Fix > Creating leaderLatch with id for getting info about spark master nodes from

[jira] [Resolved] (SPARK-26681) Support Ammonite scopes in OuterScopes

2019-01-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26681. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23607

[jira] [Resolved] (SPARK-26660) Add warning logs for large taskBinary size

2019-01-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26660. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23580

[jira] [Assigned] (SPARK-26660) Add warning logs for large taskBinary size

2019-01-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-26660: - Assignee: liupengcheng > Add warning logs for large taskBinary size >

[jira] [Assigned] (SPARK-26681) Support Ammonite scopes in OuterScopes

2019-01-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-26681: - Assignee: Ryan Blue > Support Ammonite scopes in OuterScopes >

[jira] [Assigned] (SPARK-26228) OOM issue encountered when computing Gramian matrix

2019-01-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-26228: - Assignee: Sean Owen > OOM issue encountered when computing Gramian matrix >

[jira] [Resolved] (SPARK-26228) OOM issue encountered when computing Gramian matrix

2019-01-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26228. --- Resolution: Fixed Fix Version/s: 2.3.4 2.4.1 3.0.0

[jira] [Resolved] (SPARK-24484) Power Iteration Clustering is giving incorrect clustering results when there are mutiple leading eigen values.

2019-01-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-24484. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 21627

[jira] [Assigned] (SPARK-24484) Power Iteration Clustering is giving incorrect clustering results when there are mutiple leading eigen values.

2019-01-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-24484: - Assignee: shahid > Power Iteration Clustering is giving incorrect clustering results when

[jira] [Assigned] (SPARK-16838) Add PMML export for ML KMeans in PySpark

2019-01-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-16838: - Assignee: Huaxin Gao > Add PMML export for ML KMeans in PySpark >

[jira] [Resolved] (SPARK-16838) Add PMML export for ML KMeans in PySpark

2019-01-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-16838. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23592

[jira] [Updated] (SPARK-24938) Understand usage of netty's onheap memory use, even with offheap pools

2019-01-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-24938: -- Priority: Minor (was: Major) > Understand usage of netty's onheap memory use, even with offheap

[jira] [Resolved] (SPARK-24938) Understand usage of netty's onheap memory use, even with offheap pools

2019-01-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-24938. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 22114

[jira] [Assigned] (SPARK-24938) Understand usage of netty's onheap memory use, even with offheap pools

2019-01-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-24938: - Assignee: Nihar Sheth > Understand usage of netty's onheap memory use, even with offheap pools

[jira] [Resolved] (SPARK-26463) Use ConfigEntry for hardcoded configs for scheduler categories.

2019-01-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26463. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23416

[jira] [Assigned] (SPARK-26463) Use ConfigEntry for hardcoded configs for scheduler categories.

2019-01-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-26463: - Assignee: Kazuaki Ishizaki > Use ConfigEntry for hardcoded configs for scheduler categories. >

[jira] [Resolved] (SPARK-26616) Expose document frequency in IDFModel

2019-01-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26616. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23549

[jira] [Assigned] (SPARK-26616) Expose document frequency in IDFModel

2019-01-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-26616: - Assignee: Jatin Puri > Expose document frequency in IDFModel >

[jira] [Updated] (SPARK-25713) Implement copy() for ColumnarArray

2019-01-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-25713: -- Priority: Minor (was: Major) > Implement copy() for ColumnarArray >

[jira] [Updated] (SPARK-26228) OOM issue encountered when computing Gramian matrix

2019-01-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-26228: -- Issue Type: Bug (was: Improvement) > OOM issue encountered when computing Gramian matrix >

[jira] [Commented] (SPARK-26228) OOM issue encountered when computing Gramian matrix

2019-01-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16747603#comment-16747603 ] Sean Owen commented on SPARK-26228: --- Yep this is a real problem. The issue is the 'zeroValue" to

[jira] [Resolved] (SPARK-26351) Documented formula of precision at k does not match the actual code

2019-01-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26351. --- Resolution: Fixed Fix Version/s: 2.3.4 2.4.1 3.0.0

[jira] [Resolved] (SPARK-26662) Dispose off-heap memory when MemoryStore is cleared

2019-01-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26662. --- Resolution: Won't Fix > Dispose off-heap memory when MemoryStore is cleared >

[jira] [Resolved] (SPARK-25720) Support auto refresh page for the WEBUI

2019-01-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-25720. --- Resolution: Won't Fix > Support auto refresh page for the WEBUI >

[jira] [Assigned] (SPARK-26351) Documented formula of precision at k does not match the actual code

2019-01-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-26351: - Assignee: shahid Priority: Minor (was: Major) > Documented formula of precision at k does

[jira] [Updated] (SPARK-26638) Pyspark vector classes always return error for unary negation

2019-01-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-26638: -- Fix Version/s: (was: 2.3.3) 2.3.4 > Pyspark vector classes always return error

[jira] [Resolved] (SPARK-26640) Code cleanup from lgtm.com analysis

2019-01-17 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26640. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23571

[jira] [Resolved] (SPARK-26638) Pyspark vector classes always return error for unary negation

2019-01-17 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26638. --- Resolution: Fixed Fix Version/s: 2.4.1 3.0.0 2.3.3

[jira] [Resolved] (SPARK-26621) Use ConfigEntry for hardcoded configs for shuffle categories.

2019-01-17 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26621. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23550

[jira] [Assigned] (SPARK-26621) Use ConfigEntry for hardcoded configs for shuffle categories.

2019-01-17 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-26621: - Assignee: liuxian > Use ConfigEntry for hardcoded configs for shuffle categories. >

[jira] [Resolved] (SPARK-26457) Show hadoop configurations in HistoryServer environment tab

2019-01-17 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26457. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23486

[jira] [Assigned] (SPARK-26457) Show hadoop configurations in HistoryServer environment tab

2019-01-17 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-26457: - Assignee: deshanxiao > Show hadoop configurations in HistoryServer environment tab >

[jira] [Assigned] (SPARK-26466) Use ConfigEntry for hardcoded configs for submit categories.

2019-01-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-26466: - Assignee: Jungtaek Lim > Use ConfigEntry for hardcoded configs for submit categories. >

[jira] [Resolved] (SPARK-26466) Use ConfigEntry for hardcoded configs for submit categories.

2019-01-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26466. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23532

[jira] [Assigned] (SPARK-26600) Update spark-submit usage message

2019-01-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-26600: - Assignee: Luca Canali > Update spark-submit usage message > -

[jira] [Resolved] (SPARK-26600) Update spark-submit usage message

2019-01-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26600. --- Resolution: Fixed Issue resolved by pull request 23518 [https://github.com/apache/spark/pull/23518]

[jira] [Created] (SPARK-26640) Code cleanup from lgtm.com analysis

2019-01-16 Thread Sean Owen (JIRA)
Sean Owen created SPARK-26640: - Summary: Code cleanup from lgtm.com analysis Key: SPARK-26640 URL: https://issues.apache.org/jira/browse/SPARK-26640 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-26638) Pyspark vector classes always return error for unary negation

2019-01-16 Thread Sean Owen (JIRA)
Sean Owen created SPARK-26638: - Summary: Pyspark vector classes always return error for unary negation Key: SPARK-26638 URL: https://issues.apache.org/jira/browse/SPARK-26638 Project: Spark

[jira] [Resolved] (SPARK-26615) Fixing transport server/client resource leaks in the core unittests

2019-01-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26615. --- Resolution: Fixed Fix Version/s: 2.4.1 3.0.0 Issue resolved by pull

[jira] [Assigned] (SPARK-26615) Fixing transport server/client resource leaks in the core unittests

2019-01-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-26615: - Assignee: Attila Zsolt Piros > Fixing transport server/client resource leaks in the core

[jira] [Assigned] (SPARK-17928) No driver.memoryOverhead setting for mesos cluster mode

2019-01-15 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-17928: - Assignee: Devaraj K > No driver.memoryOverhead setting for mesos cluster mode >

[jira] [Resolved] (SPARK-17928) No driver.memoryOverhead setting for mesos cluster mode

2019-01-15 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-17928. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 17726

[jira] [Assigned] (SPARK-26462) Use ConfigEntry for hardcoded configs for execution categories.

2019-01-15 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-26462: - Assignee: pralabhkumar > Use ConfigEntry for hardcoded configs for execution categories. >

[jira] [Resolved] (SPARK-26462) Use ConfigEntry for hardcoded configs for execution categories.

2019-01-15 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26462. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23447

[jira] [Resolved] (SPARK-26613) Add another rename table grammar for spark sql

2019-01-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26613. --- Resolution: Won't Fix > Add another rename table grammar for spark sql >

[jira] [Assigned] (SPARK-23182) Allow enabling of TCP keep alive for RPC connections

2019-01-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-23182: - Assignee: Petar Petrov > Allow enabling of TCP keep alive for RPC connections >

[jira] [Resolved] (SPARK-23182) Allow enabling of TCP keep alive for RPC connections

2019-01-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-23182. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 20512

[jira] [Updated] (SPARK-23182) Allow enabling of TCP keep alive for RPC connections

2019-01-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-23182: -- Summary: Allow enabling of TCP keep alive for RPC connections (was: Allow enabling of TCP keep alive

[jira] [Updated] (SPARK-23182) Allow enabling of TCP keep alive for RPC connections

2019-01-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-23182: -- Priority: Minor (was: Major) > Allow enabling of TCP keep alive for RPC connections >

[jira] [Resolved] (SPARK-26564) Fix wrong assertions and error messages for parameter checking

2019-01-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26564. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23488

[jira] [Resolved] (SPARK-26503) Get rid of spark.sql.legacy.timeParser.enabled

2019-01-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26503. --- Resolution: Fixed Fix Version/s: 3.0.0 Resolved by

[jira] [Reopened] (SPARK-26503) Get rid of spark.sql.legacy.timeParser.enabled

2019-01-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reopened SPARK-26503: --- > Get rid of spark.sql.legacy.timeParser.enabled > -- > >

<    5   6   7   8   9   10   11   12   13   14   >