[jira] [Created] (SPARK-28066) Optimize UTF8String.trim() for common case of no whitespace

2019-06-16 Thread Sean Owen (JIRA)
Sean Owen created SPARK-28066: - Summary: Optimize UTF8String.trim() for common case of no whitespace Key: SPARK-28066 URL: https://issues.apache.org/jira/browse/SPARK-28066 Project: Spark Issue

[jira] [Updated] (SPARK-21882) OutputMetrics doesn't count written bytes correctly in the saveAsHadoopDataset function

2019-06-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-21882: -- Labels: (was: bulk-closed) > OutputMetrics doesn't count written bytes correctly in the >

[jira] [Reopened] (SPARK-21882) OutputMetrics doesn't count written bytes correctly in the saveAsHadoopDataset function

2019-06-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reopened SPARK-21882: --- > OutputMetrics doesn't count written bytes correctly in the > saveAsHadoopDataset function >

[jira] [Resolved] (SPARK-21882) OutputMetrics doesn't count written bytes correctly in the saveAsHadoopDataset function

2019-06-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21882. --- Resolution: Fixed Fix Version/s: 3.0.0 2.4.4 2.3.4

[jira] [Assigned] (SPARK-21882) OutputMetrics doesn't count written bytes correctly in the saveAsHadoopDataset function

2019-06-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-21882: - Assignee: linxiaojun > OutputMetrics doesn't count written bytes correctly in the >

[jira] [Assigned] (SPARK-16692) multilabel classification to DataFrame, ML

2019-06-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-16692: - Assignee: zhengruifeng > multilabel classification to DataFrame, ML >

[jira] [Resolved] (SPARK-16692) multilabel classification to DataFrame, ML

2019-06-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-16692. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24777

[jira] [Updated] (SPARK-28004) Update jquery to 3.4.1

2019-06-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-28004: -- Description: We're using an old-ish jQuery, 1.12.4, and should probably update for Spark 3 to keep

[jira] [Created] (SPARK-28004) Update jquery to 3.4.1

2019-06-11 Thread Sean Owen (JIRA)
Sean Owen created SPARK-28004: - Summary: Update jquery to 3.4.1 Key: SPARK-28004 URL: https://issues.apache.org/jira/browse/SPARK-28004 Project: Spark Issue Type: Improvement

[jira] [Reopened] (SPARK-27258) The value of "spark.app.name" or "--name" starts with number , which causes resourceName does not match regular expression

2019-06-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reopened SPARK-27258: --- > The value of "spark.app.name" or "--name" starts with number , which causes > resourceName does not

[jira] [Resolved] (SPARK-27872) Driver and executors use a different service account breaking pull secrets

2019-06-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27872. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24748

[jira] [Assigned] (SPARK-27872) Driver and executors use a different service account breaking pull secrets

2019-06-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-27872: - Assignee: Stavros Kontopoulos > Driver and executors use a different service account breaking

[jira] [Commented] (SPARK-27932) Update jackson versions on 2.4.x and 2.3.x branches

2019-06-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16858630#comment-16858630 ] Sean Owen commented on SPARK-27932: --- I don't see how you can update to 2.7.x and not get the behavior

[jira] [Assigned] (SPARK-27973) Streaming sample DirectKafkaWordCount should mention GroupId in usage

2019-06-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-27973: - Assignee: Yuexin Zhang > Streaming sample DirectKafkaWordCount should mention GroupId in usage

[jira] [Resolved] (SPARK-27973) Streaming sample DirectKafkaWordCount should mention GroupId in usage

2019-06-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27973. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24819

[jira] [Updated] (SPARK-27973) Streaming sample DirectKafkaWordCount should mention GroupId in usage

2019-06-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-27973: -- Priority: Trivial (was: Minor) (This is too trivial for a JIRA; the description and fix are all but

[jira] [Commented] (SPARK-26896) Add maven profiles for running tests with JDK 11

2019-06-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16857843#comment-16857843 ] Sean Owen commented on SPARK-26896: --- BTW should we close this? I don't think we need a new profile. >

[jira] [Resolved] (SPARK-27704) Change default class loader to ParallelGC

2019-06-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27704. --- Resolution: Not A Problem Do you mean garbage collector? the user can already choose the GC by

[jira] [Resolved] (SPARK-15015) Log statements lack file name/number

2019-06-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-15015. --- Resolution: Auto Closed We're not going to reopen these unless there's a material change, like

[jira] [Commented] (SPARK-20856) support statement using nested joins

2019-06-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16857719#comment-16857719 ] Sean Owen commented on SPARK-20856: --- We're not going to reopen these unless there's a material change,

[jira] [Resolved] (SPARK-20856) support statement using nested joins

2019-06-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-20856. --- Resolution: Auto Closed We're not going to reopen these unless there's a material change, like

[jira] [Updated] (SPARK-21136) Misleading error message for typo in SQL

2019-06-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-21136: -- Priority: Minor (was: Critical) > Misleading error message for typo in SQL >

[jira] [Resolved] (SPARK-27933) Extracting common purge "behaviour" to the parent StreamExecution

2019-06-05 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27933. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24781

[jira] [Assigned] (SPARK-27933) Extracting common purge "behaviour" to the parent StreamExecution

2019-06-05 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-27933: - Assignee: Jacek Laskowski > Extracting common purge "behaviour" to the parent StreamExecution

[jira] [Resolved] (SPARK-27772) SQLTestUtils Refactoring

2019-06-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27772. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24747

[jira] [Assigned] (SPARK-27772) SQLTestUtils Refactoring

2019-06-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-27772: - Assignee: William Wong > SQLTestUtils Refactoring > > >

[jira] [Updated] (SPARK-18569) Support R formula arithmetic

2019-06-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-18569: -- Affects Version/s: 2.4.3 Issue Type: Improvement (was: Sub-task) Parent:

[jira] [Resolved] (SPARK-18570) Consider supporting other R formula operators

2019-06-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-18570. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24764

[jira] [Assigned] (SPARK-18570) Consider supporting other R formula operators

2019-06-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-18570: - Assignee: Ozan Cicekci > Consider supporting other R formula operators >

[jira] [Resolved] (SPARK-27847) One-Pass MultilabelMetrics & MulticlassMetrics

2019-06-01 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27847. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24717

[jira] [Assigned] (SPARK-27847) One-Pass MultilabelMetrics & MulticlassMetrics

2019-06-01 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-27847: - Assignee: zhengruifeng > One-Pass MultilabelMetrics & MulticlassMetrics >

[jira] [Updated] (SPARK-27847) One-Pass MultilabelMetrics & MulticlassMetrics

2019-06-01 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-27847: -- Priority: Minor (was: Major) > One-Pass MultilabelMetrics & MulticlassMetrics >

[jira] [Assigned] (SPARK-27811) Docs of spark.driver.memoryOverhead and spark.executor.memoryOverhead exists a little ambiguity

2019-06-01 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-27811: - Assignee: jiaan.geng > Docs of spark.driver.memoryOverhead and spark.executor.memoryOverhead

[jira] [Resolved] (SPARK-27811) Docs of spark.driver.memoryOverhead and spark.executor.memoryOverhead exists a little ambiguity

2019-06-01 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27811. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24671

[jira] [Updated] (SPARK-27811) Docs of spark.driver.memoryOverhead and spark.executor.memoryOverhead exists a little ambiguity

2019-06-01 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-27811: -- Priority: Trivial (was: Major) > Docs of spark.driver.memoryOverhead and

[jira] [Commented] (SPARK-27896) Fix definition of clustering silhouette coefficient for 1-element clusters

2019-05-31 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16852962#comment-16852962 ] Sean Owen commented on SPARK-27896: --- Copying follow up from email: Yes the paper does say the

[jira] [Created] (SPARK-27896) Fix definition of clustering silhouette coefficient for 1-element clusters

2019-05-31 Thread Sean Owen (JIRA)
Sean Owen created SPARK-27896: - Summary: Fix definition of clustering silhouette coefficient for 1-element clusters Key: SPARK-27896 URL: https://issues.apache.org/jira/browse/SPARK-27896 Project: Spark

[jira] [Assigned] (SPARK-27862) Upgrade json4s-jackson to 3.6.6

2019-05-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-27862: - Assignee: Izek Greenfield > Upgrade json4s-jackson to 3.6.6 > ---

[jira] [Resolved] (SPARK-27862) Upgrade json4s-jackson to 3.6.6

2019-05-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27862. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24736

[jira] [Commented] (SPARK-27886) Add Apache Spark project to https://python3statement.org/

2019-05-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16852166#comment-16852166 ] Sean Owen commented on SPARK-27886: --- Maybe I misunderstand, but if it's likely Python 2 goes away from

[jira] [Commented] (SPARK-27884) Deprecate Python 2 support in Spark 3.0

2019-05-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16852149#comment-16852149 ] Sean Owen commented on SPARK-27884: --- Yes that looks fine to me. > Deprecate Python 2 support in Spark

[jira] [Updated] (SPARK-27757) Bump Jackson to 2.9.9

2019-05-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-27757: -- Priority: Minor (was: Major) > Bump Jackson to 2.9.9 > - > >

[jira] [Resolved] (SPARK-27757) Bump Jackson to 2.9.9

2019-05-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27757. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24646

[jira] [Assigned] (SPARK-27757) Bump Jackson to 2.9.9

2019-05-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-27757: - Assignee: Fokko Driesprong > Bump Jackson to 2.9.9 > - > >

[jira] [Resolved] (SPARK-26872) Use a configurable value for final termination in the JobScheduler.stop() method

2019-05-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26872. --- Resolution: Won't Fix > Use a configurable value for final termination in the JobScheduler.stop()

[jira] [Resolved] (SPARK-27584) Add 'Mean reciprocal rank' to RankingMetrics

2019-05-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27584. --- Resolution: Won't Fix > Add 'Mean reciprocal rank' to RankingMetrics >

[jira] [Resolved] (SPARK-27084) Add function alias for Bitwise functions

2019-05-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27084. --- Resolution: Won't Fix > Add function alias for Bitwise functions >

[jira] [Resolved] (SPARK-27434) memory leak in spark driver

2019-05-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27434. --- Resolution: Cannot Reproduce > memory leak in spark driver > --- > >

[jira] [Resolved] (SPARK-27657) ml.util.Instrumentation.logFailure doesn't log error message

2019-05-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27657. --- Resolution: Fixed Fix Version/s: 2.4.4 3.0.0 Issue resolved by pull

[jira] [Assigned] (SPARK-27657) ml.util.Instrumentation.logFailure doesn't log error message

2019-05-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-27657: - Assignee: Wesley Tang > ml.util.Instrumentation.logFailure doesn't log error message >

[jira] [Updated] (SPARK-27657) ml.util.Instrumentation.logFailure doesn't log error message

2019-05-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-27657: -- Target Version/s: 2.4.4, 3.0.0 (was: 3.0.0) > ml.util.Instrumentation.logFailure doesn't log error

[jira] [Updated] (SPARK-27657) ml.util.Instrumentation.logFailure doesn't log error message

2019-05-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-27657: -- Target Version/s: 3.0.0 (was: 2.4.4, 3.0.0) > ml.util.Instrumentation.logFailure doesn't log error

[jira] [Updated] (SPARK-27657) ml.util.Instrumentation.logFailure doesn't log error message

2019-05-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-27657: -- Priority: Minor (was: Major) > ml.util.Instrumentation.logFailure doesn't log error message >

[jira] [Resolved] (SPARK-27776) Avoid duplicate Java reflection in DataSource

2019-05-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27776. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24647

[jira] [Assigned] (SPARK-27776) Avoid duplicate Java reflection in DataSource

2019-05-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-27776: - Assignee: jiaan.geng > Avoid duplicate Java reflection in DataSource >

[jira] [Resolved] (SPARK-27852) One updateBytesWritten operaton may be missed in DiskBlockObjectWriter.scala

2019-05-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27852. --- Resolution: Not A Problem > One updateBytesWritten operaton may be missed in

[jira] [Assigned] (SPARK-27777) Eliminate uncessary sliding job in AreaUnderCurve

2019-05-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-2: - Assignee: zhengruifeng > Eliminate uncessary sliding job in AreaUnderCurve >

[jira] [Resolved] (SPARK-27777) Eliminate uncessary sliding job in AreaUnderCurve

2019-05-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-2. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24648

[jira] [Updated] (SPARK-27776) Avoid duplicate Java reflection in DataSource

2019-05-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-27776: -- Priority: Trivial (was: Minor) > Avoid duplicate Java reflection in DataSource >

[jira] [Commented] (SPARK-13182) Spark Executor retries infinitely

2019-05-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16848904#comment-16848904 ] Sean Owen commented on SPARK-13182: --- On its face that sounds like a YARN-related issue. Rescheduling a

[jira] [Updated] (SPARK-27787) Eliminate uncessary job to compute SSreg

2019-05-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-27787: -- Fix Version/s: (was: 3.1.0) 3.0.0 > Eliminate uncessary job to compute SSreg >

[jira] [Resolved] (SPARK-27787) Eliminate uncessary job to compute SSreg

2019-05-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27787. --- Resolution: Fixed Fix Version/s: 3.1.0 Issue resolved by pull request 24656

[jira] [Assigned] (SPARK-27787) Eliminate uncessary job to compute SSreg

2019-05-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-27787: - Assignee: zhengruifeng > Eliminate uncessary job to compute SSreg >

[jira] [Commented] (SPARK-26045) Error in the spark 2.4 release package with the spark-avro_2.11 depdency

2019-05-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16845832#comment-16845832 ] Sean Owen commented on SPARK-26045: --- Yes this is consistent with the thread on dev@ yesterday. It's

[jira] [Created] (SPARK-27796) Remove obsolete spark-mesos Docker image

2019-05-21 Thread Sean Owen (JIRA)
Sean Owen created SPARK-27796: - Summary: Remove obsolete spark-mesos Docker image Key: SPARK-27796 URL: https://issues.apache.org/jira/browse/SPARK-27796 Project: Spark Issue Type: Task

[jira] [Created] (SPARK-27794) Use secure URLs for downloading CRAN artifacts

2019-05-21 Thread Sean Owen (JIRA)
Sean Owen created SPARK-27794: - Summary: Use secure URLs for downloading CRAN artifacts Key: SPARK-27794 URL: https://issues.apache.org/jira/browse/SPARK-27794 Project: Spark Issue Type:

[jira] [Commented] (SPARK-27758) Features won't generate after 1M rows

2019-05-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16843895#comment-16843895 ] Sean Owen commented on SPARK-27758: --- This was closed anyway as you'd have to report something vs a

[jira] [Commented] (SPARK-27758) Features won't generate after 1M rows

2019-05-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16843361#comment-16843361 ] Sean Owen commented on SPARK-27758: --- This should clarify what you mean when you say features won't be

[jira] [Resolved] (SPARK-27552) The configuration `hive.exec.stagingdir` is invalid on Windows OS

2019-05-17 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27552. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24446

[jira] [Assigned] (SPARK-27552) The configuration `hive.exec.stagingdir` is invalid on Windows OS

2019-05-17 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-27552: - Assignee: liuxian > The configuration `hive.exec.stagingdir` is invalid on Windows OS >

[jira] [Resolved] (SPARK-27718) incorrect result from pagerank

2019-05-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27718. --- Resolution: Not A Problem > incorrect result from pagerank > -- > >

[jira] [Updated] (SPARK-27718) incorrect result from pagerank

2019-05-15 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-27718: -- Target Version/s: (was: 2.4.3) Priority: Minor (was: Major) Fix Version/s:

[jira] [Resolved] (SPARK-27682) Avoid use of Scala collection classes that are removed in 2.13

2019-05-15 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27682. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24586

[jira] [Resolved] (SPARK-27680) Remove usage of Traversable

2019-05-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27680. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24584

[jira] [Assigned] (SPARK-25719) Search functionality in datatables in stages page should search over formatted data rather than the raw data

2019-05-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-25719: - Assignee: Parth Gandhi > Search functionality in datatables in stages page should search over

[jira] [Resolved] (SPARK-25719) Search functionality in datatables in stages page should search over formatted data rather than the raw data

2019-05-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-25719. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24419

[jira] [Commented] (SPARK-27681) Use scala.collection.Seq explicitly instead of scala.Seq alias

2019-05-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16838781#comment-16838781 ] Sean Owen commented on SPARK-27681: --- You're right, the change is kinda breaking! we can just accept

[jira] [Updated] (SPARK-27681) Use scala.collection.Seq explicitly instead of scala.Seq alias

2019-05-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-27681: -- Description: {{scala.Seq}} is widely used in the code, and is an alias for {{scala.collection.Seq}}

[jira] [Commented] (SPARK-27681) Use scala.collection.Seq explicitly instead of scala.Seq alias

2019-05-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16838744#comment-16838744 ] Sean Owen commented on SPARK-27681: --- OK, take it down a notch; we are largely in agreement, but

[jira] [Commented] (SPARK-27683) Remove usage of TraversableOnce

2019-05-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16838582#comment-16838582 ] Sean Owen commented on SPARK-27683: --- Yeah if it comes to defining two source trees we can do that; was

[jira] [Resolved] (SPARK-27343) Use ConfigEntry for hardcoded configs for spark-sql-kafka

2019-05-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27343. --- Resolution: Fixed Fix Version/s: 3.1.0 Issue resolved by pull request 24574

[jira] [Updated] (SPARK-27343) Use ConfigEntry for hardcoded configs for spark-sql-kafka

2019-05-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-27343: -- Fix Version/s: (was: 3.1.0) 3.0.0 > Use ConfigEntry for hardcoded configs for

[jira] [Assigned] (SPARK-27343) Use ConfigEntry for hardcoded configs for spark-sql-kafka

2019-05-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-27343: - Assignee: hehuiyuan > Use ConfigEntry for hardcoded configs for spark-sql-kafka >

[jira] [Commented] (SPARK-27683) Remove usage of TraversableOnce

2019-05-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16838092#comment-16838092 ] Sean Owen commented on SPARK-27683: --- Yeah I mentioned that above -- I don't think it helps as it still

[jira] [Commented] (SPARK-27683) Remove usage of TraversableOnce

2019-05-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16837967#comment-16837967 ] Sean Owen commented on SPARK-27683: --- There are many usages of TraversableOnce, though many are in

[jira] [Created] (SPARK-27683) Remove usage of TraversableOnce

2019-05-11 Thread Sean Owen (JIRA)
Sean Owen created SPARK-27683: - Summary: Remove usage of TraversableOnce Key: SPARK-27683 URL: https://issues.apache.org/jira/browse/SPARK-27683 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-27681) Use scala.collection.Seq explicitly instead of scala.Seq alias

2019-05-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16837907#comment-16837907 ] Sean Owen commented on SPARK-27681: --- One last thought for now ... when {{Seq}} becomes {{immutable}}

[jira] [Commented] (SPARK-27682) Avoid use of Scala collection classes that are removed in 2.13

2019-05-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16837906#comment-16837906 ] Sean Owen commented on SPARK-27682: --- Looks like we can replace usages of removed collections mentioned

[jira] [Updated] (SPARK-27682) Avoid use of Scala collection classes that are removed in 2.13

2019-05-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-27682: -- Priority: Minor (was: Major) > Avoid use of Scala collection classes that are removed in 2.13 >

[jira] [Commented] (SPARK-27681) Use scala.collection.Seq explicitly instead of scala.Seq alias

2019-05-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16837854#comment-16837854 ] Sean Owen commented on SPARK-27681: --- I don't think it would change source compatibility; {{scala.Seq}}

[jira] [Commented] (SPARK-27681) Use scala.collection.Seq explicitly instead of scala.Seq alias

2019-05-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16837751#comment-16837751 ] Sean Owen commented on SPARK-27681: --- To my understanding, we don't need to do this until we support

[jira] [Created] (SPARK-27680) Remove usage of Traversable

2019-05-10 Thread Sean Owen (JIRA)
Sean Owen created SPARK-27680: - Summary: Remove usage of Traversable Key: SPARK-27680 URL: https://issues.apache.org/jira/browse/SPARK-27680 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-27682) Avoid use of Scala collection classes that are removed in 2.13

2019-05-10 Thread Sean Owen (JIRA)
Sean Owen created SPARK-27682: - Summary: Avoid use of Scala collection classes that are removed in 2.13 Key: SPARK-27682 URL: https://issues.apache.org/jira/browse/SPARK-27682 Project: Spark

[jira] [Created] (SPARK-27681) Use scala.collection.Seq explicitly instead of scala.Seq alias

2019-05-10 Thread Sean Owen (JIRA)
Sean Owen created SPARK-27681: - Summary: Use scala.collection.Seq explicitly instead of scala.Seq alias Key: SPARK-27681 URL: https://issues.apache.org/jira/browse/SPARK-27681 Project: Spark

[jira] [Commented] (SPARK-25075) Build and test Spark against Scala 2.13

2019-05-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16837516#comment-16837516 ] Sean Owen commented on SPARK-25075: --- OK, so we can possibly defer this by waiting until 2.13 support

[jira] [Commented] (SPARK-25075) Build and test Spark against Scala 2.13

2019-05-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16837299#comment-16837299 ] Sean Owen commented on SPARK-25075: --- Given that 2.13 isn't out yet and most dependencies won't cross

[jira] [Resolved] (SPARK-27636) Remove cached RDD blocks after PIC execution

2019-05-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27636. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24531

[jira] [Assigned] (SPARK-27636) Remove cached RDD blocks after PIC execution

2019-05-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-27636: - Assignee: shahid > Remove cached RDD blocks after PIC execution >

[jira] [Updated] (SPARK-27636) Remove cached RDD blocks after PIC execution

2019-05-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-27636: -- Priority: Minor (was: Major) > Remove cached RDD blocks after PIC execution >

[jira] [Resolved] (SPARK-27540) Add 'meanAveragePrecision_at_k' metric to RankingMetrics

2019-05-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27540. --- Resolution: Fixed Fix Version/s: 3.1.0 Issue resolved by pull request 24543

<    1   2   3   4   5   6   7   8   9   10   >