[jira] [Resolved] (SPARK-26940) Observed greater deviation on big endian platform for SingletonReplSuite test case

2019-02-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26940. --- Resolution: Not A Problem Target Version/s: (was: 2.3.2) > Observed greater deviation

[jira] [Updated] (SPARK-26940) Observed greater deviation on big endian platform for SingletonReplSuite test case

2019-02-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-26940: -- Priority: Minor (was: Critical) I haven't observed this test fail and don't see it would have

[jira] [Commented] (SPARK-27006) SPIP: .NET bindings for Apache Spark

2019-02-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16779595#comment-16779595 ] Sean Owen commented on SPARK-27006: --- It'd be much, much better if this can, at least, start outside

[jira] [Resolved] (SPARK-26890) Add Dropwizard metrics list and additional configuration details to the documentation

2019-02-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26890. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23798

[jira] [Assigned] (SPARK-26890) Add Dropwizard metrics list and additional configuration details to the documentation

2019-02-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-26890: - Assignee: Luca Canali > Add Dropwizard metrics list and additional configuration details to

[jira] [Assigned] (SPARK-26803) include sbin subdirectory in pyspark

2019-02-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-26803: - Assignee: Oliver Urs Lenz > include sbin subdirectory in pyspark >

[jira] [Resolved] (SPARK-26803) include sbin subdirectory in pyspark

2019-02-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26803. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23715

[jira] [Assigned] (SPARK-26449) Missing Dataframe.transform API in Python API

2019-02-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-26449: - Assignee: Erik Christiansen (was: Hanan Shteingart) > Missing Dataframe.transform API in

[jira] [Resolved] (SPARK-26986) Add JAXB reference impl to build for Java 9+

2019-02-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26986. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23890

[jira] [Resolved] (SPARK-26449) Missing Dataframe.transform API in Python API

2019-02-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26449. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23877

[jira] [Assigned] (SPARK-26449) Missing Dataframe.transform API in Python API

2019-02-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-26449: - Assignee: Hanan Shteingart > Missing Dataframe.transform API in Python API >

[jira] [Resolved] (SPARK-26750) Estimate memory overhead should taking multi-cores into account

2019-02-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26750. --- Resolution: Won't Fix > Estimate memory overhead should taking multi-cores into account >

[jira] [Resolved] (SPARK-26712) Single disk broken causing YarnShuffleSerivce not available

2019-02-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26712. --- Resolution: Won't Fix > Single disk broken causing YarnShuffleSerivce not available >

[jira] [Resolved] (SPARK-26978) Avoid magic time constants

2019-02-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26978. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23878

[jira] [Assigned] (SPARK-26978) Avoid magic time constants

2019-02-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-26978: - Assignee: Maxim Gekk > Avoid magic time constants > -- > >

[jira] [Resolved] (SPARK-24103) BinaryClassificationEvaluator should use sample weight data

2019-02-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-24103. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 17084

[jira] [Assigned] (SPARK-24103) BinaryClassificationEvaluator should use sample weight data

2019-02-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-24103: - Assignee: Ilya Matiach > BinaryClassificationEvaluator should use sample weight data >

[jira] [Resolved] (SPARK-26788) Remove SchedulerExtensionService

2019-02-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26788. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23839

[jira] [Assigned] (SPARK-26788) Remove SchedulerExtensionService

2019-02-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-26788: - Assignee: Marcelo Vanzin > Remove SchedulerExtensionService >

[jira] [Commented] (SPARK-24417) Build and Run Spark on JDK11

2019-02-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16777201#comment-16777201 ] Sean Owen commented on SPARK-24417: --- [~michael.atef] looks like you compiled with Java 11 and are

[jira] [Commented] (SPARK-24417) Build and Run Spark on JDK11

2019-02-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16777198#comment-16777198 ] Sean Owen commented on SPARK-24417: --- [~mlebihan] How familiar are you with the JDK release cycle at

[jira] [Created] (SPARK-26986) Add JAXB reference impl to build for Java 9+

2019-02-25 Thread Sean Owen (JIRA)
Sean Owen created SPARK-26986: - Summary: Add JAXB reference impl to build for Java 9+ Key: SPARK-26986 URL: https://issues.apache.org/jira/browse/SPARK-26986 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-26839) on JDK11, IsolatedClientLoader must be able to load java.sql classes

2019-02-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16777185#comment-16777185 ] Sean Owen commented on SPARK-26839: --- Is this the same error? I'm seeing this while running Hive tests

[jira] [Resolved] (SPARK-25590) kubernetes-model-2.0.0.jar masks default Spark logging config

2019-02-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-25590. --- Resolution: Fixed Assignee: Jiaxin Shan Fix Version/s: 3.0.0 Resolved by

[jira] [Assigned] (SPARK-26742) Bump Kubernetes Client Version to 4.1.1

2019-02-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-26742: - Assignee: Jiaxin Shan > Bump Kubernetes Client Version to 4.1.1 >

[jira] [Resolved] (SPARK-26742) Bump Kubernetes Client Version to 4.1.1

2019-02-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26742. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23814

[jira] [Resolved] (SPARK-26966) Update JPMML to 1.4.8 for Java 9+

2019-02-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26966. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23868

[jira] [Resolved] (SPARK-26953) Test TimSort for ArrayIndexOutOfBoundsException

2019-02-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26953. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23856

[jira] [Assigned] (SPARK-26953) Test TimSort for ArrayIndexOutOfBoundsException

2019-02-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-26953: - Assignee: Maxim Gekk > Test TimSort for ArrayIndexOutOfBoundsException >

[jira] [Assigned] (SPARK-26935) Skip DataFrameReader's CSV first line scan when not used

2019-02-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-26935: - Assignee: Douglas Colkitt > Skip DataFrameReader's CSV first line scan when not used >

[jira] [Resolved] (SPARK-26935) Skip DataFrameReader's CSV first line scan when not used

2019-02-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26935. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23830

[jira] [Assigned] (SPARK-26908) Fix toMillis

2019-02-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-26908: - Assignee: Maxim Gekk > Fix toMillis > > > Key: SPARK-26908 >

[jira] [Resolved] (SPARK-26908) Fix toMillis

2019-02-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26908. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23815

[jira] [Resolved] (SPARK-26918) All .md should have ASF license header

2019-02-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26918. --- Resolution: Not A Problem > All .md should have ASF license header >

[jira] [Updated] (SPARK-26918) All .md should have ASF license header

2019-02-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-26918: -- Priority: Minor (was: Major) Issue Type: Improvement (was: Bug) I don't think we need ASF

[jira] [Resolved] (SPARK-26963) SizeEstimator can't make some JDK fields accessible in Java 9+

2019-02-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26963. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23866

[jira] [Resolved] (SPARK-26939) Fix some outdated comments about task schedulers

2019-02-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26939. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23844

[jira] [Assigned] (SPARK-26939) Fix some outdated comments about task schedulers

2019-02-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-26939: - Assignee: Chenxiao Mao > Fix some outdated comments about task schedulers >

[jira] [Updated] (SPARK-26939) Fix some outdated comments about task schedulers

2019-02-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-26939: -- Priority: Trivial (was: Minor) > Fix some outdated comments about task schedulers >

[jira] [Resolved] (SPARK-26903) Remove the TimeZone cache

2019-02-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26903. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23812

[jira] [Assigned] (SPARK-26903) Remove the TimeZone cache

2019-02-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-26903: - Assignee: Maxim Gekk > Remove the TimeZone cache > - > >

[jira] [Commented] (SPARK-26977) Warn against subclassing scala.App doesn't work

2019-02-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16775776#comment-16775776 ] Sean Owen commented on SPARK-26977: --- Sure, would you like to make a pull request? > Warn against

[jira] [Commented] (SPARK-26973) Kubernetes version support strategy on test nodes / backend

2019-02-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16775355#comment-16775355 ] Sean Owen commented on SPARK-26973: --- I think I'd suggest testing against one version or else this

[jira] [Commented] (SPARK-26881) Scaling issue with Gramian computation for RowMatrix: too many results sent to driver

2019-02-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16774750#comment-16774750 ] Sean Owen commented on SPARK-26881: --- I wouldn't make it configurable. I don't think it makes sense to

[jira] [Assigned] (SPARK-25097) Support prediction on single instance in KMeans/BiKMeans/GMM

2019-02-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-25097: - Assignee: zhengruifeng > Support prediction on single instance in KMeans/BiKMeans/GMM >

[jira] [Resolved] (SPARK-25097) Support prediction on single instance in KMeans/BiKMeans/GMM

2019-02-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-25097. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 22087

[jira] [Assigned] (SPARK-26955) Align Spark's TimSort to JDK 11 TimSort

2019-02-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-26955: - Assignee: Maxim Gekk > Align Spark's TimSort to JDK 11 TimSort >

[jira] [Resolved] (SPARK-26955) Align Spark's TimSort to JDK 11 TimSort

2019-02-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26955. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23858

[jira] [Created] (SPARK-26966) Update JPMML to 1.4.8 for Java 9+

2019-02-21 Thread Sean Owen (JIRA)
Sean Owen created SPARK-26966: - Summary: Update JPMML to 1.4.8 for Java 9+ Key: SPARK-26966 URL: https://issues.apache.org/jira/browse/SPARK-26966 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-23232) Mapping Dataset to a Java bean always set 1L to a long field

2019-02-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-23232: -- Priority: Major (was: Critical) So in what sense is it always 1? > Mapping Dataset to a Java bean

[jira] [Commented] (SPARK-22286) OutOfMemoryError caused by memory leak and large serializer batch size in ExternalAppendOnlyMap

2019-02-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16774743#comment-16774743 ] Sean Owen commented on SPARK-22286: --- [~toopt4] what are you pinging? I'm not even clear this is a

[jira] [Updated] (SPARK-22286) OutOfMemoryError caused by memory leak and large serializer batch size in ExternalAppendOnlyMap

2019-02-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-22286: -- Priority: Major (was: Critical) > OutOfMemoryError caused by memory leak and large serializer batch

[jira] [Updated] (SPARK-26948) vertex and edge rowkey upgrade and support multiple types?

2019-02-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-26948: -- Priority: Minor (was: Critical) I think that has been proposed before; search JIRA. It has some perf

[jira] [Created] (SPARK-26963) SizeEstimator can't make some JDK fields accessible in Java 9+

2019-02-21 Thread Sean Owen (JIRA)
Sean Owen created SPARK-26963: - Summary: SizeEstimator can't make some JDK fields accessible in Java 9+ Key: SPARK-26963 URL: https://issues.apache.org/jira/browse/SPARK-26963 Project: Spark

[jira] [Resolved] (SPARK-26919) change maven default compile java home

2019-02-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26919. --- Resolution: Not A Problem Fix Version/s: (was: 2.4.0) > change maven default compile

[jira] [Resolved] (SPARK-26917) CacheManager blocks while traversing plans

2019-02-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26917. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23833

[jira] [Assigned] (SPARK-26917) CacheManager blocks while traversing plans

2019-02-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-26917: - Assignee: Dave DeCaprio > CacheManager blocks while traversing plans >

[jira] [Reopened] (SPARK-26919) change maven default compile java home

2019-02-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reopened SPARK-26919: --- > change maven default compile java home > -- > >

[jira] [Commented] (SPARK-18364) Expose metrics for YarnShuffleService

2019-02-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16774084#comment-16774084 ] Sean Owen commented on SPARK-18364: --- There isn't going to be a 2.5 > Expose metrics for

[jira] [Resolved] (SPARK-26643) Spark Hive throw an AnalysisException,when set table properties.But this AnalysisException contains one typo and one unsuited word.

2019-02-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26643. --- Resolution: Not A Problem > Spark Hive throw an AnalysisException,when set table properties.But

[jira] [Assigned] (SPARK-26892) saveAsTextFile throws NullPointerException when null row present

2019-02-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-26892: - Assignee: liupengcheng > saveAsTextFile throws NullPointerException when null row present >

[jira] [Resolved] (SPARK-26892) saveAsTextFile throws NullPointerException when null row present

2019-02-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26892. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23799

[jira] [Updated] (SPARK-26903) Remove the TimeZone cache

2019-02-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-26903: -- Docs Text: Prior to Spark 3, if an invalid timezone was specified to to_utc_timestamp and

[jira] [Resolved] (SPARK-26900) Simplify truncation to quarter of year

2019-02-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26900. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23808

[jira] [Assigned] (SPARK-26900) Simplify truncation to quarter of year

2019-02-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-26900: - Assignee: Maxim Gekk > Simplify truncation to quarter of year >

[jira] [Resolved] (SPARK-22798) Add multiple column support to PySpark StringIndexer

2019-02-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-22798. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23741

[jira] [Assigned] (SPARK-22798) Add multiple column support to PySpark StringIndexer

2019-02-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-22798: - Assignee: Huaxin Gao > Add multiple column support to PySpark StringIndexer >

[jira] [Commented] (SPARK-22709) move config related infrastructure from Spark Core to a new module

2019-02-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16773072#comment-16773072 ] Sean Owen commented on SPARK-22709: --- Saw this late, but I'm not sure about it. This means a new module

[jira] [Assigned] (SPARK-22601) Data load is getting displayed successful on providing non existing hdfs file path

2019-02-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-22601: - Assignee: Sujith > Data load is getting displayed successful on providing non existing hdfs

[jira] [Commented] (SPARK-26881) Scaling issue with Gramian computation for RowMatrix: too many results sent to driver

2019-02-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16771094#comment-16771094 ] Sean Owen commented on SPARK-26881: --- It's related but not quite the same issue. (You should try 2.3.3

[jira] [Resolved] (SPARK-26852) CrossValidator: support transforming metrics to absolute values prior to min/max test

2019-02-17 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26852. --- Resolution: Not A Problem > CrossValidator: support transforming metrics to absolute values prior

[jira] [Commented] (SPARK-15544) Bouncing Zookeeper node causes Active spark master to exit

2019-02-17 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16770444#comment-16770444 ] Sean Owen commented on SPARK-15544: --- [~moein7tl] can you propose a fix? this is pretty much DIY for

[jira] [Resolved] (SPARK-26721) Bug in feature importance calculation in GBM (and possibly other decision tree classifiers)

2019-02-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26721. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23773

[jira] [Assigned] (SPARK-26721) Bug in feature importance calculation in GBM (and possibly other decision tree classifiers)

2019-02-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-26721: - Assignee: Marco Gaido > Bug in feature importance calculation in GBM (and possibly other

[jira] [Assigned] (SPARK-26817) Use System.nanoTime to measure time intervals

2019-02-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-26817: - Assignee: Maxim Gekk > Use System.nanoTime to measure time intervals >

[jira] [Resolved] (SPARK-26817) Use System.nanoTime to measure time intervals

2019-02-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26817. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23727

[jira] [Assigned] (SPARK-26835) Document configuration properties of Spark SQL Generic Load/Save Functions

2019-02-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-26835: - Assignee: Peter Horvath > Document configuration properties of Spark SQL Generic Load/Save

[jira] [Resolved] (SPARK-26835) Document configuration properties of Spark SQL Generic Load/Save Functions

2019-02-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26835. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23742

[jira] [Updated] (SPARK-23408) Flaky test: StreamingOuterJoinSuite.left outer early state exclusion on right

2019-02-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-23408: -- Fix Version/s: 2.3.4 > Flaky test: StreamingOuterJoinSuite.left outer early state exclusion on right

[jira] [Commented] (SPARK-26862) assertion failed in ParquetRowConverter

2019-02-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16766342#comment-16766342 ] Sean Owen commented on SPARK-26862: --- The assertion is ... {code} // If the repeated field

[jira] [Commented] (SPARK-26855) SparkSubmitSuite fails on a clean build

2019-02-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16764537#comment-16764537 ] Sean Owen commented on SPARK-26855: --- I think this should be improved, but even I am not sure how much

[jira] [Assigned] (SPARK-26822) Upgrade the deprecated module 'optparse'

2019-02-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-26822: - Assignee: Neil Chien > Upgrade the deprecated module 'optparse' >

[jira] [Resolved] (SPARK-26822) Upgrade the deprecated module 'optparse'

2019-02-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26822. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23730

[jira] [Resolved] (SPARK-26821) filters not working with char datatype when querying against hive table

2019-02-08 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26821. --- Resolution: Not A Problem I don't think there's something to document at this point. The behavior

[jira] [Updated] (SPARK-26665) BlockTransferService.fetchBlockSync may hang forever

2019-02-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-26665: -- Fix Version/s: (was: 2.3.4) 2.3.3 > BlockTransferService.fetchBlockSync may

[jira] [Updated] (SPARK-26751) HiveSessionImpl might have memory leak since Operation do not close properly

2019-02-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-26751: -- Fix Version/s: (was: 2.3.4) 2.3.3 > HiveSessionImpl might have memory leak

[jira] [Updated] (SPARK-26228) OOM issue encountered when computing Gramian matrix

2019-02-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-26228: -- Fix Version/s: (was: 2.3.4) 2.3.3 > OOM issue encountered when computing

[jira] [Updated] (SPARK-26638) Pyspark vector classes always return error for unary negation

2019-02-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-26638: -- Fix Version/s: (was: 2.3.4) 2.3.3 > Pyspark vector classes always return error

[jira] [Updated] (SPARK-26351) Documented formula of precision at k does not match the actual code

2019-02-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-26351: -- Fix Version/s: (was: 2.3.4) 2.3.3 > Documented formula of precision at k does

[jira] [Updated] (SPARK-24740) PySpark tests do not pass with NumPy 0.14.x+

2019-02-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-24740: -- Fix Version/s: (was: 2.3.4) > PySpark tests do not pass with NumPy 0.14.x+ >

[jira] [Updated] (SPARK-26806) EventTimeStats.merge doesn't handle "zero.merge(zero)" correctly

2019-02-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-26806: -- Fix Version/s: (was: 2.3.4) 2.3.3 > EventTimeStats.merge doesn't handle

[jira] [Updated] (SPARK-26757) GraphX EdgeRDDImpl and VertexRDDImpl `count` method cannot handle empty RDDs

2019-02-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-26757: -- Fix Version/s: (was: 2.3.4) 2.3.3 > GraphX EdgeRDDImpl and VertexRDDImpl

[jira] [Resolved] (SPARK-26734) StackOverflowError on WAL serialization caused by large receivedBlockQueue

2019-02-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26734. --- Resolution: Fixed Fix Version/s: 2.3.4 2.4.1 3.0.0

[jira] [Assigned] (SPARK-26734) StackOverflowError on WAL serialization caused by large receivedBlockQueue

2019-02-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-26734: - Assignee: Ross M. Lodge > StackOverflowError on WAL serialization caused by large

[jira] [Assigned] (SPARK-26768) Remove useless code in BlockManager

2019-02-05 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-26768: - Assignee: liupengcheng > Remove useless code in BlockManager >

[jira] [Resolved] (SPARK-26768) Remove useless code in BlockManager

2019-02-05 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26768. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23693

[jira] [Resolved] (SPARK-25692) Flaky test: ChunkFetchIntegrationSuite.fetchBothChunks

2019-02-05 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-25692. --- Resolution: Fixed Issue resolved by pull request 23700 [https://github.com/apache/spark/pull/23700]

[jira] [Assigned] (SPARK-25692) Flaky test: ChunkFetchIntegrationSuite.fetchBothChunks

2019-02-05 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-25692: - Assignee: Sanket Reddy > Flaky test: ChunkFetchIntegrationSuite.fetchBothChunks >

[jira] [Commented] (SPARK-26821) filters not working with char datatype when querying against hive table

2019-02-05 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16760897#comment-16760897 ] Sean Owen commented on SPARK-26821: --- Can you find the result when filtering for "ds " with spaces?

[jira] [Resolved] (SPARK-26758) Idle Executors are not getting killed after spark.dynamicAllocation.executorIdleTimeout value

2019-02-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26758. --- Resolution: Fixed Fix Version/s: 2.3.4 2.4.1 3.0.0

<    4   5   6   7   8   9   10   11   12   13   >