[jira] [Resolved] (SPARK-28907) Review invalid usage of new Configuration()

2019-09-04 Thread Sean Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-28907. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25616 [https://github.c

[jira] [Assigned] (SPARK-28907) Review invalid usage of new Configuration()

2019-09-04 Thread Sean Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-28907: - Assignee: Xianjin YE > Review invalid usage of new Configuration() > --

[jira] [Updated] (SPARK-28980) Remove most remaining deprecated items since <= 2.2.0 for 3.0

2019-09-04 Thread Sean Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-28980: -- Component/s: MLlib Summary: Remove most remaining deprecated items since <= 2.2.0 for 3.0 (wa

[jira] [Updated] (SPARK-28977) JDBC Dataframe Reader Doc Doesn't Match JDBC Data Source Page

2019-09-04 Thread Sean Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-28977: -- Target Version/s: (was: 2.4.3) > JDBC Dataframe Reader Doc Doesn't Match JDBC Data Source Page > ---

[jira] [Updated] (SPARK-28977) JDBC Dataframe Reader Doc Doesn't Match JDBC Data Source Page

2019-09-04 Thread Sean Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-28977: -- Fix Version/s: (was: 2.4.3) Priority: Minor (was: Major) > JDBC Dataframe Reader Doc Doe

[jira] [Created] (SPARK-28980) Remove remaining deprecated items since <= 2.2.0 for 3.0

2019-09-04 Thread Sean Owen (Jira)
Sean Owen created SPARK-28980: - Summary: Remove remaining deprecated items since <= 2.2.0 for 3.0 Key: SPARK-28980 URL: https://issues.apache.org/jira/browse/SPARK-28980 Project: Spark Issue Type

[jira] [Commented] (SPARK-28953) Integration tests fail due to malformed URL

2019-09-04 Thread Sean Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16922480#comment-16922480 ] Sean Owen commented on SPARK-28953: --- [~holdenk] Looks like this is the same issue as a

[jira] [Updated] (SPARK-28855) Remove outdated Experimental, Evolving annotations

2019-09-03 Thread Sean Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-28855: -- Issue Type: Task (was: Bug) > Remove outdated Experimental, Evolving annotations > --

[jira] [Created] (SPARK-28963) Fall back to archive.apache.org to download Maven if mirrors don't have requested version

2019-09-03 Thread Sean Owen (Jira)
Sean Owen created SPARK-28963: - Summary: Fall back to archive.apache.org to download Maven if mirrors don't have requested version Key: SPARK-28963 URL: https://issues.apache.org/jira/browse/SPARK-28963 P

[jira] [Updated] (SPARK-28709) Memory leaks after stopping of StreamingContext

2019-09-03 Thread Sean Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-28709: -- Fix Version/s: 2.4.5 > Memory leaks after stopping of StreamingContext > -

[jira] [Resolved] (SPARK-22955) Error generating jobs when Stopping JobGenerator gracefully

2019-09-03 Thread Sean Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-22955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-22955. --- Fix Version/s: 3.0.0 2.4.5 Resolution: Fixed Resolved by https://github.co

[jira] [Updated] (SPARK-22955) Error generating jobs when Stopping JobGenerator gracefully

2019-09-03 Thread Sean Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-22955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-22955: -- Labels: (was: bulk-closed) > Error generating jobs when Stopping JobGenerator gracefully > -

[jira] [Reopened] (SPARK-22955) Error generating jobs when Stopping JobGenerator gracefully

2019-09-03 Thread Sean Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-22955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reopened SPARK-22955: --- > Error generating jobs when Stopping JobGenerator gracefully >

[jira] [Resolved] (SPARK-28956) Make it tighter

2019-09-03 Thread Sean Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-28956. --- Resolution: Invalid Please see comments on PR and review https://spark.apache.org/contributing.html

[jira] [Updated] (SPARK-28933) Reduce unnecessary shuffle in ALS when initializing factors

2019-09-01 Thread Sean Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-28933: -- Priority: Minor (was: Major) > Reduce unnecessary shuffle in ALS when initializing factors >

[jira] [Resolved] (SPARK-28855) Remove outdated Experimental, Evolving annotations

2019-09-01 Thread Sean Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-28855. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25558 [https://github.c

[jira] [Updated] (SPARK-28542) Document Stages page

2019-08-31 Thread Sean Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-28542: -- Fix Version/s: 3.0.0 > Document Stages page > > > Key: SPARK-2854

[jira] [Assigned] (SPARK-28542) Document Stages page

2019-08-31 Thread Sean Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-28542: - Fix Version/s: (was: 3.0.0) Assignee: (was: Pablo Langa Blanco) Priori

[jira] [Resolved] (SPARK-28542) Document Stages page

2019-08-31 Thread Sean Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-28542. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25598 [https://github.c

[jira] [Assigned] (SPARK-28542) Document Stages page

2019-08-31 Thread Sean Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-28542: - Assignee: Pablo Langa Blanco > Document Stages page > > >

[jira] [Resolved] (SPARK-28903) Fix AWS JDK version conflict that breaks Pyspark Kinesis tests

2019-08-31 Thread Sean Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-28903. --- Fix Version/s: 3.0.0 2.4.5 Resolution: Fixed Issue resolved by pull reques

[jira] [Resolved] (SPARK-28866) Persist item factors RDD when checkpointing in ALS

2019-08-30 Thread Sean Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-28866. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25576 [https://github.c

[jira] [Assigned] (SPARK-28866) Persist item factors RDD when checkpointing in ALS

2019-08-30 Thread Sean Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-28866: - Assignee: Liang-Chi Hsieh > Persist item factors RDD when checkpointing in ALS > --

[jira] [Resolved] (SPARK-27611) Redundant javax.activation dependencies in the Maven build

2019-08-29 Thread Sean Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27611. --- Fix Version/s: 3.0.0 Resolution: Fixed Resolved by https://github.com/apache/spark/pull/24507

[jira] [Updated] (SPARK-28843) Set OMP_NUM_THREADS to executor cores reduce Python memory consumption

2019-08-28 Thread Sean Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-28843: -- Docs Text: Pyspark workers now set the env variable OMP_NUM_THREADS (if not already set) to the number

[jira] [Created] (SPARK-28903) Fix AWS JDK version conflict that breaks Pyspark Kinesis tests

2019-08-28 Thread Sean Owen (Jira)
Sean Owen created SPARK-28903: - Summary: Fix AWS JDK version conflict that breaks Pyspark Kinesis tests Key: SPARK-28903 URL: https://issues.apache.org/jira/browse/SPARK-28903 Project: Spark Iss

[jira] [Commented] (SPARK-28900) Test Pyspark, SparkR on JDK 11 with run-tests

2019-08-28 Thread Sean Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16917928#comment-16917928 ] Sean Owen commented on SPARK-28900: --- OK, let's not boil the ocean. The only immediate

[jira] [Created] (SPARK-28900) Test Pyspark, SparkR on JDK 11 with run-tests

2019-08-28 Thread Sean Owen (Jira)
Sean Owen created SPARK-28900: - Summary: Test Pyspark, SparkR on JDK 11 with run-tests Key: SPARK-28900 URL: https://issues.apache.org/jira/browse/SPARK-28900 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-28539) Document Executors page

2019-08-28 Thread Sean Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-28539. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25596 [https://github.c

[jira] [Assigned] (SPARK-28539) Document Executors page

2019-08-28 Thread Sean Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-28539: - Assignee: zhengruifeng > Document Executors page > --- > >

[jira] [Updated] (SPARK-28539) Document Executors page

2019-08-28 Thread Sean Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-28539: -- Priority: Minor (was: Major) > Document Executors page > --- > >

[jira] [Resolved] (SPARK-28871) Some codes in 'Policy for handling multiple watermarks' does not show friendly

2019-08-27 Thread Sean Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-28871. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25580 [https://github.c

[jira] [Assigned] (SPARK-28871) Some codes in 'Policy for handling multiple watermarks' does not show friendly

2019-08-27 Thread Sean Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-28871: - Assignee: chaiyongqiang > Some codes in 'Policy for handling multiple watermarks' does not show

[jira] [Assigned] (SPARK-22955) Error generating jobs when Stopping JobGenerator gracefully

2019-08-26 Thread Sean Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-22955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-22955: - Assignee: Nikita Gorbachevski > Error generating jobs when Stopping JobGenerator gracefully > -

[jira] [Created] (SPARK-28877) Investigate/fix JAXB failure running Pyspark tests on JDK 11

2019-08-26 Thread Sean Owen (Jira)
Sean Owen created SPARK-28877: - Summary: Investigate/fix JAXB failure running Pyspark tests on JDK 11 Key: SPARK-28877 URL: https://issues.apache.org/jira/browse/SPARK-28877 Project: Spark Issue

[jira] [Resolved] (SPARK-28709) Memory leaks after stopping of StreamingContext

2019-08-26 Thread Sean Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-28709. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25439 [https://github.c

[jira] [Assigned] (SPARK-28709) Memory leaks after stopping of StreamingContext

2019-08-26 Thread Sean Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-28709: - Assignee: Nikita Gorbachevski > Memory leaks after stopping of StreamingContext > -

[jira] [Assigned] (SPARK-28769) Improve warning message in Barrier Execution Mode in case required slots > maximum slots

2019-08-22 Thread Sean Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-28769: - Assignee: Kousuke Saruta > Improve warning message in Barrier Execution Mode in case required s

[jira] [Resolved] (SPARK-28769) Improve warning message in Barrier Execution Mode in case required slots > maximum slots

2019-08-22 Thread Sean Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-28769. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25487 [https://github.c

[jira] [Resolved] (SPARK-13677) Support Tree-Based Feature Transformation for ML

2019-08-22 Thread Sean Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-13677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-13677. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25383 [https://github.c

[jira] [Assigned] (SPARK-13677) Support Tree-Based Feature Transformation for ML

2019-08-22 Thread Sean Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-13677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-13677: - Assignee: zhengruifeng > Support Tree-Based Feature Transformation for ML > ---

[jira] [Resolved] (SPARK-28776) SparkML MLWriter gets hadoop conf from spark context instead of session

2019-08-22 Thread Sean Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-28776. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25505 [https://github.c

[jira] [Assigned] (SPARK-28776) SparkML MLWriter gets hadoop conf from spark context instead of session

2019-08-22 Thread Sean Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-28776: - Assignee: Helen Yu > SparkML MLWriter gets hadoop conf from spark context instead of session >

[jira] [Created] (SPARK-28855) Remove outdated Experimental, Evolving annotations

2019-08-22 Thread Sean Owen (Jira)
Sean Owen created SPARK-28855: - Summary: Remove outdated Experimental, Evolving annotations Key: SPARK-28855 URL: https://issues.apache.org/jira/browse/SPARK-28855 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-14643) Remove overloaded methods which become ambiguous in Scala 2.12

2019-08-21 Thread Sean Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-14643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16912842#comment-16912842 ] Sean Owen commented on SPARK-14643: --- I took another look at this. I tried implementing

[jira] [Commented] (ARROW-3786) Enable merge_arrow_pr.py script to run in non-English JIRA accounts.

2019-08-21 Thread Sean Owen (Jira)
[ https://issues.apache.org/jira/browse/ARROW-3786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16912795#comment-16912795 ] Sean Owen commented on ARROW-3786: -- Hm, I don't know much about the merge script, but of

[jira] [Updated] (SPARK-28540) Document Environment page

2019-08-21 Thread Sean Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-28540: -- Priority: Minor (was: Major) > Document Environment page > - > >

[jira] [Resolved] (SPARK-28540) Document Environment page

2019-08-21 Thread Sean Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-28540. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25430 [https://github.c

[jira] [Assigned] (SPARK-28540) Document Environment page

2019-08-21 Thread Sean Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-28540: - Assignee: zhengruifeng > Document Environment page > - > >

[jira] [Resolved] (SPARK-28780) Delete the incorrect setWeightCol method in LinearSVCModel

2019-08-21 Thread Sean Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-28780. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25510 [https://github.c

[jira] [Assigned] (SPARK-28780) Delete the incorrect setWeightCol method in LinearSVCModel

2019-08-21 Thread Sean Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-28780: - Assignee: zhengruifeng > Delete the incorrect setWeightCol method in LinearSVCModel > -

[jira] [Assigned] (SPARK-28541) Document Storage page

2019-08-20 Thread Sean Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-28541: - Assignee: zhengruifeng > Document Storage page > - > > Key:

[jira] [Resolved] (SPARK-28541) Document Storage page

2019-08-20 Thread Sean Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-28541. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25445 [https://github.c

[jira] [Updated] (SPARK-28541) Document Storage page

2019-08-20 Thread Sean Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-28541: -- Priority: Minor (was: Major) > Document Storage page > - > > Key:

[jira] [Updated] (SPARK-28780) Delete the incorrect setWeightCol method in LinearSVCModel

2019-08-20 Thread Sean Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-28780: -- Docs Text: Spark 2.2 accidentally introduced the method LinearSVCModel.setWeightCol. This method works

[jira] [Resolved] (SPARK-22531) Migrate the implementation of IDF from MLLib to ML

2019-08-20 Thread Sean Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-22531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-22531. --- Resolution: Duplicate > Migrate the implementation of IDF from MLLib to ML > ---

[jira] [Reopened] (SPARK-22531) Migrate the implementation of IDF from MLLib to ML

2019-08-20 Thread Sean Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-22531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reopened SPARK-22531: --- > Migrate the implementation of IDF from MLLib to ML > -

[jira] [Reopened] (SPARK-21178) Add support for label specific metrics in MulticlassClassificationEvaluator

2019-08-20 Thread Sean Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-21178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reopened SPARK-21178: --- > Add support for label specific metrics in MulticlassClassificationEvaluator >

[jira] [Resolved] (SPARK-21178) Add support for label specific metrics in MulticlassClassificationEvaluator

2019-08-20 Thread Sean Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-21178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21178. --- Resolution: Duplicate > Add support for label specific metrics in MulticlassClassificationEvaluator

[jira] [Assigned] (SPARK-28749) Fix PySpark tests not to require kafka-0-8 in branch-2.4

2019-08-19 Thread Sean Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-28749: - Assignee: Matt Foley > Fix PySpark tests not to require kafka-0-8 in branch-2.4 > -

[jira] [Resolved] (SPARK-28749) Fix PySpark tests not to require kafka-0-8 in branch-2.4

2019-08-19 Thread Sean Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-28749. --- Fix Version/s: 2.4.5 Resolution: Fixed Issue resolved by pull request 25482 [https://github.c

[jira] [Resolved] (SPARK-28434) Decision Tree model isn't equal after save and load

2019-08-19 Thread Sean Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-28434. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25485 [https://github.c

[jira] [Updated] (SPARK-28775) DateTimeUtilsSuite fails for JDKs using the tzdata2018i or newer timezone database

2019-08-19 Thread Sean Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-28775: -- Summary: DateTimeUtilsSuite fails for JDKs using the tzdata2018i or newer timezone database (was: Dat

[jira] [Assigned] (SPARK-28434) Decision Tree model isn't equal after save and load

2019-08-17 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-28434: - Assignee: Ievgen Prokhorenko > Decision Tree model isn't equal after save and load > --

[jira] [Updated] (SPARK-28434) Decision Tree model isn't equal after save and load

2019-08-17 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-28434: -- Priority: Minor (was: Major) Issue Type: Improvement (was: Bug) OK, on re-reading the code, ye

[jira] [Resolved] (SPARK-28722) Change sequential label sorting in StringIndexer fit to parallel

2019-08-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-28722. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25442 [https://github.c

[jira] [Assigned] (SPARK-28722) Change sequential label sorting in StringIndexer fit to parallel

2019-08-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-28722: - Assignee: Liang-Chi Hsieh > Change sequential label sorting in StringIndexer fit to parallel >

[jira] [Updated] (SPARK-28722) Change sequential label sorting in StringIndexer fit to parallel

2019-08-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-28722: -- Priority: Minor (was: Major) > Change sequential label sorting in StringIndexer fit to parallel > ---

[jira] [Commented] (SPARK-28758) Upgrade Janino to 3.0.15

2019-08-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16909163#comment-16909163 ] Sean Owen commented on SPARK-28758: --- It doesn't really matter, but I don't know if thi

[jira] [Commented] (SPARK-28750) Use `--release 8` for javac

2019-08-15 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16908587#comment-16908587 ] Sean Owen commented on SPARK-28750: --- [~dongjoon] I've tried this for an hour, and can'

[jira] [Assigned] (SPARK-28543) Document Spark Jobs page

2019-08-15 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-28543: - Assignee: Pablo Langa Blanco > Document Spark Jobs page > > >

[jira] [Resolved] (SPARK-28543) Document Spark Jobs page

2019-08-15 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-28543. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25424 [https://github.c

[jira] [Created] (SPARK-28737) Update jersey to 2.27+ (2.29)

2019-08-14 Thread Sean Owen (JIRA)
Sean Owen created SPARK-28737: - Summary: Update jersey to 2.27+ (2.29) Key: SPARK-28737 URL: https://issues.apache.org/jira/browse/SPARK-28737 Project: Spark Issue Type: Sub-task Compon

[jira] [Commented] (SPARK-28683) Upgrade Scala to 2.12.10

2019-08-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16907606#comment-16907606 ] Sean Owen commented on SPARK-28683: --- I think we can detach this from the JDK 11 umbrel

[jira] [Commented] (SPARK-28110) on JDK11, IsolatedClientLoader must be able to load java.sql classes

2019-08-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16907604#comment-16907604 ] Sean Owen commented on SPARK-28110: --- Is this one still an issue? I think this is a clo

[jira] [Commented] (SPARK-28701) add java11 support for spark pull request builds

2019-08-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16906613#comment-16906613 ] Sean Owen commented on SPARK-28701: --- I'm pretty sure the consensus is: support Java 8

[jira] [Commented] (SPARK-28693) Malformed input or input contains unmappable characters

2019-08-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16905396#comment-16905396 ] Sean Owen commented on SPARK-28693: --- I wonder if we have to fix the default encoding i

[jira] [Assigned] (SPARK-28538) Document SQL page

2019-08-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-28538: - Assignee: zhengruifeng > Document SQL page > - > > Key: SPARK-2

[jira] [Resolved] (SPARK-28538) Document SQL page

2019-08-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-28538. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25349 [https://github.c

[jira] [Commented] (SPARK-28696) create database _; allowing in Spark but Hive throws Parse Exception

2019-08-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16905162#comment-16905162 ] Sean Owen commented on SPARK-28696: --- [~cloud_fan] may be a better contact. I guess Hiv

[jira] [Resolved] (SPARK-28639) Configuration doc for Barrier Execution Mode

2019-08-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-28639. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25370 [https://github.c

[jira] [Updated] (SPARK-28639) Configuration doc for Barrier Execution Mode

2019-08-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-28639: -- Priority: Minor (was: Major) > Configuration doc for Barrier Execution Mode > ---

[jira] [Resolved] (SPARK-28677) "Select All" checkbox in StagePage doesn't work properly

2019-08-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-28677. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25397 [https://github.c

[jira] [Assigned] (SPARK-28677) "Select All" checkbox in StagePage doesn't work properly

2019-08-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-28677: - Assignee: Kousuke Saruta > "Select All" checkbox in StagePage doesn't work properly > -

[jira] [Resolved] (SPARK-28655) Support to cut the event log, and solve the history server was too slow when event log is too large.

2019-08-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-28655. --- Resolution: Not A Problem > Support to cut the event log, and solve the history server was too slow

[jira] [Updated] (SPARK-21481) Add indexOf method in ml.feature.HashingTF similar to mllib.feature.HashingTF

2019-08-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-21481: -- Priority: Minor (was: Major) > Add indexOf method in ml.feature.HashingTF similar to mllib.feature.Ha

[jira] [Resolved] (SPARK-26667) Add `Scanning Input Table` to Performance Tuning Guide

2019-08-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26667. --- Resolution: Won't Fix > Add `Scanning Input Table` to Performance Tuning Guide > ---

[jira] [Assigned] (SPARK-28514) Remove the redundant transformImpl method in RF & GBT

2019-08-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-28514: - Assignee: zhengruifeng > Remove the redundant transformImpl method in RF & GBT > --

[jira] [Resolved] (SPARK-28514) Remove the redundant transformImpl method in RF & GBT

2019-08-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-28514. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25256 [https://github.c

[jira] [Updated] (SPARK-28514) Remove the redundant transformImpl method in RF & GBT

2019-08-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-28514: -- Description: In GBTClassifier & RandomForestClassifier, the real transform methods inherit from Proba

[jira] [Resolved] (SPARK-28604) Use log1p(x) instead of log(1+x) and expm1(x) instead of exp(x)-1

2019-08-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-28604. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25337 [https://github.c

[jira] [Created] (SPARK-28604) Use log1p(x) instead of log(1+x) and expm1(x) instead of exp(x)-1

2019-08-02 Thread Sean Owen (JIRA)
Sean Owen created SPARK-28604: - Summary: Use log1p(x) instead of log(1+x) and expm1(x) instead of exp(x)-1 Key: SPARK-28604 URL: https://issues.apache.org/jira/browse/SPARK-28604 Project: Spark

[jira] [Assigned] (SPARK-20604) Allow Imputer to handle all numeric types

2019-08-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-20604: - Assignee: Wayne Zhang > Allow Imputer to handle all numeric types > ---

[jira] [Resolved] (SPARK-20604) Allow Imputer to handle all numeric types

2019-08-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-20604. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 17864 [https://github.c

[jira] [Resolved] (SPARK-28519) Tests failed on aarch64 due the value of math.log and power function is different

2019-08-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-28519. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25279 [https://github.c

[jira] [Updated] (SPARK-20604) Allow Imputer to handle all numeric types

2019-08-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-20604: -- Priority: Minor (was: Major) > Allow Imputer to handle all numeric types > --

[jira] [Assigned] (SPARK-28519) Tests failed on aarch64 due the value of math.log and power function is different

2019-08-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-28519: - Assignee: Sean Owen > Tests failed on aarch64 due the value of math.log and power function is

[jira] [Resolved] (SPARK-23469) HashingTF should use corrected MurmurHash3 implementation

2019-08-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-23469. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25303 [https://github.c

[jira] [Assigned] (SPARK-23469) HashingTF should use corrected MurmurHash3 implementation

2019-08-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-23469: - Assignee: Huaxin Gao > HashingTF should use corrected MurmurHash3 implementation >

[jira] [Updated] (SPARK-23469) HashingTF should use corrected MurmurHash3 implementation

2019-08-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-23469: -- Docs Text: In Spark 3.0, the HashingTF Transformer uses a corrected implementation of the murmur3 hash

<    1   2   3   4   5   6   7   8   9   10   >