[
https://issues.apache.org/jira/browse/SPARK-14810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15285613#comment-15285613
]
Joseph K. Bradley commented on SPARK-14810:
-------------------------------------------
[~nick.pentre...@gmail.com] Thanks! Your judgements sound correct to me.
To document the changes, I like to list them in the migration guide, grouped by
whether they are breaking changes, removed deprecated items, behavior changes,
etc.
By the way, can you please not put items specific to this release in the JIRA
description? It makes things easier if we can clone these QA JIRAs for each
new release and minimize the editing needed. Feel free to update the
instructions, though.
> ML, Graph 2.0 QA: API: Binary incompatible changes
> --------------------------------------------------
>
> Key: SPARK-14810
> URL: https://issues.apache.org/jira/browse/SPARK-14810
> Project: Spark
> Issue Type: Sub-task
> Components: Documentation, GraphX, ML, MLlib
> Reporter: Joseph K. Bradley
> Assignee: Nick Pentreath
>
> Generate a list of binary incompatible changes using MiMa and create new
> JIRAs for issues found. Filter out false positives as needed.
> If you want to take this task, look at the analogous task from the previous
> release QA, and ping the Assignee for advice.
> List of changes since {{1.6.0}} audited - these are "false positives" due to
> being private, @Experimental, DeveloperAPI, etc:
> * SPARK-13686 - Add a constructor parameter `regParam` to
> (Streaming)LinearRegressionWithSGD
> * SPARK-13664 - Replace HadoopFsRelation with FileFormat
> * SPARK-11622 - Make LibSVMRelation extends HadoopFsRelation and Add
> LibSVMOutputWriter
> * SPARK-13920 - MIMA checks should apply to @Experimental and @DeveloperAPI
> APIs
> * SPARK-11011 - UserDefinedType serialization should be strongly typed
> * SPARK-13817 - Re-enable MiMA and removes object DataFrame
> * SPARK-13927 - add row/column iterator to local matrices - (add methods to
> sealed trait)
> * SPARK-13948 - MiMa Check should catch if the visibility change to `private`
> - (DataFrame -> Dataset)
> * SPARK-11262 - Unit test for gradient, loss layers, memory management -
> (private class)
> * SPARK-13430 - moved featureCol from LinearRegressionModelSummary to
> LinearRegressionSummary - (private class)
> * SPARK-13048 - keepLastCheckpoint option for LDA EM optimizer - (private
> class)
> * SPARK-14734 - Add conversions between mllib and ml Vector, Matrix types -
> (private methods added)
> * SPARK-14861 - Replace internal usages of SQLContext with SparkSession -
> (private class)
> Binary incompatible changes:
> * SPARK-14089 - Remove methods that has been deprecated since 1.1, 1.2, 1.3,
> 1.4, and 1.5
> * SPARK-14952 - Remove methods deprecated in 1.6
> * DataFrame -> Dataset<Row> changes for Java (this of course applies for all
> of Spark SQL)
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
