Github user ajaysaini725 commented on the issue:
https://github.com/apache/spark/pull/1
@jkbradley Quick reminder to merge this since the tests have passed!
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user ajaysaini725 commented on a diff in the pull request:
https://github.com/apache/spark/pull/1#discussion_r132597367
--- Diff: python/pyspark/ml/pipeline.py ---
@@ -242,3 +327,65 @@ def _to_java(self):
JavaParams._new_java_obj
Github user ajaysaini725 commented on a diff in the pull request:
https://github.com/apache/spark/pull/1#discussion_r132595823
--- Diff: python/pyspark/ml/tests.py ---
@@ -1142,6 +1142,35 @@ def test_nested_pipeline_persistence(self):
except OSError
Github user ajaysaini725 commented on the issue:
https://github.com/apache/spark/pull/1
@jkbradley @MrBago @WeichenXu123 Can you please review this?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project
GitHub user ajaysaini725 opened a pull request:
https://github.com/apache/spark/pull/1
[Spark-17025][ML][Python] Persistence for Custom Python-only Pipelines
## What changes were proposed in this pull request?
Implemented a Python-only persistence framework for
Github user ajaysaini725 commented on a diff in the pull request:
https://github.com/apache/spark/pull/18742#discussion_r131781393
--- Diff: python/pyspark/ml/tests.py ---
@@ -1158,6 +1165,33 @@ def test_decisiontree_regressor(self):
except OSError
Github user ajaysaini725 commented on a diff in the pull request:
https://github.com/apache/spark/pull/18742#discussion_r131028435
--- Diff: python/pyspark/ml/param/__init__.py ---
@@ -375,6 +375,18 @@ def copy(self, extra=None):
that._defaultParamMap
Github user ajaysaini725 commented on a diff in the pull request:
https://github.com/apache/spark/pull/18742#discussion_r131017418
--- Diff: python/pyspark/ml/util.py ---
@@ -61,32 +66,82 @@ def _randomUID(cls):
@inherit_doc
-class MLWriter(object):
+class
Github user ajaysaini725 commented on a diff in the pull request:
https://github.com/apache/spark/pull/18746#discussion_r130775557
--- Diff: python/pyspark/ml/base.py ---
@@ -116,3 +121,44 @@ class Model(Transformer):
"""
__metacl
Github user ajaysaini725 commented on a diff in the pull request:
https://github.com/apache/spark/pull/18746#discussion_r130775517
--- Diff: python/pyspark/ml/base.py ---
@@ -116,3 +121,44 @@ class Model(Transformer):
"""
__metacl
Github user ajaysaini725 commented on a diff in the pull request:
https://github.com/apache/spark/pull/18742#discussion_r130741050
--- Diff: python/pyspark/ml/util.py ---
@@ -283,3 +289,124 @@ def numFeatures(self):
Returns the number of features the model was trained
Github user ajaysaini725 commented on the issue:
https://github.com/apache/spark/pull/18746
@jkbradley @thunterdb @MrBago Could you please review this?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does
GitHub user ajaysaini725 opened a pull request:
https://github.com/apache/spark/pull/18746
Implemented UnaryTransformer in Python
## What changes were proposed in this pull request?
Implemented UnaryTransformer in Python
(Please fill in changes proposed in this fix
Github user ajaysaini725 commented on the issue:
https://github.com/apache/spark/pull/18742
@jkbradley @thunterdb @MrBago Could you please review this PR?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project
GitHub user ajaysaini725 opened a pull request:
https://github.com/apache/spark/pull/18742
Python persistence helper functions
## What changes were proposed in this pull request?
Added DefaultParamsWriteable, DefaultParamsReadable, DefaultParamsWriter,
and
Github user ajaysaini725 commented on a diff in the pull request:
https://github.com/apache/spark/pull/18281#discussion_r127558107
--- Diff: python/pyspark/ml/tests.py ---
@@ -1229,11 +1229,30 @@ def test_output_columns(self):
(2.0
Github user ajaysaini725 commented on a diff in the pull request:
https://github.com/apache/spark/pull/18281#discussion_r127557890
--- Diff:
mllib/src/test/scala/org/apache/spark/ml/classification/OneVsRestSuite.scala ---
@@ -101,6 +101,50 @@ class OneVsRestSuite extends
Github user ajaysaini725 commented on the issue:
https://github.com/apache/spark/pull/18281
@BryanCutler @MLnick @jkbradley I pushed another update based on comments.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If
Github user ajaysaini725 commented on a diff in the pull request:
https://github.com/apache/spark/pull/18428#discussion_r126014344
--- Diff: python/pyspark/ml/classification.py ---
@@ -1630,8 +1614,52 @@ def _to_java(self):
_java_obj.setPredictionCol
Github user ajaysaini725 commented on the issue:
https://github.com/apache/spark/pull/18428
@jkbradley @thunterdb Could you please review this?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
GitHub user ajaysaini725 opened a pull request:
https://github.com/apache/spark/pull/18428
[ML] CrossValidator and TrainValidationSplit Persist Nested Estimators
## What changes were proposed in this pull request?
Added functionality for CrossValidator and
Github user ajaysaini725 commented on the issue:
https://github.com/apache/spark/pull/18281
Also @BryanCutler just pushed an updated PR based on your comments. Thanks!
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If
Github user ajaysaini725 commented on the issue:
https://github.com/apache/spark/pull/18281
@BryanCutler What is the point of having the function getExectionContext()
take a parameter maxThreads? Isn't it just supposed to use the parallelism
parameter when determining what exec
Github user ajaysaini725 commented on the issue:
https://github.com/apache/spark/pull/18281
@BryanCutler Could you please review this?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this
Github user ajaysaini725 commented on the issue:
https://github.com/apache/spark/pull/18281
Quick comment about my update. As per a discussion earlier I had the
OneVsRest class extend the trait ParallelismParam because the parallelism
parameter is only relevant to the training of
Github user ajaysaini725 commented on the issue:
https://github.com/apache/spark/pull/18281
add to whitelist
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes
GitHub user ajaysaini725 opened a pull request:
https://github.com/apache/spark/pull/18281
Added tunable parallelism to the pyspark implementation of one vs. reâ¦
â¦st classification. Added a parallelism parameter to the scala
implementation of one vs. rest for python persistence
27 matches
Mail list logo
