[jira] [Updated] (SPARK-10467) Vector is converted to tuple when extracted from Row using __getitem__

2015-09-06 Thread Maciej Szymkiewicz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-10467: --- Description: {code} from pyspark.ml.feature import HashingTF df = sqlContext.createD

[jira] [Updated] (SPARK-10467) Vector is converted to tuple when extracted from Row using __getitem__

2015-09-06 Thread Maciej Szymkiewicz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-10467: --- Description: If we take a row from a data frame and try to extract vector element by

[jira] [Updated] (SPARK-10467) Vector is converted to tuple when extracted from Row using __getitem__

2015-09-06 Thread Maciej Szymkiewicz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-10467: --- Description: If we take a row from a data frame and try to extract vector element by

[jira] [Updated] (SPARK-10467) Vector is converted to tuple when extracted from Row using __getitem__

2015-09-06 Thread Maciej Szymkiewicz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-10467: --- Description: If we take a row from a data frame and try to extract vector element by

[jira] [Created] (SPARK-14058) Incorrect docstring in Window.orderBy

2016-03-21 Thread Maciej Szymkiewicz (JIRA)
Maciej Szymkiewicz created SPARK-14058: -- Summary: Incorrect docstring in Window.orderBy Key: SPARK-14058 URL: https://issues.apache.org/jira/browse/SPARK-14058 Project: Spark Issue Type

[jira] [Commented] (SPARK-12916) Support Row.fromSeq and Row.toSeq methods in pyspark

2016-03-22 Thread Maciej Szymkiewicz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15206030#comment-15206030 ] Maciej Szymkiewicz commented on SPARK-12916: Since PySpark `Row` is just a su

[jira] [Created] (SPARK-14202) python_full_outer_join should use generator expression instead of list comp

2016-03-28 Thread Maciej Szymkiewicz (JIRA)
Maciej Szymkiewicz created SPARK-14202: -- Summary: python_full_outer_join should use generator expression instead of list comp Key: SPARK-14202 URL: https://issues.apache.org/jira/browse/SPARK-14202

[jira] [Updated] (SPARK-14202) python_full_outer_join should use generator expression instead of list comp

2016-03-28 Thread Maciej Szymkiewicz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-14202: --- Affects Version/s: (was: 1.3.0) > python_full_outer_join should use generator exp

[jira] [Created] (SPARK-14739) Vectors.parse doesn't handle dense vectors of size 0 and sparse vectros with no indices

2016-04-19 Thread Maciej Szymkiewicz (JIRA)
Maciej Szymkiewicz created SPARK-14739: -- Summary: Vectors.parse doesn't handle dense vectors of size 0 and sparse vectros with no indices Key: SPARK-14739 URL: https://issues.apache.org/jira/browse/SPARK-1473

[jira] [Commented] (SPARK-14739) Vectors.parse doesn't handle dense vectors of size 0 and sparse vectros with no indices

2016-04-19 Thread Maciej Szymkiewicz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15248994#comment-15248994 ] Maciej Szymkiewicz commented on SPARK-14739: This solves only small part of t

[jira] [Commented] (SPARK-14739) Vectors.parse doesn't handle dense vectors of size 0 and sparse vectros with no indices

2016-04-19 Thread Maciej Szymkiewicz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15249053#comment-15249053 ] Maciej Szymkiewicz commented on SPARK-14739: Sure, but your latest PR still d

[jira] [Comment Edited] (SPARK-14739) Vectors.parse doesn't handle dense vectors of size 0 and sparse vectros with no indices

2016-04-19 Thread Maciej Szymkiewicz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15249053#comment-15249053 ] Maciej Szymkiewicz edited comment on SPARK-14739 at 4/20/16 12:47 AM: -

[jira] [Commented] (SPARK-14739) Vectors.parse doesn't handle dense vectors of size 0 and sparse vectros with no indices

2016-04-19 Thread Maciej Szymkiewicz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15249061#comment-15249061 ] Maciej Szymkiewicz commented on SPARK-14739: I extracted relevant test fixes

[jira] [Created] (SPARK-9098) Inconsistent Dense Vectors hashing between PySpark and Scala

2015-07-16 Thread Maciej Szymkiewicz (JIRA)
Maciej Szymkiewicz created SPARK-9098: - Summary: Inconsistent Dense Vectors hashing between PySpark and Scala Key: SPARK-9098 URL: https://issues.apache.org/jira/browse/SPARK-9098 Project: Spark

[jira] [Commented] (SPARK-29212) Add common classes without using JVM backend

2019-09-26 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16938465#comment-16938465 ] Maciej Szymkiewicz commented on SPARK-29212: [~podongfeng] First of all than

[jira] [Commented] (SPARK-27884) Deprecate Python 2 support in Spark 3.0

2019-09-29 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16940365#comment-16940365 ] Maciej Szymkiewicz commented on SPARK-27884: According to [related discussio

[jira] [Commented] (SPARK-29212) Add common classes without using JVM backend

2019-10-02 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16942809#comment-16942809 ] Maciej Szymkiewicz commented on SPARK-29212: [~podongfeng] It sounds about r

[jira] [Comment Edited] (SPARK-29212) Add common classes without using JVM backend

2019-10-02 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16942809#comment-16942809 ] Maciej Szymkiewicz edited comment on SPARK-29212 at 10/2/19 1:41 PM: -

[jira] [Commented] (SPARK-13802) Fields order in Row(**kwargs) is not consistent with Schema.toInternal method

2019-10-02 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-13802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16942912#comment-16942912 ] Maciej Szymkiewicz commented on SPARK-13802: [~metasim] namedtuples are the

[jira] [Updated] (SPARK-29212) Add common classes without using JVM backend

2019-10-05 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-29212: --- Description: Copied from [https://github.com/apache/spark/pull/25776].   Maciej's

[jira] [Updated] (SPARK-29212) Add common classes without using JVM backend

2019-10-05 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-29212: --- Description: Copied from [https://github.com/apache/spark/pull/25776].   Maciej's

[jira] [Updated] (SPARK-29212) Add common classes without using JVM backend

2019-10-05 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-29212: --- Description: Copied from [https://github.com/apache/spark/pull/25776].   Maciej's

[jira] [Updated] (SPARK-29212) Add common classes without using JVM backend

2019-10-05 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-29212: --- Description: Copied from [https://github.com/apache/spark/pull/25776].   Maciej's

[jira] [Updated] (SPARK-29212) Add common classes without using JVM backend

2019-10-05 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-29212: --- Description: Copied from [https://github.com/apache/spark/pull/25776].   Maciej's

[jira] [Updated] (SPARK-29212) Add common classes without using JVM backend

2019-10-05 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-29212: --- Description: Copied from [https://github.com/apache/spark/pull/25776].   Maciej's

[jira] [Commented] (SPARK-29212) Add common classes without using JVM backend

2019-10-05 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16945025#comment-16945025 ] Maciej Szymkiewicz commented on SPARK-29212: [~podongfeng] I've formalized t

[jira] [Updated] (SPARK-29212) Add common classes without using JVM backend

2019-10-05 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-29212: --- Description: Copied from [https://github.com/apache/spark/pull/25776].   Maciej's

[jira] [Created] (SPARK-29363) o.a.s.ml.regression.Regressor should be public

2019-10-05 Thread Maciej Szymkiewicz (Jira)
Maciej Szymkiewicz created SPARK-29363: -- Summary: o.a.s.ml.regression.Regressor should be public Key: SPARK-29363 URL: https://issues.apache.org/jira/browse/SPARK-29363 Project: Spark Is

[jira] [Commented] (SPARK-29748) Remove sorting of fields in PySpark SQL Row creation

2019-11-13 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16973695#comment-16973695 ] Maciej Szymkiewicz commented on SPARK-29748: While this is a step in the rig

[jira] [Comment Edited] (SPARK-29748) Remove sorting of fields in PySpark SQL Row creation

2019-11-13 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16973695#comment-16973695 ] Maciej Szymkiewicz edited comment on SPARK-29748 at 11/13/19 9:11 PM:

[jira] [Comment Edited] (SPARK-29748) Remove sorting of fields in PySpark SQL Row creation

2019-11-13 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16973695#comment-16973695 ] Maciej Szymkiewicz edited comment on SPARK-29748 at 11/13/19 9:13 PM:

[jira] [Commented] (SPARK-29748) Remove sorting of fields in PySpark SQL Row creation

2019-11-15 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16975054#comment-16975054 ] Maciej Szymkiewicz commented on SPARK-29748: [~jhereth] {quote}With simply

[jira] [Commented] (SPARK-28264) Revisiting Python / pandas UDF

2019-12-30 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17005500#comment-17005500 ] Maciej Szymkiewicz commented on SPARK-28264: Thanks [~hyukjin.kwon]. In gen

[jira] [Commented] (SPARK-27692) Optimize evaluation of udf that is deterministic and has literal inputs

2019-12-31 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17006127#comment-17006127 ] Maciej Szymkiewicz commented on SPARK-27692: Could you explain what is the v

[jira] [Updated] (SPARK-29748) Remove sorting of fields in PySpark SQL Row creation

2020-01-10 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-29748: --- Labels: release-notes (was: ) > Remove sorting of fields in PySpark SQL Row creatio

[jira] [Created] (SPARK-30493) pyspark.ml.classification.OneVsRestModel shouldn't have setClassifier method

2020-01-12 Thread Maciej Szymkiewicz (Jira)
Maciej Szymkiewicz created SPARK-30493: -- Summary: pyspark.ml.classification.OneVsRestModel shouldn't have setClassifier method Key: SPARK-30493 URL: https://issues.apache.org/jira/browse/SPARK-30493

[jira] [Updated] (SPARK-30493) pyspark.ml.classification.OneVsRestModel shouldn't have setClassifier method

2020-01-12 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-30493: --- Description: Problem introduced with SPARK-29093. > pyspark.ml.classification.OneVsR

[jira] [Updated] (SPARK-30493) pyspark.ml.classification.OneVsRestModel shouldn't have setClassifier, setLabelCol, setWeightCol and methods

2020-01-12 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-30493: --- Summary: pyspark.ml.classification.OneVsRestModel shouldn't have setClassifier, setL

[jira] [Updated] (SPARK-30493) pyspark.ml.classification.OneVsRestModel shouldn't have setClassifier, setLabelCol, setWeightCol and methods

2020-01-12 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-30493: --- Description: These methods don't makes sense in a model, and not present in the Scal

[jira] [Updated] (SPARK-30493) pyspark.ml.classification.OneVsRestModel shouldn't have setClassifier, setLabelCol and setWeightCol methods

2020-01-12 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-30493: --- Summary: pyspark.ml.classification.OneVsRestModel shouldn't have setClassifier, setL

[jira] [Created] (SPARK-30504) OneVsRest and OneVsRestModel _from_java and _to_java should handle weightCol

2020-01-13 Thread Maciej Szymkiewicz (Jira)
Maciej Szymkiewicz created SPARK-30504: -- Summary: OneVsRest and OneVsRestModel _from_java and _to_java should handle weightCol Key: SPARK-30504 URL: https://issues.apache.org/jira/browse/SPARK-30504

[jira] [Updated] (SPARK-30504) OneVsRest and OneVsRestModel _from_java and _to_java should handle weightCol

2020-01-13 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-30504: --- Description: Current behaviour {code:python} from pyspark.ml.classification import

[jira] [Created] (SPARK-30533) Add classes to represent Java Regressors and RegressionModels

2020-01-16 Thread Maciej Szymkiewicz (Jira)
Maciej Szymkiewicz created SPARK-30533: -- Summary: Add classes to represent Java Regressors and RegressionModels Key: SPARK-30533 URL: https://issues.apache.org/jira/browse/SPARK-30533 Project: Sp

[jira] [Updated] (SPARK-30533) Add classes to represent Java Regressors and RegressionModels

2020-01-16 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-30533: --- Parent: SPARK-28958 Issue Type: Sub-task (was: Bug) > Add classes to repres

[jira] [Created] (SPARK-30569) Add DSL functions invoking percentile_approx

2020-01-19 Thread Maciej Szymkiewicz (Jira)
Maciej Szymkiewicz created SPARK-30569: -- Summary: Add DSL functions invoking percentile_approx Key: SPARK-30569 URL: https://issues.apache.org/jira/browse/SPARK-30569 Project: Spark Issu

[jira] [Created] (SPARK-30607) overlay wrappers for SparkR and PySpark

2020-01-22 Thread Maciej Szymkiewicz (Jira)
Maciej Szymkiewicz created SPARK-30607: -- Summary: overlay wrappers for SparkR and PySpark Key: SPARK-30607 URL: https://issues.apache.org/jira/browse/SPARK-30607 Project: Spark Issue Typ

[jira] [Created] (SPARK-30611) Update testthat dependency

2020-01-22 Thread Maciej Szymkiewicz (Jira)
Maciej Szymkiewicz created SPARK-30611: -- Summary: Update testthat dependency Key: SPARK-30611 URL: https://issues.apache.org/jira/browse/SPARK-30611 Project: Spark Issue Type: Improvemen

[jira] [Commented] (SPARK-30817) SparkR ML algorithms parity

2020-07-28 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1713#comment-1713 ] Maciej Szymkiewicz commented on SPARK-30817: [~dan_z] I think we're in-sync

[jira] [Created] (SPARK-32814) Metaclasses are broken for a few classes in Python 3

2020-09-07 Thread Maciej Szymkiewicz (Jira)
Maciej Szymkiewicz created SPARK-32814: -- Summary: Metaclasses are broken for a few classes in Python 3 Key: SPARK-32814 URL: https://issues.apache.org/jira/browse/SPARK-32814 Project: Spark

[jira] [Commented] (SPARK-32814) Metaclasses are broken for a few classes in Python 3

2020-09-07 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17191967#comment-17191967 ] Maciej Szymkiewicz commented on SPARK-32814: https://github.com/apache/spark

[jira] [Issue Comment Deleted] (SPARK-32814) Metaclasses are broken for a few classes in Python 3

2020-09-07 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-32814: --- Comment: was deleted (was: https://github.com/apache/spark/pull/29591) > Metaclasse

[jira] [Commented] (SPARK-32814) Metaclasses are broken for a few classes in Python 3

2020-09-07 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17191969#comment-17191969 ] Maciej Szymkiewicz commented on SPARK-32814: https://github.com/apache/spark

[jira] [Created] (SPARK-32933) Use keyword-only syntax for keyword_only methods

2020-09-18 Thread Maciej Szymkiewicz (Jira)
Maciej Szymkiewicz created SPARK-32933: -- Summary: Use keyword-only syntax for keyword_only methods Key: SPARK-32933 URL: https://issues.apache.org/jira/browse/SPARK-32933 Project: Spark

[jira] [Created] (SPARK-32946) Add withField function to SparkR

2020-09-19 Thread Maciej Szymkiewicz (Jira)
Maciej Szymkiewicz created SPARK-32946: -- Summary: Add withField function to SparkR Key: SPARK-32946 URL: https://issues.apache.org/jira/browse/SPARK-32946 Project: Spark Issue Type: Impr

[jira] [Created] (SPARK-32949) Add timestamp_seconds to SparkR

2020-09-20 Thread Maciej Szymkiewicz (Jira)
Maciej Szymkiewicz created SPARK-32949: -- Summary: Add timestamp_seconds to SparkR Key: SPARK-32949 URL: https://issues.apache.org/jira/browse/SPARK-32949 Project: Spark Issue Type: Impro

[jira] [Commented] (SPARK-32933) Use keyword-only syntax for keyword_only methods

2020-09-23 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17201017#comment-17201017 ] Maciej Szymkiewicz commented on SPARK-32933: Not a problem [~hyukjin.kwon].

[jira] [Created] (SPARK-33002) Post-port removal of non-API stubs

2020-09-26 Thread Maciej Szymkiewicz (Jira)
Maciej Szymkiewicz created SPARK-33002: -- Summary: Post-port removal of non-API stubs Key: SPARK-33002 URL: https://issues.apache.org/jira/browse/SPARK-33002 Project: Spark Issue Type: Su

[jira] [Created] (SPARK-33003) Add type hints guideliness to the documentation

2020-09-26 Thread Maciej Szymkiewicz (Jira)
Maciej Szymkiewicz created SPARK-33003: -- Summary: Add type hints guideliness to the documentation Key: SPARK-33003 URL: https://issues.apache.org/jira/browse/SPARK-33003 Project: Spark I

[jira] [Created] (SPARK-33030) Add nth_value in SparkR API

2020-09-29 Thread Maciej Szymkiewicz (Jira)
Maciej Szymkiewicz created SPARK-33030: -- Summary: Add nth_value in SparkR API Key: SPARK-33030 URL: https://issues.apache.org/jira/browse/SPARK-33030 Project: Spark Issue Type: Improveme

[jira] [Created] (SPARK-33040) Add SparkR API for invoking vector_to_array

2020-09-30 Thread Maciej Szymkiewicz (Jira)
Maciej Szymkiewicz created SPARK-33040: -- Summary: Add SparkR API for invoking vector_to_array Key: SPARK-33040 URL: https://issues.apache.org/jira/browse/SPARK-33040 Project: Spark Issue

[jira] [Created] (SPARK-33054) Support interval type in PySpark

2020-10-02 Thread Maciej Szymkiewicz (Jira)
Maciej Szymkiewicz created SPARK-33054: -- Summary: Support interval type in PySpark Key: SPARK-33054 URL: https://issues.apache.org/jira/browse/SPARK-33054 Project: Spark Issue Type: Impr

[jira] [Created] (SPARK-33055) Add support for CalendarIntervalType in PySpark schema

2020-10-02 Thread Maciej Szymkiewicz (Jira)
Maciej Szymkiewicz created SPARK-33055: -- Summary: Add support for CalendarIntervalType in PySpark schema Key: SPARK-33055 URL: https://issues.apache.org/jira/browse/SPARK-33055 Project: Spark

[jira] [Created] (SPARK-33056) Add mapping between external Python types and CalendarIntervalType

2020-10-02 Thread Maciej Szymkiewicz (Jira)
Maciej Szymkiewicz created SPARK-33056: -- Summary: Add mapping between external Python types and CalendarIntervalType Key: SPARK-33056 URL: https://issues.apache.org/jira/browse/SPARK-33056 Projec

[jira] [Commented] (SPARK-33003) Add type hints guideliness to the documentation

2020-10-07 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17209419#comment-17209419 ] Maciej Szymkiewicz commented on SPARK-33003: [~hyukjin.kwon] Do you think we

[jira] [Created] (SPARK-33086) Provide static annotatiions for pyspark.resource.* modules

2020-10-07 Thread Maciej Szymkiewicz (Jira)
Maciej Szymkiewicz created SPARK-33086: -- Summary: Provide static annotatiions for pyspark.resource.* modules Key: SPARK-33086 URL: https://issues.apache.org/jira/browse/SPARK-33086 Project: Spark

[jira] [Created] (SPARK-33105) Broken installation of source packages on AppVeyor

2020-10-09 Thread Maciej Szymkiewicz (Jira)
Maciej Szymkiewicz created SPARK-33105: -- Summary: Broken installation of source packages on AppVeyor Key: SPARK-33105 URL: https://issues.apache.org/jira/browse/SPARK-33105 Project: Spark

[jira] [Updated] (SPARK-33105) Broken installation of source packages on AppVeyor

2020-10-09 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-33105: --- Description: It looks like AppVeyor configuration is broken, which leads to failure

[jira] [Created] (SPARK-30629) cleanClosure on recursive call leads to node stack overflow

2020-01-23 Thread Maciej Szymkiewicz (Jira)
Maciej Szymkiewicz created SPARK-30629: -- Summary: cleanClosure on recursive call leads to node stack overflow Key: SPARK-30629 URL: https://issues.apache.org/jira/browse/SPARK-30629 Project: Spar

[jira] [Created] (SPARK-30645) collect() support Unicode charactes tests fails on Windows

2020-01-25 Thread Maciej Szymkiewicz (Jira)
Maciej Szymkiewicz created SPARK-30645: -- Summary: collect() support Unicode charactes tests fails on Windows Key: SPARK-30645 URL: https://issues.apache.org/jira/browse/SPARK-30645 Project: Spark

[jira] [Commented] (SPARK-30629) cleanClosure on recursive call leads to node stack overflow

2020-01-25 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17023706#comment-17023706 ] Maciej Szymkiewicz commented on SPARK-30629: OK, so I checked and it looks l

[jira] [Commented] (SPARK-30629) cleanClosure on recursive call leads to node stack overflow

2020-01-25 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17023708#comment-17023708 ] Maciej Szymkiewicz commented on SPARK-30629: CC [~mengxr] [~falaki] > clean

[jira] [Updated] (SPARK-30629) cleanClosure on recursive call leads to node stack overflow

2020-01-25 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-30629: --- Description: This problem surfaced while handling SPARK-22817. In theory there are t

[jira] [Updated] (SPARK-30629) cleanClosure on recursive call leads to node stack overflow

2020-01-25 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-30629: --- Description: This problem surfaced while handling SPARK-22817. In theory there are t

[jira] [Commented] (SPARK-30629) cleanClosure on recursive call leads to node stack overflow

2020-01-25 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17023711#comment-17023711 ] Maciej Szymkiewicz commented on SPARK-30629: [~falaki] Fair enough, but the

[jira] [Comment Edited] (SPARK-30629) cleanClosure on recursive call leads to node stack overflow

2020-01-25 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17023711#comment-17023711 ] Maciej Szymkiewicz edited comment on SPARK-30629 at 1/26/20 2:42 AM: -

[jira] [Comment Edited] (SPARK-30629) cleanClosure on recursive call leads to node stack overflow

2020-01-25 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17023711#comment-17023711 ] Maciej Szymkiewicz edited comment on SPARK-30629 at 1/26/20 2:46 AM: -

[jira] [Commented] (SPARK-30629) cleanClosure on recursive call leads to node stack overflow

2020-01-25 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17023713#comment-17023713 ] Maciej Szymkiewicz commented on SPARK-30629: Thanks for clarification, I'll

[jira] [Commented] (SPARK-30629) cleanClosure on recursive call leads to node stack overflow

2020-01-25 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17023714#comment-17023714 ] Maciej Szymkiewicz commented on SPARK-30629: Although I still have some doub

[jira] [Commented] (SPARK-30629) cleanClosure on recursive call leads to node stack overflow

2020-01-25 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17023717#comment-17023717 ] Maciej Szymkiewicz commented on SPARK-30629: Makes sense. I guess if we have

[jira] [Created] (SPARK-30663) Remove 1.x testthat switch once Jenkins version is updated to 2.x

2020-01-28 Thread Maciej Szymkiewicz (Jira)
Maciej Szymkiewicz created SPARK-30663: -- Summary: Remove 1.x testthat switch once Jenkins version is updated to 2.x Key: SPARK-30663 URL: https://issues.apache.org/jira/browse/SPARK-30663 Project

[jira] [Updated] (SPARK-30663) Remove 1.x testthat switch once Jenkins version is updated to 2.x

2020-01-28 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-30663: --- Description: As part of SPARK-23435 proposal we include {{testthat}} 1.x compatibili

[jira] [Updated] (SPARK-30663) Remove 1.x testthat switch once Jenkins version is updated to 2.x

2020-01-28 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-30663: --- Issue Type: Planned Work (was: Bug) > Remove 1.x testthat switch once Jenkins versi

[jira] [Created] (SPARK-30681) Add higher order functions API to PySpark

2020-01-30 Thread Maciej Szymkiewicz (Jira)
Maciej Szymkiewicz created SPARK-30681: -- Summary: Add higher order functions API to PySpark Key: SPARK-30681 URL: https://issues.apache.org/jira/browse/SPARK-30681 Project: Spark Issue T

[jira] [Created] (SPARK-30682) Add higher order functions API to SparkR

2020-01-30 Thread Maciej Szymkiewicz (Jira)
Maciej Szymkiewicz created SPARK-30682: -- Summary: Add higher order functions API to SparkR Key: SPARK-30682 URL: https://issues.apache.org/jira/browse/SPARK-30682 Project: Spark Issue Ty

[jira] [Updated] (SPARK-30681) Add higher order functions API to PySpark

2020-01-30 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-30681: --- Description: As of 3.0.0 higher order functions are available in SQL and Scala, but

[jira] [Created] (SPARK-30747) Update roxygen2 to 7.0.1

2020-02-06 Thread Maciej Szymkiewicz (Jira)
Maciej Szymkiewicz created SPARK-30747: -- Summary: Update roxygen2 to 7.0.1 Key: SPARK-30747 URL: https://issues.apache.org/jira/browse/SPARK-30747 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-30747) Update roxygen2 to 7.0.1

2020-02-06 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-30747: --- Description: Currently Spark uses {{roxygen2}} 5.0.1. It is already pretty old (2015

[jira] [Commented] (SPARK-30747) Update roxygen2 to 7.0.1

2020-02-06 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17031471#comment-17031471 ] Maciej Szymkiewicz commented on SPARK-30747: CC [~felixcheung] [~hyukjin.kwo

[jira] [Created] (SPARK-30817) SparkR ML algorithms parity

2020-02-13 Thread Maciej Szymkiewicz (Jira)
Maciej Szymkiewicz created SPARK-30817: -- Summary: SparkR ML algorithms parity Key: SPARK-30817 URL: https://issues.apache.org/jira/browse/SPARK-30817 Project: Spark Issue Type: Umbrella

[jira] [Created] (SPARK-30818) Add LinearRegression wrapper to SparkR

2020-02-13 Thread Maciej Szymkiewicz (Jira)
Maciej Szymkiewicz created SPARK-30818: -- Summary: Add LinearRegression wrapper to SparkR Key: SPARK-30818 URL: https://issues.apache.org/jira/browse/SPARK-30818 Project: Spark Issue Type

[jira] [Created] (SPARK-30819) Add FMRegressor wrapper to SparkR

2020-02-13 Thread Maciej Szymkiewicz (Jira)
Maciej Szymkiewicz created SPARK-30819: -- Summary: Add FMRegressor wrapper to SparkR Key: SPARK-30819 URL: https://issues.apache.org/jira/browse/SPARK-30819 Project: Spark Issue Type: Sub

[jira] [Created] (SPARK-30820) Add FMClassifier to SparkR

2020-02-13 Thread Maciej Szymkiewicz (Jira)
Maciej Szymkiewicz created SPARK-30820: -- Summary: Add FMClassifier to SparkR Key: SPARK-30820 URL: https://issues.apache.org/jira/browse/SPARK-30820 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-32084) Replace dictionary-based function definitions to proper functions in functions.py

2020-10-19 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17217339#comment-17217339 ] Maciej Szymkiewicz commented on SPARK-32084: [~hyukjin.kwon] I can work on t

[jira] [Commented] (SPARK-32084) Replace dictionary-based function definitions to proper functions in functions.py

2020-10-20 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17217914#comment-17217914 ] Maciej Szymkiewicz commented on SPARK-32084: I got that part and I fully agr

[jira] [Updated] (SPARK-32085) Migrate to NumPy documentation style

2020-10-22 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-32085: --- Description: https://github.com/numpy/numpydoc For example, Before: https://githu

[jira] [Created] (SPARK-33257) Support Column inputs in PySpark ordering functions (asc*, desc*)

2020-10-27 Thread Maciej Szymkiewicz (Jira)
Maciej Szymkiewicz created SPARK-33257: -- Summary: Support Column inputs in PySpark ordering functions (asc*, desc*) Key: SPARK-33257 URL: https://issues.apache.org/jira/browse/SPARK-33257 Project

[jira] [Created] (SPARK-33258) Add asc_nulls_* and desc_nulls_* methods to SparkR

2020-10-27 Thread Maciej Szymkiewicz (Jira)
Maciej Szymkiewicz created SPARK-33258: -- Summary: Add asc_nulls_* and desc_nulls_* methods to SparkR Key: SPARK-33258 URL: https://issues.apache.org/jira/browse/SPARK-33258 Project: Spark

[jira] [Commented] (SPARK-33251) Migration to NumPy documentation style in ML (pyspark.ml.*)

2020-10-29 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17222748#comment-17222748 ] Maciej Szymkiewicz commented on SPARK-33251: Let me work on this one. > Mig

[jira] [Created] (SPARK-33304) Add from_avro and to_avro functions to SparkR

2020-10-30 Thread Maciej Szymkiewicz (Jira)
Maciej Szymkiewicz created SPARK-33304: -- Summary: Add from_avro and to_avro functions to SparkR Key: SPARK-33304 URL: https://issues.apache.org/jira/browse/SPARK-33304 Project: Spark Iss

[jira] [Created] (SPARK-33313) R/run-tests.sh is not compatible with testthat >= 3.0

2020-11-01 Thread Maciej Szymkiewicz (Jira)
Maciej Szymkiewicz created SPARK-33313: -- Summary: R/run-tests.sh is not compatible with testthat >= 3.0 Key: SPARK-33313 URL: https://issues.apache.org/jira/browse/SPARK-33313 Project: Spark

<    1   2   3   4   5   6   7   >