[jira] [Updated] (SPARK-30273) Add melt() function
[ https://issues.apache.org/jira/browse/SPARK-30273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shelby Vanhooser updated SPARK-30273: - Description: - Adds melt() functionality based on [this]([https://stackoverflow.com/a/41673644/12474509)] implementation [https://github.com/apache/spark/pull/26912/files] was:- Adds melt() functionality based on [this]([https://stackoverflow.com/a/41673644/12474509)] implementation > Add melt() function > --- > > Key: SPARK-30273 > URL: https://issues.apache.org/jira/browse/SPARK-30273 > Project: Spark > Issue Type: Improvement > Components: PySpark >Affects Versions: 2.4.4 >Reporter: Shelby Vanhooser >Priority: Major > Labels: PySpark, feature > > - Adds melt() functionality based on > [this]([https://stackoverflow.com/a/41673644/12474509)] implementation > > [https://github.com/apache/spark/pull/26912/files] -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-30273) Add melt() function
Shelby Vanhooser created SPARK-30273: Summary: Add melt() function Key: SPARK-30273 URL: https://issues.apache.org/jira/browse/SPARK-30273 Project: Spark Issue Type: Improvement Components: PySpark Affects Versions: 2.4.4 Reporter: Shelby Vanhooser - Adds melt() functionality based on [this]([https://stackoverflow.com/a/41673644/12474509)] implementation -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-30273) Add melt() function
[ https://issues.apache.org/jira/browse/SPARK-30273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shelby Vanhooser updated SPARK-30273: - Labels: PySpark feature (was: ) > Add melt() function > --- > > Key: SPARK-30273 > URL: https://issues.apache.org/jira/browse/SPARK-30273 > Project: Spark > Issue Type: Improvement > Components: PySpark >Affects Versions: 2.4.4 >Reporter: Shelby Vanhooser >Priority: Major > Labels: PySpark, feature > > - Adds melt() functionality based on > [this]([https://stackoverflow.com/a/41673644/12474509)] implementation -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-30257) Mapping simpleString to Spark SQL types
[ https://issues.apache.org/jira/browse/SPARK-30257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16995896#comment-16995896 ] Shelby Vanhooser commented on SPARK-30257: -- All tests passing! > Mapping simpleString to Spark SQL types > --- > > Key: SPARK-30257 > URL: https://issues.apache.org/jira/browse/SPARK-30257 > Project: Spark > Issue Type: Improvement > Components: PySpark >Affects Versions: 2.4.4 >Reporter: Shelby Vanhooser >Priority: Critical > > The PySpark mapping from simpleString to Spark SQL types are too manual right > now; instead, pyspark.sql.types should expose a method that maps the > simpleString representation of these types to the underlying Spark SQL ones > > Tracked here : [https://github.com/apache/spark/pull/26884] -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-30257) Mapping simpleString to Spark SQL types
[ https://issues.apache.org/jira/browse/SPARK-30257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shelby Vanhooser updated SPARK-30257: - Labels: PySpark feature (was: ) > Mapping simpleString to Spark SQL types > --- > > Key: SPARK-30257 > URL: https://issues.apache.org/jira/browse/SPARK-30257 > Project: Spark > Issue Type: Improvement > Components: PySpark >Affects Versions: 2.4.4 >Reporter: Shelby Vanhooser >Priority: Critical > Labels: PySpark, feature > > The PySpark mapping from simpleString to Spark SQL types are too manual right > now; instead, pyspark.sql.types should expose a method that maps the > simpleString representation of these types to the underlying Spark SQL ones > > Tracked here : [https://github.com/apache/spark/pull/26884] -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-30257) Mapping simpleString to Spark SQL types
[ https://issues.apache.org/jira/browse/SPARK-30257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shelby Vanhooser updated SPARK-30257: - Component/s: (was: Input/Output) PySpark > Mapping simpleString to Spark SQL types > --- > > Key: SPARK-30257 > URL: https://issues.apache.org/jira/browse/SPARK-30257 > Project: Spark > Issue Type: Improvement > Components: PySpark >Affects Versions: 2.4.4 >Reporter: Shelby Vanhooser >Priority: Critical > > The PySpark mapping from simpleString to Spark SQL types are too manual right > now; instead, pyspark.sql.types should expose a method that maps the > simpleString representation of these types to the underlying Spark SQL ones > > Tracked here : [https://github.com/apache/spark/pull/26884] -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-30257) Mapping simpleString to Spark SQL types
[ https://issues.apache.org/jira/browse/SPARK-30257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shelby Vanhooser updated SPARK-30257: - Description: The PySpark mapping from simpleString to Spark SQL types are too manual right now; instead, pyspark.sql.types should expose a method that maps the simpleString representation of these types to the underlying Spark SQL ones Tracked here : [https://github.com/apache/spark/pull/26884] was:The PySpark mapping from simpleString to Spark SQL types are too manual right now; instead, pyspark.sql.types should expose a method that maps the simpleString representation of these types to the underlying Spark SQL ones > Mapping simpleString to Spark SQL types > --- > > Key: SPARK-30257 > URL: https://issues.apache.org/jira/browse/SPARK-30257 > Project: Spark > Issue Type: Improvement > Components: Input/Output >Affects Versions: 2.4.4 >Reporter: Shelby Vanhooser >Priority: Critical > > The PySpark mapping from simpleString to Spark SQL types are too manual right > now; instead, pyspark.sql.types should expose a method that maps the > simpleString representation of these types to the underlying Spark SQL ones > > Tracked here : [https://github.com/apache/spark/pull/26884] -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-30257) Mapping simpleString to Spark SQL types
Shelby Vanhooser created SPARK-30257: Summary: Mapping simpleString to Spark SQL types Key: SPARK-30257 URL: https://issues.apache.org/jira/browse/SPARK-30257 Project: Spark Issue Type: Improvement Components: Input/Output Affects Versions: 2.4.4 Reporter: Shelby Vanhooser The PySpark mapping from simpleString to Spark SQL types are too manual right now; instead, pyspark.sql.types should expose a method that maps the simpleString representation of these types to the underlying Spark SQL ones -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-26860) RangeBetween docs appear to be wrong
Shelby Vanhooser created SPARK-26860: Summary: RangeBetween docs appear to be wrong Key: SPARK-26860 URL: https://issues.apache.org/jira/browse/SPARK-26860 Project: Spark Issue Type: Bug Components: PySpark Affects Versions: 2.4.0 Reporter: Shelby Vanhooser The docs describing [RangeBetween|http://spark.apache.org/docs/2.4.0/api/python/_modules/pyspark/sql/window.html#Window.rangeBetween] for PySpark appear to be duplicates of [RowsBetween|http://spark.apache.org/docs/2.4.0/api/python/_modules/pyspark/sql/window.html#Window.rowsBetween] even though these are functionally different windows. Rows between reference proceeding and succeeding rows, but rangeBetween is based on the values in these rows. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
