[jira] [Commented] (SPARK-28360) The serviceAccountName configuration item does not take effect in client mode.

[ https://issues.apache.org/jira/browse/SPARK-28360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17376901#comment-17376901 ] Mathew Wicks commented on SPARK-28360: -- [~holden] this issue is still present. That is, the docs

[jira] [Commented] (SPARK-32226) JDBC TimeStamp predicates always append `.0`

[ https://issues.apache.org/jira/browse/SPARK-32226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17156413#comment-17156413 ] Mathew Wicks commented on SPARK-32226: -- [~Chen Zhang], thanks for the idea! However, while

[jira] [Created] (SPARK-32226) JDBC TimeStamp predicates always append `.0`

Mathew Wicks created SPARK-32226: Summary: JDBC TimeStamp predicates always append `.0` Key: SPARK-32226 URL: https://issues.apache.org/jira/browse/SPARK-32226 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-26295) [K8S] serviceAccountName is not set in client mode

[ https://issues.apache.org/jira/browse/SPARK-26295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17024838#comment-17024838 ] Mathew Wicks commented on SPARK-26295: -- I am still encountering this issue on 2.4.4, (and given

[jira] [Commented] (SPARK-28360) The serviceAccountName configuration item does not take effect in client mode.

[ https://issues.apache.org/jira/browse/SPARK-28360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17024835#comment-17024835 ] Mathew Wicks commented on SPARK-28360: -- This issue was also reported for 2.4, but has not been

[jira] [Commented] (SPARK-28921) Spark jobs failing on latest versions of Kubernetes (1.15.3, 1.14.6, 1,13.10, 1.12.10, 1.11.10)

[ https://issues.apache.org/jira/browse/SPARK-28921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17023439#comment-17023439 ] Mathew Wicks commented on SPARK-28921: -- [~dongjoon], it's just very bad practice to not update all

[jira] [Commented] (SPARK-28921) Spark jobs failing on latest versions of Kubernetes (1.15.3, 1.14.6, 1,13.10, 1.12.10, 1.11.10)

[ https://issues.apache.org/jira/browse/SPARK-28921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17022625#comment-17022625 ] Mathew Wicks commented on SPARK-28921: -- It is not enough to replace the kuberntes-client.jar in

[jira] [Comment Edited] (SPARK-28921) Spark jobs failing on latest versions of Kubernetes (1.15.3, 1.14.6, 1,13.10, 1.12.10, 1.11.10)

[ https://issues.apache.org/jira/browse/SPARK-28921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17022625#comment-17022625 ] Mathew Wicks edited comment on SPARK-28921 at 1/24/20 1:03 AM: --- It is not

[jira] [Commented] (SPARK-24632) Allow 3rd-party libraries to use pyspark.ml abstractions for Java wrappers for persistence

[ https://issues.apache.org/jira/browse/SPARK-24632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16888495#comment-16888495 ] Mathew Wicks commented on SPARK-24632: -- I have an elegant solution for this: You can include a

[jira] [Created] (SPARK-28032) DataFrame.saveAsTable( in AVRO format with Timestamps create bad Hive tables

Mathew Wicks created SPARK-28032: Summary: DataFrame.saveAsTable( in AVRO format with Timestamps create bad Hive tables Key: SPARK-28032 URL: https://issues.apache.org/jira/browse/SPARK-28032

[jira] [Commented] (SPARK-28008) Default values & column comments in AVRO schema converters

[ https://issues.apache.org/jira/browse/SPARK-28008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16862699#comment-16862699 ] Mathew Wicks commented on SPARK-28008: -- The only issue I could think, would be that the column

[jira] [Created] (SPARK-28008) Default values & column comments in AVRO schema converters

Mathew Wicks created SPARK-28008: Summary: Default values & column comments in AVRO schema converters Key: SPARK-28008 URL: https://issues.apache.org/jira/browse/SPARK-28008 Project: Spark

[jira] [Comment Edited] (SPARK-17477) SparkSQL cannot handle schema evolution from Int -> Long when parquet files have Int as its type while hive metastore has Long as its type

[ https://issues.apache.org/jira/browse/SPARK-17477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847192#comment-16847192 ] Mathew Wicks edited comment on SPARK-17477 at 5/24/19 2:52 AM: --- *UPDATE:* 

[jira] [Issue Comment Deleted] (SPARK-16544) Support for conversion from compatible schema for Parquet data source when data types are not matched

[ https://issues.apache.org/jira/browse/SPARK-16544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mathew Wicks updated SPARK-16544: - Comment: was deleted (was: This only seems to be an issue if

[jira] [Commented] (SPARK-17477) SparkSQL cannot handle schema evolution from Int -> Long when parquet files have Int as its type while hive metastore has Long as its type

[ https://issues.apache.org/jira/browse/SPARK-17477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847192#comment-16847192 ] Mathew Wicks commented on SPARK-17477: -- This only seems to be an issue if

[jira] [Commented] (SPARK-16544) Support for conversion from compatible schema for Parquet data source when data types are not matched

[ https://issues.apache.org/jira/browse/SPARK-16544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847193#comment-16847193 ] Mathew Wicks commented on SPARK-16544: -- This only seems to be an issue if

[jira] [Commented] (SPARK-26388) No support for "alter table .. replace columns" to drop columns

[ https://issues.apache.org/jira/browse/SPARK-26388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16846528#comment-16846528 ] Mathew Wicks commented on SPARK-26388: -- After a bit of investigating, it seems like the 

[jira] [Commented] (SPARK-26388) No support for "alter table .. replace columns" to drop columns

[ https://issues.apache.org/jira/browse/SPARK-26388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16846490#comment-16846490 ] Mathew Wicks commented on SPARK-26388: -- This test suite seems to imply this feature is not

[jira] [Commented] (SPARK-26388) No support for "alter table .. replace columns" to drop columns

[ https://issues.apache.org/jira/browse/SPARK-26388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16846469#comment-16846469 ] Mathew Wicks commented on SPARK-26388: -- This appears to still be an issue in Spark 2.4.3.   For

[jira] [Created] (SPARK-21423) MODE average aggregate function.

Mathew Wicks created SPARK-21423: Summary: MODE average aggregate function. Key: SPARK-21423 URL: https://issues.apache.org/jira/browse/SPARK-21423 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-20353) Implement Tensorflow TFRecords file format

Mathew Wicks created SPARK-20353: Summary: Implement Tensorflow TFRecords file format Key: SPARK-20353 URL: https://issues.apache.org/jira/browse/SPARK-20353 Project: Spark Issue Type:

[jira] [Commented] (SPARK-20207) Add ablity to exclude current row in WindowSpec

[ https://issues.apache.org/jira/browse/SPARK-20207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15956403#comment-15956403 ] Mathew Wicks commented on SPARK-20207: -- A toy example is given in the StackOverflow. Although an

[jira] [Commented] (SPARK-20207) Add ablity to exclude current row in WindowSpec

[ https://issues.apache.org/jira/browse/SPARK-20207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15956372#comment-15956372 ] Mathew Wicks commented on SPARK-20207: -- Well, technically no, but it would be a good place to

[jira] [Commented] (SPARK-20207) Add ablity to exclude current row in WindowSpec

[ https://issues.apache.org/jira/browse/SPARK-20207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15956363#comment-15956363 ] Mathew Wicks commented on SPARK-20207: -- Sorry I was a bit unclear, we would want to define a window

[jira] [Created] (SPARK-20207) Add ablity to exclude current row in WindowSpec

Mathew Wicks created SPARK-20207: Summary: Add ablity to exclude current row in WindowSpec Key: SPARK-20207 URL: https://issues.apache.org/jira/browse/SPARK-20207 Project: Spark Issue Type: