[jira] [Commented] (SPARK-25102) Write Spark version to ORC/Parquet file metadata

2020-04-07 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17077536#comment-17077536 ] Dongjoon Hyun commented on SPARK-25102: --- This is backported to `branch-2.4` via

[jira] [Commented] (SPARK-25102) Write Spark version to ORC/Parquet file metadata

2020-04-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17076922#comment-17076922 ] Hyukjin Kwon commented on SPARK-25102: -- Thank you [~dongjoon] :-). > Write Spark version to

[jira] [Commented] (SPARK-25102) Write Spark version to ORC/Parquet file metadata

2020-04-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17076915#comment-17076915 ] Dongjoon Hyun commented on SPARK-25102: --- I also chatted with [~cloud_fan] a few hours ago. Given

[jira] [Commented] (SPARK-25102) Write Spark version to ORC/Parquet file metadata

2020-04-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17076856#comment-17076856 ] Hyukjin Kwon commented on SPARK-25102: -- I think .. it became slightly off topic. This metadata is

[jira] [Commented] (SPARK-25102) Write Spark version to ORC/Parquet file metadata

2020-04-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17076658#comment-17076658 ] Dongjoon Hyun commented on SPARK-25102: --- In that case, like all the other 2.x versions, `None`

[jira] [Commented] (SPARK-25102) Write Spark version to ORC/Parquet file metadata

2020-04-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17076044#comment-17076044 ] Wenchen Fan commented on SPARK-25102: - I don't plan to have more releases, but 2.4.6 is not released

[jira] [Commented] (SPARK-25102) Write Spark version to ORC/Parquet file metadata

2020-04-03 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17074689#comment-17074689 ] Dongjoon Hyun commented on SPARK-25102: --- Are we going to have 2.4.7 or 2.4.8? For now, 2.4.6 is

[jira] [Commented] (SPARK-25102) Write Spark version to ORC/Parquet file metadata

2020-04-03 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17074434#comment-17074434 ] Wenchen Fan commented on SPARK-25102: - I'd like to propose to backport it to 2.4. It's very

[jira] [Commented] (SPARK-25102) Write Spark version to ORC/Parquet file metadata

2020-03-31 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17071926#comment-17071926 ] Dongjoon Hyun commented on SPARK-25102: --- Thanks, [~cloud_fan]. > Write Spark version to

[jira] [Commented] (SPARK-25102) Write Spark version to ORC/Parquet file metadata

2020-03-31 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17071803#comment-17071803 ] Wenchen Fan commented on SPARK-25102: - ok nvm, I checked ORC and it doesn't have the "createdBy"

[jira] [Commented] (SPARK-25102) Write Spark version to ORC/Parquet file metadata

2020-03-31 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17071692#comment-17071692 ] Wenchen Fan commented on SPARK-25102: - It's not completely orthogonal as we can merge these two.

[jira] [Commented] (SPARK-25102) Write Spark version to ORC/Parquet file metadata

2020-03-27 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17069167#comment-17069167 ] Dongjoon Hyun commented on SPARK-25102: --- [~cloud_fan]. That sounds like an orthogonal issue. Could

[jira] [Commented] (SPARK-25102) Write Spark version to ORC/Parquet file metadata

2020-03-27 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17068616#comment-17068616 ] Wenchen Fan commented on SPARK-25102: - Shall we also fill the `createdBy` field in the parquet

[jira] [Commented] (SPARK-25102) Write Spark version to ORC/Parquet file metadata

2018-11-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16673948#comment-16673948 ] Apache Spark commented on SPARK-25102: -- User 'dongjoon-hyun' has created a pull request for this