[jira] [Commented] (SPARK-29358) Make unionByName optionally fill missing columns with nulls

2020-07-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17151431#comment-17151431 ] Apache Spark commented on SPARK-29358: -- User 'viirya' has created a pull request for this issue:

[jira] [Commented] (SPARK-29358) Make unionByName optionally fill missing columns with nulls

2020-07-04 Thread Syedhamjath (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17151349#comment-17151349 ] Syedhamjath commented on SPARK-29358: - I also came across same issue, if the data frame does not

[jira] [Commented] (SPARK-29358) Make unionByName optionally fill missing columns with nulls

2020-05-14 Thread Andreas Neumann (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17107775#comment-17107775 ] Andreas Neumann commented on SPARK-29358: - I would like to put a vote for this feature * It

[jira] [Commented] (SPARK-29358) Make unionByName optionally fill missing columns with nulls

2020-04-02 Thread Michael Armbrust (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17073951#comment-17073951 ] Michael Armbrust commented on SPARK-29358: -- Sure, but it is very easy to make this not a

[jira] [Commented] (SPARK-29358) Make unionByName optionally fill missing columns with nulls

2020-03-31 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17072300#comment-17072300 ] L. C. Hsieh commented on SPARK-29358: - > users might rely on the exception when the schema is

[jira] [Commented] (SPARK-29358) Make unionByName optionally fill missing columns with nulls

2020-03-31 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17072294#comment-17072294 ] Hyukjin Kwon commented on SPARK-29358: -- I am good with adding this behaviour if other committers

[jira] [Commented] (SPARK-29358) Make unionByName optionally fill missing columns with nulls

2020-03-31 Thread Michael Armbrust (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17071968#comment-17071968 ] Michael Armbrust commented on SPARK-29358: -- I think we should reconsider closing this as won't

[jira] [Commented] (SPARK-29358) Make unionByName optionally fill missing columns with nulls

2019-10-10 Thread Mukul Murthy (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16948800#comment-16948800 ] Mukul Murthy commented on SPARK-29358: -- That would be a start to make us not have to do #1, but #2

[jira] [Commented] (SPARK-29358) Make unionByName optionally fill missing columns with nulls

2019-10-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16948101#comment-16948101 ] Hyukjin Kwon commented on SPARK-29358: -- {{StructType}} has {{merge}} implementation although it's

[jira] [Commented] (SPARK-29358) Make unionByName optionally fill missing columns with nulls

2019-10-09 Thread Mukul Murthy (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16947982#comment-16947982 ] Mukul Murthy commented on SPARK-29358: -- [~hyukjin.kwon], I disagree that the workaround is pretty

[jira] [Commented] (SPARK-29358) Make unionByName optionally fill missing columns with nulls

2019-10-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16946809#comment-16946809 ] Hyukjin Kwon commented on SPARK-29358: -- Given that workaround is pretty easy, I wouldn't need the

[jira] [Commented] (SPARK-29358) Make unionByName optionally fill missing columns with nulls

2019-10-07 Thread Mukul Murthy (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16946069#comment-16946069 ] Mukul Murthy commented on SPARK-29358: -- I agree that it should not change the current behavior of

[jira] [Commented] (SPARK-29358) Make unionByName optionally fill missing columns with nulls

2019-10-04 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16944927#comment-16944927 ] L. C. Hsieh commented on SPARK-29358: - And I also concern that it is more far away from SQL union.

[jira] [Commented] (SPARK-29358) Make unionByName optionally fill missing columns with nulls

2019-10-04 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16944899#comment-16944899 ] L. C. Hsieh commented on SPARK-29358: - My concern is it breaks current behavior of unionByName. >