[jira] [Updated] (SPARK-19615) Provide Dataset union convenience for divergent schema
[ https://issues.apache.org/jira/browse/SPARK-19615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-19615: - Labels: bulk-closed (was: ) > Provide Dataset union convenience for divergent schema > -- > > Key: SPARK-19615 > URL: https://issues.apache.org/jira/browse/SPARK-19615 > Project: Spark > Issue Type: Improvement > Components: SQL >Affects Versions: 2.1.0 >Reporter: Nick Dimiduk >Priority: Major > Labels: bulk-closed > > Creating a union DataFrame over two sources that have different schema > definitions is surprisingly complex. Provide a version of the union method > that will create a infer a target schema as the result of merging the > sources. Automatically add extend either side with {{null}} columns for any > missing columns that are nullable. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-19615) Provide Dataset union convenience for divergent schema
[ https://issues.apache.org/jira/browse/SPARK-19615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Dimiduk updated SPARK-19615: - Priority: Major (was: Minor) > Provide Dataset union convenience for divergent schema > -- > > Key: SPARK-19615 > URL: https://issues.apache.org/jira/browse/SPARK-19615 > Project: Spark > Issue Type: Improvement > Components: SQL >Affects Versions: 2.1.0 >Reporter: Nick Dimiduk > > Creating a union DataFrame over two sources that have different schema > definitions is surprisingly complex. Provide a version of the union method > that will create a infer a target schema as the result of merging the > sources. Automatically add extend either side with {{null}} columns for any > missing columns that are nullable. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org