Nick Dimiduk created SPARK-19615: ------------------------------------ Summary: Provide Dataset union convenience for divergent schema Key: SPARK-19615 URL: https://issues.apache.org/jira/browse/SPARK-19615 Project: Spark Issue Type: Improvement Components: SQL Affects Versions: 2.1.0 Reporter: Nick Dimiduk Priority: Minor
Creating a union DataFrame over two sources that have different schema definitions is surprisingly complex. Provide a version of the union method that will create a infer a target schema as the result of merging the sources. Automatically add extend either side with {{null}} columns for any missing columns that are nullable. -- This message was sent by Atlassian JIRA (v6.3.15#6346) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org