Re: How to get a clean DataFrame schema merge

2015-04-15 Thread Michael Armbrust
Schema merging is not the feature you are looking for. It is designed when you are adding new records (that are not associated with old records), which may or may not have new or missing columns. In your case it looks like you have two datasets that you want to load separately and join on a key.

How to get a clean DataFrame schema merge

2015-04-15 Thread Jaonary Rabarisoa
Hi all, If you follow the example of schema merging in the spark documentation http://spark.apache.org/docs/latest/sql-programming-guide.html#schema-merging you obtain the following results when you want to load the result data : single triple double 1 3 null 2 6 null 4 1