Hi, I have a dataframe with some columns and data that is fetched from JDBC, as i have to maintain the schema consistent in the ORC file i have to apply different schema for that dataframe. Column names will be same, but Data or Schema may contain some extra columns.
Is there any way i can apply the schema on top the existing Dataframe ?. Schema may be just doing the columns reordering in the most of the cases. i have tried this " DataFrame dfNew = hc.createDataFrame(df.rdd(), ((StructType) DataType.fromJson(schema))); " But this will map the columns based on index and it will fail in case of columns reordering. Any pointers will be helpful. Thanks and Regards Manjunath Shetty