Re: How to change Dataframe schema

2020-05-16 Thread Adi Polak
Hi Manjunath, Can you share the data example? >From the information shared above, it seems that you will need to apply mapping with custom logic on the rows in your RDD to be consistent before you can apply the schema. I recommend reading about the mapping functionality here: https://data-flair.tr

How to change Dataframe schema

2020-05-16 Thread Manjunath Shetty H
Hi, I have a dataframe with some columns and data that is fetched from JDBC, as i have to maintain the schema consistent in the ORC file i have to apply different schema for that dataframe. Column names will be same, but Data or Schema may contain some extra columns. Is there any way i can app