Hi, I am trying to take union of 2 dataframes and then drop duplicate based on the value of a specific column. But, I want to make sure that while dropping duplicates, the rows from first data frame are kept.
Example: df1 = df1.union(df2).dropDuplicates(['id'])
