Hi All, Can we use bucketing with sorting functionality to save data incrementally (say daily) ? I understand bucketing is supported in Spark only with saveAsTable, however can this be used with mode "append" instead of "overwrite"?
My understanding around bucketing was, you need to rewrite entire table every time, can someone help advice? -- Regards, Rishi Shah