Given popularity of related SO questions:
- https://stackoverflow.com/q/41670103/1560062 - https://stackoverflow.com/q/42465568/1560062 - https://stackoverflow.com/q/41670103/1560062 it is probably more "nobody thought about asking", than "it is not used often". On Wed, 22 Aug 2018 at 00:07, Reynold Xin <r...@databricks.com> wrote: > Probably just because it is not used that often and nobody has submitted a > patch for it. I've used pivot probably on average once a week (primarily in > spreadsheets), but I've never used unpivot ... > > > On Tue, Aug 21, 2018 at 3:06 PM Ivan Gozali <i...@lecida.com> wrote: > >> Hi there, >> >> I was looking into why the UNPIVOT feature isn't implemented, given that >> Spark already has PIVOT implemented natively in the DataFrame/Dataset API. >> >> Came across this JIRA <https://issues.apache.org/jira/browse/SPARK-8992> >> which >> talks about implementing PIVOT in Spark 1.6, but no mention whatsoever >> regarding UNPIVOT, even though the JIRA curiously references a blog post >> that talks about both PIVOT and UNPIVOT :) >> >> Is this because UNPIVOT is just simply generating multiple slim tables by >> selecting each column, and making a union out of all of them? >> >> Thank you! >> >> -- >> Regards, >> >> >> Ivan Gozali >> Lecida >> Email: i...@lecida.com >> >
