Hi all, I am trying to improve PySpark documentation especially:
- Make the examples self-contained, e.g., https://pandas.pydata.org/docs/reference/api/pandas.DataFrame.pivot.html - Document Parameters https://pandas.pydata.org/docs/reference/api/pandas.DataFrame.pivot.html#pandas.DataFrame.pivot. There are many API that misses parameters in PySpark, e.g., DataFrame.union Here is one example PR I am working on: https://github.com/apache/spark/pull/37437 I can't do it all by myself. Any help, review, and contributions would be welcome and appreciated. Thank you all in advance.