Haejoon Lee created SPARK-37036: ----------------------------------- Summary: Add util function to raise advice warning for pandas API on Spark. Key: SPARK-37036 URL: https://issues.apache.org/jira/browse/SPARK-37036 Project: Spark Issue Type: Improvement Components: PySpark Affects Versions: 3.2.0 Reporter: Haejoon Lee
Pandas API on Spark has some features that potentially cause the performance degradation or an unexpected behavior e.g. `sort_index`, `index_col`, `to_pandas`, etc. We should raise the proper advice warning for those functions so that users can adjust their pandas-on-Spark code base more robust. -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org