+1 This is a great idea.
On Wed, Jun 21, 2023 at 8:29 AM, Holden Karau < hol...@pigscanfly.ca > wrote: > > I’d like to start with a +1, better Python testing tools integrated into > the project make sense. > > On Wed, Jun 21, 2023 at 8:11 AM Amanda Liu < amandastephanieliu@ gmail. com > ( amandastephanie...@gmail.com ) > wrote: > > >> Hi all, >> >> I'd like to start the vote for SPIP: PySpark Test Framework. >> >> The high-level summary for the SPIP is that it proposes an official test >> framework for PySpark. Currently, there are only disparate open-source >> repos and blog posts for PySpark testing resources. We can streamline and >> simplify the testing process by incorporating test features, such as a >> PySpark Test Base class (which allows tests to share Spark sessions) and >> test util functions (for example, asserting dataframe and schema >> equality). >> >> *SPIP doc:* https:/ / docs. google. com/ document/ d/ >> 1OkyBn3JbEHkkQgSQ45Lq82esXjr9rm2Vj7Ih_4zycRc/ >> edit#heading=h. f5f0u2riv07v ( >> https://docs.google.com/document/d/1OkyBn3JbEHkkQgSQ45Lq82esXjr9rm2Vj7Ih_4zycRc/edit#heading=h.f5f0u2riv07v >> ) >> >> >> *JIRA ticket:* https:/ / issues. apache. org/ jira/ browse/ SPARK-44042 ( >> https://issues.apache.org/jira/browse/SPARK-44042 ) >> >> *Discussion thread:* https:/ / lists. apache. org/ thread/ >> trwgbgn3ycoj8b8k8lkxko2hql23o41n >> ( https://lists.apache.org/thread/trwgbgn3ycoj8b8k8lkxko2hql23o41n ) >> >> Please vote on the SPIP for the next 72 hours: >> [ ] +1: Accept the proposal as an official SPIP >> [ ] +0 >> [ ] -1: I don’t think this is a good idea because __. >> >> Thank you! >> >> Best, >> Amanda Liu >> >> > > -- > Twitter: https:/ / twitter. com/ holdenkarau ( > https://twitter.com/holdenkarau ) > > Books (Learning Spark, High Performance Spark, etc.): https:/ / amzn. to/ > 2MaRAG9 > ( https://amzn.to/2MaRAG9 ) > YouTube Live Streams: https:/ / www. youtube. com/ user/ holdenkarau ( > https://www.youtube.com/user/holdenkarau ) >
smime.p7s
Description: S/MIME Cryptographic Signature
