[ https://issues.apache.org/jira/browse/SPARK-33165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17215129#comment-17215129 ]
Apache Spark commented on SPARK-33165: -------------------------------------- User 'HyukjinKwon' has created a pull request for this issue: https://github.com/apache/spark/pull/30065 > Remove dependencies(scalatest,scalactic) from Benchmark > ------------------------------------------------------- > > Key: SPARK-33165 > URL: https://issues.apache.org/jira/browse/SPARK-33165 > Project: Spark > Issue Type: Test > Components: SQL, Tests > Affects Versions: 3.0.1, 3.1.0 > Reporter: Takeshi Yamamuro > Priority: Major > Fix For: 3.0.2, 3.1.0 > > > This ticket aims at removing `assert` from `Benchmark` for making it easier > to run benchmark codes via `spark-submit`. > Since the current `Benchmark` (`master` and `branch-3.0`) has `assert`, we > need to pass the proper jars of `scalatest` and `scalactic`; > - scalatest-core_2.12-3.2.0.jar > - scalatest-compatible-3.2.0.jar > - scalactic_2.12-3.0.jar > {code} > ./bin/spark-submit --jars > scalatest-core_2.12-3.2.0.jar,scalatest-compatible-3.2.0.jar,scalactic_2.12-3.0.jar,./sql/catalyst/target/spark-catalyst_2.12-3.1.0-SNAPSHOT-tests.jar,./core/target/spark-core_2.12-3.1.0-SNAPSHOT-tests.jar > --class org.apache.spark.sql.execution.benchmark.TPCDSQueryBenchmark > ./sql/core/target/spark-sql_2.12-3.1.0-SNAPSHOT-tests.jar --data-location > /tmp/tpcds-sf1 > {code} -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org