[ https://issues.apache.org/jira/browse/SPARK-30409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Dongjoon Hyun reassigned SPARK-30409: ------------------------------------- Assignee: Maxim Gekk > Use `NoOp` datasource in SQL benchmarks > --------------------------------------- > > Key: SPARK-30409 > URL: https://issues.apache.org/jira/browse/SPARK-30409 > Project: Spark > Issue Type: Test > Components: SQL > Affects Versions: 2.4.4 > Reporter: Maxim Gekk > Assignee: Maxim Gekk > Priority: Major > > Currently, SQL benchmarks use `count()`, `collect()` and `foreach(_ => ())` > actions. The actions have additional overhead. For example, `collect()` > converts column values to external type values and pull data on the driver. > Need to unify benchmark and the `NoOp` datasource except the benchmarks for > `count()` or `collect()` -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org