[ https://issues.apache.org/jira/browse/SPARK-25475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Dongjoon Hyun updated SPARK-25475: ---------------------------------- Description: This is an umbrella issue to refactor all benchmarks to use a common style using main-method (instead of `test` method) and saving the result as a separate file (instead of embedding as comments). This is not only for consistency, but also for making the benchmark-automation easy. SPARK-25339 is finished as a reference model. *Completed* - FilterPushdownBenchmark.scala (SPARK-25339) *Candidates* - AggregateBenchmark.scala - AvroWriteBenchmark.scala (SPARK-24777) - ColumnarBatchBenchmark.scala - CompressionSchemeBenchmark.scala - DataSourceReadBenchmark.scala - DataSourceWriteBenchmark.scala (SPARK-24777) - DatasetBenchmark.scala - ExternalAppendOnlyUnsafeRowArrayBenchmark.scala - HashBenchmark.scala - HashByteArrayBenchmark.scala - JoinBenchmark.scala - KryoBenchmark.scala - MiscBenchmark.scala - ObjectHashAggregateExecBenchmark.scala - OrcReadBenchmark.scala - PrimitiveArrayBenchmark.scala - SortBenchmark.scala - SynthBenchmark.scala - TPCDSQueryBenchmark.scala - UDTSerializationBenchmark.scala - UnsafeArrayDataBenchmark.scala - UnsafeProjectionBenchmark.scala - WideSchemaBenchmark.scala Candidates will be reviewed and converted as a subtask of this JIRA. was: This is an umbrella issue to refactor all benchmarks to use a common style using main-method (instead of `test` method) and saving the result as a separate file (instead of embedding as comments). This is not only for consistency, but also for making the benchmark-automation easy. SPARK-25339 is finished as a reference model. *Completed* - FilterPushdownBenchmark.scala *Candidates* - AggregateBenchmark.scala - AvroWriteBenchmark.scala (SPARK-24777) - ColumnarBatchBenchmark.scala - CompressionSchemeBenchmark.scala - DataSourceReadBenchmark.scala - DataSourceWriteBenchmark.scala (SPARK-24777) - DatasetBenchmark.scala - ExternalAppendOnlyUnsafeRowArrayBenchmark.scala - HashBenchmark.scala - HashByteArrayBenchmark.scala - JoinBenchmark.scala - KryoBenchmark.scala - MiscBenchmark.scala - ObjectHashAggregateExecBenchmark.scala - OrcReadBenchmark.scala - PrimitiveArrayBenchmark.scala - SortBenchmark.scala - SynthBenchmark.scala - TPCDSQueryBenchmark.scala - UDTSerializationBenchmark.scala - UnsafeArrayDataBenchmark.scala - UnsafeProjectionBenchmark.scala - WideSchemaBenchmark.scala Candidates will be reviewed and converted as a subtask of this JIRA. > Refactor all benchmark to save the result as a separate file > ------------------------------------------------------------ > > Key: SPARK-25475 > URL: https://issues.apache.org/jira/browse/SPARK-25475 > Project: Spark > Issue Type: Improvement > Components: Tests > Affects Versions: 2.5.0 > Reporter: Dongjoon Hyun > Priority: Major > > This is an umbrella issue to refactor all benchmarks to use a common style > using main-method (instead of `test` method) and saving the result as a > separate file (instead of embedding as comments). This is not only for > consistency, but also for making the benchmark-automation easy. SPARK-25339 > is finished as a reference model. > *Completed* > - FilterPushdownBenchmark.scala (SPARK-25339) > *Candidates* > - AggregateBenchmark.scala > - AvroWriteBenchmark.scala (SPARK-24777) > - ColumnarBatchBenchmark.scala > - CompressionSchemeBenchmark.scala > - DataSourceReadBenchmark.scala > - DataSourceWriteBenchmark.scala (SPARK-24777) > - DatasetBenchmark.scala > - ExternalAppendOnlyUnsafeRowArrayBenchmark.scala > - HashBenchmark.scala > - HashByteArrayBenchmark.scala > - JoinBenchmark.scala > - KryoBenchmark.scala > - MiscBenchmark.scala > - ObjectHashAggregateExecBenchmark.scala > - OrcReadBenchmark.scala > - PrimitiveArrayBenchmark.scala > - SortBenchmark.scala > - SynthBenchmark.scala > - TPCDSQueryBenchmark.scala > - UDTSerializationBenchmark.scala > - UnsafeArrayDataBenchmark.scala > - UnsafeProjectionBenchmark.scala > - WideSchemaBenchmark.scala > Candidates will be reviewed and converted as a subtask of this JIRA. -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org