Greg Hogan created FLINK-3279: --------------------------------- Summary: Optionally disable DistinctOperator combiner Key: FLINK-3279 URL: https://issues.apache.org/jira/browse/FLINK-3279 Project: Flink Issue Type: New Feature Components: DataSet API Affects Versions: 1.0.0 Reporter: Greg Hogan Priority: Minor
Calling {{DataSet.distinct()}} executes {{DistinctOperator.DistinctFunction}} which is a combinable {{RichGroupReduceFunction}}. Sometimes we know that there will be few duplicate records and disabling the combine would improve performance. I propose adding {{public DistinctOperator<T> setCombinable(boolean combinable)}} to {{DistinctOperator}}. -- This message was sent by Atlassian JIRA (v6.3.4#6332)