[ https://issues.apache.org/jira/browse/CALCITE-4193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17184971#comment-17184971 ]
Rui Wang commented on CALCITE-4193: ----------------------------------- >Calcite does not know how to serialize values. So this operator will not know >either. The values may not even be serializable. Yes, you are right. I didn't consider this. Then I agree that Calcite needs to define how serialize and deserialize types/java classes. > Implement new sort operator: EnumerableExternalSort > --------------------------------------------------- > > Key: CALCITE-4193 > URL: https://issues.apache.org/jira/browse/CALCITE-4193 > Project: Calcite > Issue Type: Improvement > Components: core > Reporter: Ruben Q L > Priority: Major > > Sometimes we need to sort a big volume of data which does not fit into > memory. In this situation EnumerableSort will cause an OutOfMemoryError. > The solution for such a scenario will be using a different sorting algorithm: > [External Sort|https://en.wikipedia.org/wiki/External_sorting]. > The goal of the current ticket is to implement a new operator > (EnumerableExternalSort) to provide this feature. -- This message was sent by Atlassian Jira (v8.3.4#803005)