[
https://issues.apache.org/jira/browse/CALCITE-4193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17184971#comment-17184971
]
Rui Wang edited comment on CALCITE-4193 at 8/26/20, 6:52 AM:
-------------------------------------------------------------
>Calcite does not know how to serialize values. So this operator will not know
>either. The values may not even be serializable.
Yes, you are right. I didn't consider this. Then I agree that Calcite needs to
define how to serialize and deserialize types/java classes.
was (Author: amaliujia):
>Calcite does not know how to serialize values. So this operator will not know
>either. The values may not even be serializable.
Yes, you are right. I didn't consider this. Then I agree that Calcite needs to
define how serialize and deserialize types/java classes.
> Implement new sort operator: EnumerableExternalSort
> ---------------------------------------------------
>
> Key: CALCITE-4193
> URL: https://issues.apache.org/jira/browse/CALCITE-4193
> Project: Calcite
> Issue Type: Improvement
> Components: core
> Reporter: Ruben Q L
> Priority: Major
>
> Sometimes we need to sort a big volume of data which does not fit into
> memory. In this situation EnumerableSort will cause an OutOfMemoryError.
> The solution for such a scenario will be using a different sorting algorithm:
> [External Sort|https://en.wikipedia.org/wiki/External_sorting].
> The goal of the current ticket is to implement a new operator
> (EnumerableExternalSort) to provide this feature.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
