[
https://issues.apache.org/jira/browse/FLINK-33476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matthias Pohl closed FLINK-33476.
---------------------------------
Resolution: Won't Fix
[~zhuyinjun] Unfortunately, I don't have an answer to your question. It's not
my field of expertise. Please use the [user mailing
list|https://flink.apache.org/what-is-flink/community/#mailing-lists] for
questions like that. It's more likely to get an answer there than to ping
individuals. Jira is preferably used for actual bugs or improvements.
I'm closing this issue as it doesn't seem to cover an actual bug.
> join table throw Record is too big Exception
> --------------------------------------------
>
> Key: FLINK-33476
> URL: https://issues.apache.org/jira/browse/FLINK-33476
> Project: Flink
> Issue Type: New Feature
> Reporter: zhu
> Priority: Major
>
> When I join a table, Flink throws a record too big Exception. What parameters
> should I configure to solve this problem
>
> Caused by: java.io.IOException: Record is too big, it can't be added to a
> empty InMemoryBuffer! Record size: 1163764, Buffer: 0
> at
> org.apache.flink.table.runtime.util.ResettableExternalBuffer.throwTooBigException(ResettableExternalBuffer.java:193)
> at
> org.apache.flink.table.runtime.util.ResettableExternalBuffer.add(ResettableExternalBuffer.java:149)
> at
> org.apache.flink.table.runtime.operators.join.SortMergeJoinIterator.bufferMatchingRows(SortMergeJoinIterator.java:118)
> at
> org.apache.flink.table.runtime.operators.join.SortMergeOneSideOuterJoinIterator.nextOuterJoin(SortMergeOneSideOuterJoinIterator.java:88)
> at
> org.apache.flink.table.runtime.operators.join.SortMergeJoinOperator.oneSideOuterJoin(SortMergeJoinOperator.java:413)
> at
> org.apache.flink.table.runtime.operators.join.SortMergeJoinOperator.doSortMergeJoin(SortMergeJoinOperator.java:298)
> at
> org.apache.flink.table.runtime.operators.join.SortMergeJoinOperator.endInput(SortMergeJoinOperator.java:248)
> at
> org.apache.flink.table.runtime.operators.multipleinput.TableOperatorWrapper.endOperatorInput(TableOperatorWrapper.java:124)
> at
> org.apache.flink.table.runtime.operators.multipleinput.TableOperatorWrapper.propagateEndOperatorInput(TableOperatorWrapper.java:136)
> at
> org.apache.flink.table.runtime.operators.multipleinput.TableOperatorWrapper.endOperatorInput(TableOperatorWrapper.java:130)
> at
> org.apache.flink.table.runtime.operators.multipleinput.TableOperatorWrapper.propagateEndOperatorInput(TableOperatorWrapper.java:136)
> at
> org.apache.flink.table.runtime.operators.multipleinput.TableOperatorWrapper.endOperatorInput(TableOperatorWrapper.java:122)
> at
> org.apache.flink.table.runtime.operators.multipleinput.TableOperatorWrapper.propagateEndOperatorInput(TableOperatorWrapper.java:136)
> at
> org.apache.flink.table.runtime.operators.multipleinput.TableOperatorWrapper.endOperatorInput(TableOperatorWrapper.java:122)
> at
> org.apache.flink.table.runtime.operators.multipleinput.BatchMultipleInputStreamOperator.endInput(BatchMultipleInputStreamOperator.java:56)
> at
> org.apache.flink.streaming.runtime.tasks.StreamOperatorWrapper.endOperatorInput(StreamOperatorWrapper.java:98)
> at
> org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.endInput(RegularOperatorChain.java:97)
> at
> org.apache.flink.streaming.runtime.io.StreamOneInputProcessor.processInput(StreamOneInputProcessor.java:68)
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
