[
https://issues.apache.org/jira/browse/CARBONDATA-2913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16602772#comment-16602772
]
Ajantha Bhat commented on CARBONDATA-2913:
------------------------------------------
!image-2018-09-04-14-19-00-708.png!
That could be the reason. Need to analyze more
> BufferOverflowException when use varchar data of length 10000000
> ----------------------------------------------------------------
>
> Key: CARBONDATA-2913
> URL: https://issues.apache.org/jira/browse/CARBONDATA-2913
> Project: CarbonData
> Issue Type: Bug
> Reporter: Ajantha Bhat
> Priority: Major
> Attachments: image-2018-09-04-14-19-00-708.png
>
>
> SDKwriterTestCase has a test case "Test sdk with longstring"
>
> use
> RandomStringUtils.randomAlphabetic(10000000).
>
> we get below exception during sort.
>
> java.nio.BufferOverflowException
> at java.nio.HeapByteBuffer.put(HeapByteBuffer.java:189)
> at java.nio.ByteBuffer.put(ByteBuffer.java:859)
> at
> org.apache.carbondata.processing.loading.sort.SortStepRowHandler.packNoSortFieldsToBytes(SortStepRowHandler.java:585)
> at
> org.apache.carbondata.processing.loading.sort.SortStepRowHandler.writeRawRowAsIntermediateSortTempRowToUnsafeMemory(SortStepRowHandler.java:548)
> at
> org.apache.carbondata.processing.loading.sort.unsafe.UnsafeCarbonRowPage.addRow(UnsafeCarbonRowPage.java:82)
> at
> org.apache.carbondata.processing.loading.sort.unsafe.UnsafeCarbonRowPage.addRow(UnsafeCarbonRowPage.java:68)
> at
> org.apache.carbondata.processing.loading.sort.unsafe.UnsafeSortDataRows.addBatch(UnsafeSortDataRows.java:203)
> at
> org.apache.carbondata.processing.loading.sort.unsafe.UnsafeSortDataRows.addRowBatch(UnsafeSortDataRows.java:179)
> at
> org.apache.carbondata.processing.loading.sort.impl.UnsafeParallelReadMergeSorterImpl$SortIteratorThread.run(UnsafeParallelReadMergeSorterImpl.java:205)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748)
> 2018-09-04 14:06:55 ERROR CarbonTableOutputFormat:442 - Error while loading
> data
> java.util.concurrent.ExecutionException: java.lang.RuntimeException:
> org.apache.carbondata.processing.loading.exception.CarbonDataLoadingException:
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
