[
https://issues.apache.org/jira/browse/SPARK-9725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14696336#comment-14696336
]
Zhongshuai Pei commented on SPARK-9725:
---------------------------------------
I have debug this issue and i find BYTE_ARRAY_OFFSET has different result when
i use different memory.
when set spark.executor.memory=36g, BYTE_ARRAY_OFFSET is 24, but set
spark.executor.memory=30g, BYTE_ARRAY_OFFSET is 16. So getBytes() of
UTF8String will enter different branches when i use different memory. [~davies]
[~lian cheng] [~scwf]
> spark sql query string field return empty/garbled string
> --------------------------------------------------------
>
> Key: SPARK-9725
> URL: https://issues.apache.org/jira/browse/SPARK-9725
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Reporter: Fei Wang
> Assignee: Davies Liu
> Priority: Blocker
>
> to reproduce it:
> 1 deploy spark cluster mode, i use standalone mode locally
> 2 set executor memory >= 32g, set following config in spark-default.xml
> spark.executor.memory 36g
> 3 run spark-sql.sh with "show tables" it return empty/garbled string
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
