[ 
https://issues.apache.org/jira/browse/SPARK-9725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14696684#comment-14696684
 ] 

Zhongshuai Pei commented on SPARK-9725:
---------------------------------------

In my environment,"offset" did not change according to BYTE_ARRAY_OFFSET.
when set spark.executor.memory=36g, "BYTE_ARRAY_OFFSET" is 24, "offset" is 16 , 
but set spark.executor.memory=30g, "BYTE_ARRAY_OFFSET" is 16,  "offset" is 16 
too. So "if (offset == BYTE_ARRAY_OFFSET && base instanceof byte[]  && 
((byte[]) base).length == numBytes)" will get different result. [~rxin] 

> spark sql query string field return empty/garbled string
> --------------------------------------------------------
>
>                 Key: SPARK-9725
>                 URL: https://issues.apache.org/jira/browse/SPARK-9725
>             Project: Spark
>          Issue Type: Bug
>          Components: SQL
>            Reporter: Fei Wang
>            Assignee: Davies Liu
>            Priority: Blocker
>
> to reproduce it:
> 1 deploy spark cluster mode, i use standalone mode locally
> 2 set executor memory >= 32g, set following config in spark-default.xml
>    spark.executor.memory            36g 
> 3 run spark-sql.sh with "show tables" it return empty/garbled string



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to