[ https://issues.apache.org/jira/browse/SPARK-2927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14090990#comment-14090990 ]
Apache Spark commented on SPARK-2927: ------------------------------------- User 'yhuai' has created a pull request for this issue: https://github.com/apache/spark/pull/1855 > Add a conf to configure if we always read Binary columns stored in Parquet as > String columns > -------------------------------------------------------------------------------------------- > > Key: SPARK-2927 > URL: https://issues.apache.org/jira/browse/SPARK-2927 > Project: Spark > Issue Type: Bug > Components: SQL > Reporter: Yin Huai > > Based on Parquet spec (https://github.com/Parquet/parquet-format), "strings > are stored as byte arrays (binary) with a UTF8 annotation". However, if the > data generator does not follow it, we will only read binary values back > instead of string values. -- This message was sent by Atlassian JIRA (v6.2#6252) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org