Github user cxzl25 commented on the issue: https://github.com/apache/spark/pull/21596 https://github.com/apache/spark/pull/20738 Bump jackson from 2.6.7&2.6.7.1 to 2.7.7 Jackson(>=2.7.7) fixes the possibility of missing tail data when the length of the value is in a range [https://github.com/FasterXML/jackson/wiki/Jackson-Release-2.7.7](https://github.com/FasterXML/jackson/wiki/Jackson-Release-2.7.7) [https://github.com/FasterXML/jackson-core/issues/30](https://github.com/FasterXML/jackson-core/issues/307) spark-shell: ``` val value = "x" * 3000 val json = s"""{"big": "$value"}""" spark.sql("select length(get_json_object(\'"+json+"\','$.big'))" ).collect res0: Array[org.apache.spark.sql.Row] = Array([2991]) ``` expect result : 3000 actual result : 2991
--- --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org