Github user kiszk commented on a diff in the pull request:
https://github.com/apache/spark/pull/19222#discussion_r170842910
--- Diff:
common/unsafe/src/main/java/org/apache/spark/unsafe/types/UTF8String.java ---
@@ -195,15 +205,15 @@ private static int numBytesForFirstByte(final byte b)
{
* Returns the number of bytes
*/
public int numBytes() {
- return numBytes;
+ return (int)base.size();
--- End diff --
Yes, I believe that `UTF8String` always puts int value into
`MemoryBlock.size`. However, some corruption may occur. Let me add assertion
for testing.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
