Github user kumarvishal09 commented on a diff in the pull request: https://github.com/apache/carbondata/pull/2379#discussion_r196440793 --- Diff: core/src/main/java/org/apache/carbondata/core/datastore/page/VarLengthColumnPageBase.java --- @@ -289,6 +289,12 @@ public void putDouble(int rowId, double value) { @Override public void putBytes(int rowId, byte[] bytes) { + // rowId * 4 represents the length of L in LV + if (bytes.length > (Integer.MAX_VALUE - totalLength - rowId * 4)) { --- End diff -- Better to add a check in FieldEncoder to validate if it crosses 67104 bytes for varchar datatype, it should be fail first mechanism, here it will fail while writing which is too late as most of the data transformation is done.
---