Just to add further , I could get the code reference as below:
https://github.com/xedin/sasi/blob/master/src/java/org/apache/cassandra/db/index/sasi/disk/PerSSTableIndexWriter.java
while (analyzer.hasNext())
{
ByteBuffer token = analyzer.next();
int size = token.remaining();
if (token.remaining() >= OnDiskIndexBuilder.MAX_TERM_SIZE)
{
logger.info("Rejecting value (size {}, maximum {} bytes) for column {}
(analyzed {}) at {} SSTable.",
term.remaining(),
OnDiskIndexBuilder.MAX_TERM_SIZE,
columnIndex.getColumnName(),
columnIndex.getMode().isAnalyzed,
descriptor);
continue;
}
On Mon, 9 Mar 2020 at 09:36, Surbhi Gupta <surbhi.gupt...@gmail.com> wrote:
>
> https://javadoc.io/static/org.apache.cassandra/cassandra-all/3.11.4/constant-values.html#org.apache.cassandra.index.sasi.disk.OnDiskIndexBuilder.MAX_TERM_SIZE
> The MAX_TERM_SIZE value is 1024
>
> Can we change it ?
>
>
> The messages below is INFO but because it is saying "Rejecting value" , I
> would like to understand the impact of this rejection.
>
> On Mon, 9 Mar 2020 at 08:47, Surbhi Gupta <surbhi.gupt...@gmail.com>
> wrote:
>
>> We have SASI index .
>> Any solution ?
>>
>> On Thu, 5 Mar 2020 at 15:20, Surbhi Gupta <surbhi.gupt...@gmail.com>
>> wrote:
>>
>>> Hi,
>>>
>>> We are in process of upgrading from 3.11.0 to 3.115 .
>>> While upgrading SSTables we are noticing messages like below in
>>> system.log.
>>> What are the significance of these messages?
>>>
>>> INFO [CompactionExecutor:3] 2020-03-05 16:12:41,393
>>> PerSSTableIndexWriter.java:211 - Rejecting value (size 1.022KiB, maximum
>>> 1.000KiB) for column body (analyzed true) at
>>> /mnt/cdata/golf/enus-76e27eb0f4c111e7b07c8dd03431d478/md-196-big SSTable.
>>>
>>> INFO [CompactionExecutor:3] 2020-03-05 16:12:41,396
>>> PerSSTableIndexWriter.java:211 - Rejecting value (size 1.178KiB, maximum
>>> 1.000KiB) for column body (analyzed true) at
>>> /mnt/cdata/golf/enus-76e27eb0f4c111e7b07c8dd03431d478/md-196-big SSTable.
>>>
>>> INFO [CompactionExecutor:3] 2020-03-05 16:12:41,400
>>> PerSSTableIndexWriter.java:211 - Rejecting value (size 2.808KiB, maximum
>>> 1.000KiB) for column body (analyzed true) at
>>> /mnt/cdata/golf/enus-76e27eb0f4c111e7b07c8dd03431d478/md-196-big SSTable.
>>>
>>> INFO [CompactionExecutor:3] 2020-03-05 16:12:41,401
>>> PerSSTableIndexWriter.java:211 - Rejecting value (size 1.562KiB, maximum
>>> 1.000KiB) for column body (analyzed true) at
>>> /mnt/cdata/golf/enus-76e27eb0f4c111e7b07c8dd03431d478/md-196-big SSTable.
>>>
>>> INFO [CompactionExecutor:3] 2020-03-05 16:12:41,401
>>> PerSSTableIndexWriter.java:211 - Rejecting value (size 1.182KiB, maximum
>>> 1.000KiB) for column body (analyzed true) at
>>> /mnt/cdata/golf/enus-76e27eb0f4c111e7b07c8dd03431d478/md-196-big SSTable.
>>>
>>> INFO [CompactionExecutor:3] 2020-03-05 16:12:41,404
>>> PerSSTableIndexWriter.java:211 - Rejecting value (size 1.848KiB, maximum
>>> 1.000KiB) for column body (analyzed true) at
>>> /mnt/cdata/golf/enus-76e27eb0f4c111e7b07c8dd03431d478/md-196-big SSTable.
>>>
>>> Thanks
>>> Surbhi
>>>
>>
