vikramahuja1001 commented on a change in pull request #4210:
URL: https://github.com/apache/carbondata/pull/4210#discussion_r728686186
##########
File path: docs/configuration-parameters.md
##########
@@ -151,6 +169,17 @@ This section provides the details of all the
configurations required for the Car
| carbon.partition.max.driver.lru.cache.size | -1 | Maximum memory **(in MB)**
upto which driver can cache partition metadata. Beyond this, least recently
used data will be removed from cache before loading new set of values.
| carbon.mapOrderPushDown.<db_name>_<table_name>.column| empty | If order by
column is in sort column, specify that sort column here to avoid ordering at
map task . |
| carbon.metacache.expiration.seconds | Long.MAX_VALUE | Expiration time **(in
seconds)** for tableInfo cache in CarbonMetadata and tableModifiedTime in
CarbonFileMetastore, after the time configured since last access to the cache
entry, tableInfo and tableModifiedTime will be removed from each cache. Recent
access will refresh the timer. Default value of Long.MAX_VALUE means the cache
will not be expired by time. **NOTE:** At the time when cache is being expired,
queries on the table may fail with NullPointerException. |
+| is.driver.instance | false | This parameter decides if LRU cache for storing
indexes need to be created on driver. By default, it is created on executors. |
+| carbon.input.metrics.update.interval | 500000 | This property determines the
number of records queried after which input metrics are updated to spark. |
+| carbon.use.bitset.pipe.line | true | Carbondata has various optimizations
for faster query execution. Setting this property acts like a catalyst for
filter queries. If set to true, the bitset is passed from one filter to
another, resulting in incremental filtering and improving overall performance |
+
+## Index Configuration
+| Parameter | Default Value | Description |
+|--------------------------------------|---------------|---------------------------------------------------|
+| is.internal.load.call | false | This parameter decides whether the insert
call is triggered internally or by the user. If triggered by user, this ensures
data does not get loaded into MV directly |
+| carbon.lucene.index.stop.words | false | By default, lucene does not create
index for stop words like 'is', 'the' etc. This flag is used to override this
behaviour |
+| carbon.load.dateformat.setlenient.enable | false | This property enables
parsing of timestamp/date data in load flow if the parsing fails with invalid
timestamp data error. For example: 1941-03-15 00:00:00 is valid time in
Asia/Calcutta zone and is invalid and will fail to parse in Asia/Shanghai zone
as DST is observed and clocks were turned forward 1 hour to 1941-03-15 01:00:00
|
Review comment:
This property can be set dynamically within a session, please add that
detail here. Since there are a lot of properties which can be set dynamically i
think we can make a new separate column to show if dynamic changes are allowed
or not. @akashrn5 what do you think?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
