pratyakshsharma commented on a change in pull request #4210:
URL: https://github.com/apache/carbondata/pull/4210#discussion_r732707327
##########
File path: docs/configuration-parameters.md
##########
@@ -52,6 +52,17 @@ This section provides the details of all the configurations
required for the Car
| carbon.trash.retention.days | 7 | This parameter specifies the number of
days after which the timestamp based subdirectories are expired in the trash
folder. Allowed Min value = 0, Allowed Max Value = 365 days|
| carbon.clean.file.force.allowed | false | This parameter specifies if the
clean files operation with force option is allowed or not.|
| carbon.cdc.minmax.pruning.enabled | false | This parameter defines whether
the min max pruning to be performed on the target table based on the source
data. It will be useful when data is not sparse across target table which
results in better pruning.|
+| spark.sql.warehouse.dir | ../carbon.store | This parameter defines the path
on DFS where carbondata files and metadata will be stored. The configuration
`carbon.storelocation` has been deprecated. For simplicity, we recommended you
remove the configuration of `carbon.storelocation`. If `carbon.storelocation`
and `spark.sql.warehouse.dir` are configured to different paths, exception will
be thrown when CREATE DATABASE and DROP DATABASE to avoid inconsistent database
location.|
+| carbon.blocklet.size | 64 MB | Carbondata files consist of blocklets which
further consists of column pages. As per the latest V3 format, the default size
of a blocklet is 64 MB. In V2 format, the default size of a blocklet was 120000
rows. |
+| carbon.properties.filepath | conf/carbon.properties | This file is by
default present in conf directory on your base project path. Users can
configure all the carbondata related properties in this file. |
+| carbon.date.format | yyyy-MM-dd | This property specifies the format in
which data will be stored in the column with DATE data type. |
+| carbon.lock.class | (none) | This specifies the implementation of
ICarbonLock interface to be used for acquiring the locks in case of concurrent
operations |
+| carbon.local.dictionary.enable | (none) | If set to true, this property
enables the generation of local dictionary. Local dictionary enables to map
string and varchar values to numbers which helps in storing the data
efficiently. |
+| carbon.local.dictionary.decoder.fallback | true | Page Level data will not
be maintained for the blocklet. During fallback, actual data will be retrieved
from the encoded page data using local dictionary. NOTE: Memory footprint
decreases significantly as compared to when this property is set to false |
Review comment:
Actually these properties were mentioned in the corresponding jira. So I
simply followed the jira without any cross verifying. Will remove it anyways.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
