Anonymitaet commented on a change in pull request #5762: Add the filesystem offload doc URL: https://github.com/apache/pulsar/pull/5762#discussion_r352071546
########## File path: site2/docs/cookbooks-tiered-storage.md ########## @@ -186,6 +190,59 @@ Pulsar also provides some knobs to configure the size of requests sent to GCS. In both cases, these should not be touched unless you know what you are doing. +### "filesystem" Driver configuration + + +#### Configure connection address + +```conf +fileSystemURI="hdfs://127.0.0.1:9000" +``` +#### Configure Hadoop profile path + +In the configuration file under this path, you can configure the base path and authentication and so on. + +```conf +fileSystemProfilePath="../conf/filesystem_offload_core_site.xml" +``` + +The model for storing this topic data use `org.apache.hadoop.io.MapFile`, so we can use all of the configuration in Apache Hadoop for `org.apache.hadoop.io.MapFile`, the following example : + +```conf + + <property> + <name>fs.defaultFS</name> + <value></value> + </property> + + <property> + <name>hadoop.tmp.dir</name> + <value>pulsar</value> + </property> + + <property> + <name>io.file.buffer.size</name> + <value>4096</value> + </property> + + <property> + <name>io.seqfile.compress.blocksize</name> + <value>1000000</value> + </property> + <property> + + <name>io.seqfile.compression.type</name> + <value>BLOCK</value> + </property> + + <property> + <name>io.map.index.interval</name> + <value>128</value> + </property> + +``` + +A detailed explanation of the role of these configurations and other configurations can be found in [Filesystem Storage](http://hadoop.apache.org/). Review comment: ```suggestion For more information about the configurations in `org.apache.hadoop.io.MapFile`, see [Filesystem Storage](http://hadoop.apache.org/). ``` ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
