This is an automated email from the ASF dual-hosted git repository. rxl pushed a commit to branch branch-2.6 in repository https://gitbox.apache.org/repos/asf/pulsar.git
commit 50493d07d42c25dc2c2f018626fc21f645bce4c4 Author: Yunze Xu <xyzinfern...@163.com> AuthorDate: Tue Jul 28 17:38:25 2020 +0800 [docs] Fix wrong required properties for HDFS2 sink (#7643) * Fix wrong required properties for HDFS2 sink * Fix description of filenamePrefix (cherry picked from commit bf90e55214d04c3f8b34433c119c43a49bb1c1e8) --- site2/docs/io-hdfs2-sink.md | 6 ++++-- 1 file changed, 4 insertions(+), 2 deletions(-) diff --git a/site2/docs/io-hdfs2-sink.md b/site2/docs/io-hdfs2-sink.md index 9769695..56c4c7b 100644 --- a/site2/docs/io-hdfs2-sink.md +++ b/site2/docs/io-hdfs2-sink.md @@ -21,8 +21,8 @@ The configuration of the HDFS2 sink connector has the following properties. | `compression` | Compression |false |None |The compression code used to compress or de-compress the files on HDFS. <br/><br/>Below are the available options:<br/><li>BZIP2<br/><li>DEFLATE<br/><li>GZIP<br/><li>LZ4<br/><li>SNAPPY| | `kerberosUserPrincipal` |String| false| None|The principal account of Kerberos user used for authentication. | | `keytab` | String|false|None| The full pathname of the Kerberos keytab file used for authentication. | -| `filenamePrefix` |String| false |None |The prefix of the files created inside the HDFS directory.<br/><br/>**Example**<br/> The value of topicA result in files named topicA-. | -| `fileExtension` | String| false | None| The extension added to the files written to HDFS.<br/><br/>**Example**<br/>'.txt'<br/> '.seq' | +| `filenamePrefix` |String| true, if `compression` is set to `None`. | None |The prefix of the files created inside the HDFS directory.<br/><br/>**Example**<br/> The value of topicA result in files named topicA-. | +| `fileExtension` | String| true | None | The extension added to the files written to HDFS.<br/><br/>**Example**<br/>'.txt'<br/> '.seq' | | `separator` | char|false |None |The character used to separate records in a text file. <br/><br/>If no value is provided, the contents from all records are concatenated together in one continuous byte array. | | `syncInterval` | long| false |0| The interval between calls to flush data to HDFS disk in milliseconds. | | `maxPendingRecords` |int| false|Integer.MAX_VALUE | The maximum number of records that hold in memory before acking. <br/><br/>Setting this property to 1 makes every record send to disk before the record is acked.<br/><br/>Setting this property to a higher value allows buffering records before flushing them to disk. @@ -38,6 +38,7 @@ Before using the HDFS2 sink connector, you need to create a configuration file t "hdfsConfigResources": "core-site.xml", "directory": "/foo/bar", "filenamePrefix": "prefix", + "fileExtension": ".log", "compression": "SNAPPY" } ``` @@ -49,5 +50,6 @@ Before using the HDFS2 sink connector, you need to create a configuration file t hdfsConfigResources: "core-site.xml" directory: "/foo/bar" filenamePrefix: "prefix" + fileExtension: ".log" compression: "SNAPPY" ```