This is an automated email from the ASF dual-hosted git repository. vinoth pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/asf-site by this push: new 0b938d5 Travis CI build asf-site 0b938d5 is described below commit 0b938d5ab64a004a6da6f93a1f2a828fa6a76a3c Author: CI <ci...@hudi.apache.org> AuthorDate: Tue Aug 11 02:02:22 2020 +0000 Travis CI build asf-site --- content/cn/docs/configurations.html | 28 ++++++++++++++++++++++++++++ content/docs/configurations.html | 28 ++++++++++++++++++++++++++++ 2 files changed, 56 insertions(+) diff --git a/content/cn/docs/configurations.html b/content/cn/docs/configurations.html index 589e8d4..5636b76 100644 --- a/content/cn/docs/configurations.html +++ b/content/cn/docs/configurations.html @@ -368,6 +368,7 @@ <li><a href="#压缩配置">压缩配置</a></li> <li><a href="#指标配置">指标配置</a></li> <li><a href="#内存配置">内存配置</a></li> + <li><a href="#写提交回调配置">写提交回调配置</a></li> </ul> </li> </ul> @@ -909,6 +910,33 @@ Hudi提供了一个选项,可以通过将对该分区中的插入作为对现 <p>属性:<code class="highlighter-rouge">hoodie.memory.writestatus.failure.fraction</code> <br /> <span style="color:grey">此属性控制报告给驱动程序的失败记录和异常的比例</span></p> +<h3 id="写提交回调配置">写提交回调配置</h3> +<p>控制写提交的回调。 如果用户启用了回调并且回调过程发生了错误,则会抛出异常。 当前只支持Http回调方式,Kafka不久后会支持。 +<a href="#withCallbackConfig">withCallbackConfig</a> (HoodieWriteCommitCallbackConfig) <br /> +<span style="color:grey">写提交回调相关配置</span></p> + +<h5 id="writeCommitCallbackOn">writeCommitCallbackOn(callbackOn = false)</h5> +<p>Property: <code class="highlighter-rouge">hoodie.write.commit.callback.on</code> <br /> +<span style="color:grey">打开或关闭回调功能. 默认关闭.</span></p> + +<h5 id="withCallbackClass">withCallbackClass(callbackClass)</h5> +<p>Property: <code class="highlighter-rouge">hoodie.write.commit.callback.class</code> <br /> +<span style="color:grey">用户自定义回调的类全路径名,回调类必须为HoodieWriteCommitCallback的子类。默认 org.apache.hudi.callback.impl.HoodieWriteCommitHttpCallback</span></p> + +<h4 id="hoodiewritecommithttpcallback">HoodieWriteCommitHttpCallback</h4> + +<h5 id="withCallbackHttpUrl">withCallbackHttpUrl(url)</h5> +<p>Property: <code class="highlighter-rouge">hoodie.write.commit.callback.http.url</code> <br /> +<span style="color:grey">Http回调主机,回调信息将会发送到该主机</span></p> + +<h5 id="withCallbackHttpTimeoutSeconds">withCallbackHttpTimeoutSeconds(timeoutSeconds = 3)</h5> +<p>Property: <code class="highlighter-rouge">hoodie.write.commit.callback.http.timeout.seconds</code> <br /> +<span style="color:grey">Http回调超时时间(单位秒),默认3秒</span></p> + +<h5 id="withCallbackHttpApiKey">withCallbackHttpApiKey(apiKey)</h5> +<p>Property: <code class="highlighter-rouge">hoodie.write.commit.callback.http.api.key</code> <br /> +<span style="color:grey">Http 回调秘钥. 默认 hudi_write_commit_http_callback</span></p> + </section> <a href="#masthead__inner-wrap" class="back-to-top">Back to top ↑</a> diff --git a/content/docs/configurations.html b/content/docs/configurations.html index 69aab3f..69e45cb 100644 --- a/content/docs/configurations.html +++ b/content/docs/configurations.html @@ -379,6 +379,7 @@ <li><a href="#compaction-configs">Compaction configs</a></li> <li><a href="#metrics-configs">Metrics configs</a></li> <li><a href="#memory-configs">Memory configs</a></li> + <li><a href="#write-commit-callback-configs">Write commit callback configs</a></li> </ul> </li> </ul> @@ -884,6 +885,33 @@ HoodieWriteConfig can be built using a builder pattern as below.</p> <p>Property: <code class="highlighter-rouge">hoodie.memory.writestatus.failure.fraction</code> <br /> <span style="color:grey">This property controls what fraction of the failed record, exceptions we report back to driver</span></p> +<h3 id="write-commit-callback-configs">Write commit callback configs</h3> +<p>Controls callback behavior on write commit. Exception will be thrown if user enabled the callback service and errors occurred during the process of callback. Currently support http callback only, kafka implementation will be supported in the near future. +<a href="#withCallbackConfig">withCallbackConfig</a> (HoodieWriteCommitCallbackConfig) <br /> +<span style="color:grey">Callback related configs</span></p> + +<h5 id="writeCommitCallbackOn">writeCommitCallbackOn(callbackOn = false)</h5> +<p>Property: <code class="highlighter-rouge">hoodie.write.commit.callback.on</code> <br /> +<span style="color:grey">Turn callback on/off. off by default.</span></p> + +<h5 id="withCallbackClass">withCallbackClass(callbackClass)</h5> +<p>Property: <code class="highlighter-rouge">hoodie.write.commit.callback.class</code> <br /> +<span style="color:grey">Full path of user-defined callback class and must be a subclass of HoodieWriteCommitCallback class, org.apache.hudi.callback.impl.HoodieWriteCommitHttpCallback by default</span></p> + +<h4 id="hoodiewritecommithttpcallback">HoodieWriteCommitHttpCallback</h4> + +<h5 id="withCallbackHttpUrl">withCallbackHttpUrl(url)</h5> +<p>Property: <code class="highlighter-rouge">hoodie.write.commit.callback.http.url</code> <br /> +<span style="color:grey">Callback host to be sent along with callback messages</span></p> + +<h5 id="withCallbackHttpTimeoutSeconds">withCallbackHttpTimeoutSeconds(timeoutSeconds = 3)</h5> +<p>Property: <code class="highlighter-rouge">hoodie.write.commit.callback.http.timeout.seconds</code> <br /> +<span style="color:grey">Callback timeout in seconds. 3 by default</span></p> + +<h5 id="withCallbackHttpApiKey">withCallbackHttpApiKey(apiKey)</h5> +<p>Property: <code class="highlighter-rouge">hoodie.write.commit.callback.http.api.key</code> <br /> +<span style="color:grey">Http callback API key. hudi_write_commit_http_callback by default</span></p> + </section> <a href="#masthead__inner-wrap" class="back-to-top">Back to top ↑</a>