This is an automated email from the ASF dual-hosted git repository.
git-site-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/asf-site by this push:
new b9b588c2790 Publishing website 2022/10/11 22:15:42 at commit 3ffdf8d
b9b588c2790 is described below
commit b9b588c27908fce1ec0c61ee8893e8c75fca22e4
Author: jenkins <bui...@apache.org>
AuthorDate: Tue Oct 11 22:15:43 2022 +0000
Publishing website 2022/10/11 22:15:42 at commit 3ffdf8d
---
.../blog/review-input-streaming-connectors/index.html | 2 +-
website/generated-content/documentation/index.xml | 4 ++--
.../documentation/io/built-in/snowflake/index.html | 6 +++---
website/generated-content/documentation/io/connectors/index.html | 6 +++---
website/generated-content/sitemap.xml | 2 +-
5 files changed, 10 insertions(+), 10 deletions(-)
diff --git
a/website/generated-content/blog/review-input-streaming-connectors/index.html
b/website/generated-content/blog/review-input-streaming-connectors/index.html
index f4cdc8d8b6a..7aecba4c8a2 100644
---
a/website/generated-content/blog/review-input-streaming-connectors/index.html
+++
b/website/generated-content/blog/review-input-streaming-connectors/index.html
@@ -22,7 +22,7 @@ function
blockScroll(){$("body").toggleClass("fixedPosition");}
function openMenu(){addPlaceholder();blockScroll();}</script><div
class="body__contained center no__padding content-up"><article class=post
itemscope itemtype=http://schema.org/BlogPosting><div class=post-content><div
class=post-info><p>blog</p><p>2018/08/20</p></div><header class=post-header><h2
itemprop="name headline">A review of input streaming connectors</h1><div
class=post-info><span>Leonid Kuligin [<a
href=https://twitter.com/lkulighin>@lkulighin</a>]
&
Julien Phalip [<a
href=https://twitter.com/julienphalip>@julienphalip</a>]</span></div></header><div
class="arrow-list header-top-margin" itemprop=articleBody><p>In this post,
you’ll learn about the current state of support for input streaming
connectors in <a href=/>Apache Beam</a>. For more context, you’ll also
learn about the corresponding state of support in <a
href=https://spark.apache.org/>Apache Spark</a>.</p><p>With batch processing,
you might load data from any sourc [...]
-and <a
href=https://spark.apache.org/docs/latest/api/java/org/apache/spark/streaming/StreamingContext.html#textFileStream-java.lang.String->textFileStream</a></td></tr><tr><td>S3<br>(Using
the <code>s3://</code> URI)</td><td><a
href=https://beam.apache.org/releases/javadoc/2.41.0/org/apache/beam/sdk/io/FileIO.html>FileIO</a>
+ <a
href=https://beam.apache.org/releases/javadoc/2.41.0/org/apache/beam/sdk/io/aws/options/S3Options.html>S3Options</a></td></tr><tr><td
rowspan=3>Messaging Queues [...]
+and <a
href=https://spark.apache.org/docs/latest/api/java/org/apache/spark/streaming/StreamingContext.html#textFileStream-java.lang.String->textFileStream</a></td></tr><tr><td>S3<br>(Using
the <code>s3://</code> URI)</td><td><a
href=https://beam.apache.org/releases/javadoc/2.41.0/org/apache/beam/sdk/io/FileIO.html>FileIO</a>
+ <a
href=https://beam.apache.org/releases/javadoc/2.41.0/org/apache/beam/sdk/io/aws2/options/S3Options.html>S3Options</a></td></tr><tr><td
rowspan=3>Messaging Queue [...]
and <a
href=https://spark.apache.org/docs/latest/api/python/reference/api/pyspark.streaming.StreamingContext.textFileStream.html>textFileStream</a></td></tr><tr><td
rowspan=2>Object stores</td><td>Google Cloud Storage</td><td><a
href=https://beam.apache.org/releases/pydoc/2.41.0/apache_beam.io.gcp.gcsio.html>io.gcp.gcsio</a></td><td
rowspan=2><a
href=https://spark.apache.org/docs/latest/api/python/pyspark.streaming.html#pyspark.streaming.StreamingContext.textFileStream>textFileStream</a>
[...]
</p><p>2022/07/06</p></div><div class=post><p class=post-title>Big
Improvements in Beam Go's 2.40 Release</p><p class=post-info>Danny
McCormick</p></div></a><a class=post-card href=/blog/beam-2.40.0/
data-categories="blog release"><div class="post-info post-category"><p>blog &
release
diff --git a/website/generated-content/documentation/index.xml
b/website/generated-content/documentation/index.xml
index b18aff5b842..e538bdee873 100644
--- a/website/generated-content/documentation/index.xml
+++ b/website/generated-content/documentation/index.xml
@@ -2869,7 +2869,7 @@ return new GenericRecordBuilder(PARQUET_SCHEMA)
<h2 id="using-snowflakeio-with-aws-s3">Using SnowflakeIO with AWS S3</h2>
<p>To be able to use AWS S3 bucket as <code>stagingBucketName</code>
is required to:</p>
<ol>
-<li>Create <code>PipelineOptions</code> interface which is <a
href="https://beam.apache.org/documentation/io/built-in/snowflake/#extending-pipeline-options";>extending</a>
<code>SnowflakePipelineOptions</code> and <a
href="https://beam.apache.org/releases/javadoc/current/org/apache/beam/sdk/io/aws/options/S3Options.html";>S3Options</a>
+<li>Create <code>PipelineOptions</code> interface which is <a
href="https://beam.apache.org/documentation/io/built-in/snowflake/#extending-pipeline-options";>extending</a>
<code>SnowflakePipelineOptions</code> and <a
href="https://beam.apache.org/releases/javadoc/current/org/apache/beam/sdk/io/aws2/options/S3Options.html";>S3Options</a>
with <code>AwsAccessKey</code> and <code>AwsSecretKey</code>
options. Example:</li>
</ol>
<p>
@@ -2913,7 +2913,7 @@ new BasicAWSCredentials(options.getAwsAccessKey(),
options.getAwsSecretKey())
<pre><code>Pipeline p = Pipeline.create(options);</code></pre>
</div>
</div>
-<p><strong>Note</strong>: Remember to set
<code>awsRegion</code> from <a
href="https://beam.apache.org/releases/javadoc/current/org/apache/beam/sdk/io/aws/options/S3Options.html";>S3Options</a>.</p>
+<p><strong>Note</strong>: Remember to set
<code>awsRegion</code> from <a
href="https://beam.apache.org/releases/javadoc/current/org/apache/beam/sdk/io/aws2/options/S3Options.html";>S3Options</a>.</p>
<h2 id="using-snowflakeio-in-python-sdk">Using SnowflakeIO in Python
SDK</h2>
<h3 id="intro">Intro</h3>
<p>Snowflake cross-language implementation is supporting both reading and
writing operations for Python programming language, thanks to
diff --git
a/website/generated-content/documentation/io/built-in/snowflake/index.html
b/website/generated-content/documentation/io/built-in/snowflake/index.html
index 0aa6a99da9b..754ec8d7a2f 100644
--- a/website/generated-content/documentation/io/built-in/snowflake/index.html
+++ b/website/generated-content/documentation/io/built-in/snowflake/index.html
@@ -227,7 +227,7 @@ SnowflakeIO uses <code>COPY</code> statements behind the
scenes to read (using <
[...]
.build();
};
-}</code></pre></div></div></p><h2 id=using-snowflakeio-with-aws-s3>Using
SnowflakeIO with AWS S3</h2><p>To be able to use AWS S3 bucket as
<code>stagingBucketName</code> is required to:</p><ol><li>Create
<code>PipelineOptions</code> interface which is <a
href=https://beam.apache.org/documentation/io/built-in/snowflake/#extending-pipeline-options>extending</a>
<code>SnowflakePipelineOptions</code> and <a
href=https://beam.apache.org/releases/javadoc/current/org/apache/beam/sdk/io/aws/opti
[...]
+}</code></pre></div></div></p><h2 id=using-snowflakeio-with-aws-s3>Using
SnowflakeIO with AWS S3</h2><p>To be able to use AWS S3 bucket as
<code>stagingBucketName</code> is required to:</p><ol><li>Create
<code>PipelineOptions</code> interface which is <a
href=https://beam.apache.org/documentation/io/built-in/snowflake/#extending-pipeline-options>extending</a>
<code>SnowflakePipelineOptions</code> and <a
href=https://beam.apache.org/releases/javadoc/current/org/apache/beam/sdk/io/aws2/opt
[...]
with <code>AwsAccessKey</code> and <code>AwsSecretKey</code> options.
Example:</li></ol><p><div class=snippet><div class="notebook-skip code-snippet
without_switcher"><a class=copy type=button data-bs-toggle=tooltip
data-bs-placement=bottom title="Copy to clipboard"><img
src=/images/copy-icon.svg></a><pre><code>public interface AwsPipelineOptions
extends SnowflakePipelineOptions, S3Options {
@Description("AWS Access Key")
@@ -245,7 +245,7 @@ with <code>AwsAccessKey</code> and
<code>AwsSecretKey</code> options. Example:</
new AWSStaticCredentialsProvider(
new BasicAWSCredentials(options.getAwsAccessKey(),
options.getAwsSecretKey())
)
-);</code></pre></div></div>3. Create pipeline</p><div class=snippet><div
class="notebook-skip code-snippet without_switcher"><a class=copy type=button
data-bs-toggle=tooltip data-bs-placement=bottom title="Copy to clipboard"><img
src=/images/copy-icon.svg></a><pre><code>Pipeline p =
Pipeline.create(options);</code></pre></div></div><p><strong>Note</strong>:
Remember to set <code>awsRegion</code> from <a
href=https://beam.apache.org/releases/javadoc/current/org/apache/beam/sdk/io/aws/opti
[...]
+);</code></pre></div></div>3. Create pipeline</p><div class=snippet><div
class="notebook-skip code-snippet without_switcher"><a class=copy type=button
data-bs-toggle=tooltip data-bs-placement=bottom title="Copy to clipboard"><img
src=/images/copy-icon.svg></a><pre><code>Pipeline p =
Pipeline.create(options);</code></pre></div></div><p><strong>Note</strong>:
Remember to set <code>awsRegion</code> from <a
href=https://beam.apache.org/releases/javadoc/current/org/apache/beam/sdk/io/aws2/opt
[...]
cross-language which is part of <a
href=https://beam.apache.org/roadmap/portability/>Portability Framework
Roadmap</a> which aims to provide full interoperability
across the Beam ecosystem. From a developer perspective it means the
possibility of combining transforms written in different
languages(Java/Python/Go).</p><p>For more information about cross-language
please see <a href=https://beam.apache.org/roadmap/connectors-multi-sdk/>multi
sdk efforts</a>
and <a
href=https://beam.apache.org/roadmap/connectors-multi-sdk/#cross-language-transforms-api-and-expansion-service>Cross-language
transforms API and expansion service</a> articles.</p><p>Additional
resources:</p><ul><li><a
href=https://github.com/apache/beam/blob/master/sdks/python/apache_beam/io/snowflake.py>SnowflakeIO
source code</a></li><li><a
href=https://beam.apache.org/releases/pydoc/2.41.0/apache_beam.io.snowflake.html>SnowflakeIO
Pydoc</a></li><li><a href=https://docs.snowfla [...]
@@ -312,7 +312,7 @@ Example:<div class=snippet><div class="notebook-skip
code-snippet without_switch
{"type":"string","length":null},
{"type":"text","length":null},
{"type":"varbinary","size":null},
-{"type":"varchar","length":100}]</code></pre></div></div>You
can read about Snowflake data types at <a
href=https://docs.snowflake.com/en/sql-reference/data-types.html>Snowflake data
types</a>.</p></li><li><p><code>expansion_service</code> Specifies URL of
expansion service.</p></li></ul><h2
id=limitations>Limitations</h2><p>SnowflakeIO currently has the following
limitations.</p><ol><li><p>Streaming writing supports only pair key
authentication. For details, see: [...]
+{"type":"varchar","length":100}]</code></pre></div></div>You
can read about Snowflake data types at <a
href=https://docs.snowflake.com/en/sql-reference/data-types.html>Snowflake data
types</a>.</p></li><li><p><code>expansion_service</code> Specifies URL of
expansion service.</p></li></ul><h2
id=limitations>Limitations</h2><p>SnowflakeIO currently has the following
limitations.</p><ol><li><p>Streaming writing supports only pair key
authentication. For details, see: [...]
<a href=https://www.apache.org>The Apache Software Foundation</a>
| <a href=/privacy_policy>Privacy Policy</a>
| <a href=/feed.xml>RSS Feed</a><br><br>Apache Beam, Apache, Beam, the Beam
logo, and the Apache feather logo are either registered trademarks or
trademarks of The Apache Software Foundation. All other products or name brands
are trademarks of their respective holders, including The Apache Software
Foundation.</div></div><div class="footer__cols__col
footer__cols__col__logos"><div class=footer__cols__col--group><div
class=footer__cols__col__logo><a href=https://github.com/apache/beam><im [...]
\ No newline at end of file
diff --git a/website/generated-content/documentation/io/connectors/index.html
b/website/generated-content/documentation/io/connectors/index.html
index 15f192164f2..85f7f2012b7 100644
--- a/website/generated-content/documentation/io/connectors/index.html
+++ b/website/generated-content/documentation/io/connectors/index.html
@@ -43,10 +43,10 @@ function
openMenu(){addPlaceholder();blockScroll();}</script><div class="clearfi
<a
href=https://beam.apache.org/releases/javadoc/current/org/apache/beam/sdk/io/LocalFileSystemRegistrar.html>native</a></td><td
class=present>✔
<a
href=https://beam.apache.org/releases/pydoc/current/apache_beam.io.localfilesystem.html>native</a></td><td
class=present>✔
<a
href=https://pkg.go.dev/github.com/apache/beam/sdks/v2/go/pkg/beam/io/filesystem/local>native</a></td><td
class=present>✔</td><td class=absent>✘</td></tr><tr><td>S3FileSystem</td><td
class=present>✔</td><td class=present>✔</td><td class=present>✔
-<a
href=https://beam.apache.org/releases/javadoc/current/org/apache/beam/sdk/io/aws/s3/S3FileSystemRegistrar.html>native</a></td><td
class=present>✔
+<a
href=https://beam.apache.org/releases/javadoc/current/org/apache/beam/sdk/io/aws2/s3/S3FileSystemRegistrar.html>native</a></td><td
class=present>✔
<a
href=https://beam.apache.org/releases/pydoc/current/apache_beam.io.aws.s3filesystem.html>native</a></td><td>Not
available</td><td class=present>✔</td><td
class=absent>✘</td></tr><tr><td>In-memory</td><td class=absent>✘</td><td
class=present>✔</td><td class=absent>✘</td><td class=absent>✘</td><td
class=present>✔
<a
href=https://pkg.go.dev/github.com/apache/beam/sdks/v2/go/pkg/beam/io/filesystem/memfs>native</a></td><td
class=present>✔</td><td class=absent>✘</td></tr><tr><td>KinesisIO</td><td
class=present>✔</td><td class=present>✔</td><td class=present>✔
-<a
href=https://beam.apache.org/releases/javadoc/current/org/apache/beam/sdk/io/kinesis/KinesisIO.html>native</a></td><td
class=present>✔
+<a
href=https://beam.apache.org/releases/javadoc/current/org/apache/beam/sdk/io/aws2/kinesis/KinesisIO.html>native</a></td><td
class=present>✔
<a
href=https://beam.apache.org/releases/pydoc/current/apache_beam.io.kinesis.html#apache_beam.io.kinesis.ReadDataFromKinesis>via
X-language</a></td><td>Not available</td><td class=present>✔</td><td
class=present>✔</td></tr><tr><td>AmqpIO</td><td class=present>✔</td><td
class=present>✔</td><td class=present>✔
<a
href=https://beam.apache.org/releases/javadoc/current/org/apache/beam/sdk/io/amqp/AmqpIO.html>native</a></td><td>Not
available</td><td>Not available</td><td class=present>✔</td><td
class=present>✔</td></tr><tr><td>KafkaIO</td><td class=present>✔</td><td
class=present>✔</td><td class=present>✔
<a
href=https://beam.apache.org/releases/javadoc/current/org/apache/beam/sdk/io/kafka/KafkaIO.html>native</a></td><td
class=present>✔
@@ -108,7 +108,7 @@ native</td><td>Not available</td><td>Not available</td><td
class=present>✔</td
native</td><td>Not available</td><td class=present>✔</td><td
class=absent>✘</td></tr><tr><td><a href=https://github.com/amient/goconnect>Go
Connect</a></td><td class=present>✔</td><td class=present>✔</td><td
class=absent>✘</td><td class=absent>✘</td><td class=present>✔
native</td><td class=present>✔</td><td class=present>✔</td></tr><tr><td><a
href=https://github.com/tinybirdco/tinybird-beam>Tinybird</a></td><td
class=absent>✘</td><td class=present>✔</td><td>Not available</td><td
class=present>✔
native</td><td>Not available</td><td class=present>✔</td><td
class=present>✔</td></tr><tr><td><a
href=https://github.com/jccatrinck/dataflow-cloud-sql-python>Cloud
SQL</a></td><td class=present>✔</td><td class=absent>✘</td><td>Not
available</td><td class=present>✔
-native</td><td>Not available</td><td class=present>✔</td><td
class=absent>✘</td></tr></table></div><div class=feedback><p class=update>Last
updated on 2022/08/25</p><h3>Have you found everything you were looking
for?</h3><p class=description>Was it all useful and clear? Is there anything
that you would like to change? Let us know!</p><button class=load-button><a
href="mailto:d...@beam.apache.org?subject=Beam Website Feedback">SEND
FEEDBACK</a></button></div></div></div><footer class=foote [...]
+native</td><td>Not available</td><td class=present>✔</td><td
class=absent>✘</td></tr></table></div><div class=feedback><p class=update>Last
updated on 2022/10/11</p><h3>Have you found everything you were looking
for?</h3><p class=description>Was it all useful and clear? Is there anything
that you would like to change? Let us know!</p><button class=load-button><a
href="mailto:d...@beam.apache.org?subject=Beam Website Feedback">SEND
FEEDBACK</a></button></div></div></div><footer class=foote [...]
<a href=https://www.apache.org>The Apache Software Foundation</a>
| <a href=/privacy_policy>Privacy Policy</a>
| <a href=/feed.xml>RSS Feed</a><br><br>Apache Beam, Apache, Beam, the Beam
logo, and the Apache feather logo are either registered trademarks or
trademarks of The Apache Software Foundation. All other products or name brands
are trademarks of their respective holders, including The Apache Software
Foundation.</div></div><div class="footer__cols__col
footer__cols__col__logos"><div class=footer__cols__col--group><div
class=footer__cols__col__logo><a href=https://github.com/apache/beam><im [...]
\ No newline at end of file
diff --git a/website/generated-content/sitemap.xml
b/website/generated-content/sitemap.xml
index 4d6837da6f6..aafc8a140a8 100644
--- a/website/generated-content/sitemap.xml
+++ b/website/generated-content/sitemap.xml
@@ -1 +1 @@
-<?xml version="1.0" encoding="utf-8" standalone="yes"?><urlset
xmlns="http://www.sitemaps.org/schemas/sitemap/0.9";
xmlns:xhtml="http://www.w3.org/1999/xhtml";><url><loc>/blog/beam-2.41.0/</loc><lastmod>2022-08-23T21:36:06+00:00</lastmod></url><url><loc>/categories/blog/</loc><lastmod>2022-10-06T17:53:06+02:00</lastmod></url><url><loc>/blog/</loc><lastmod>2022-10-06T17:53:06+02:00</lastmod></url><url><loc>/categories/</loc><lastmod>2022-10-06T17:53:06+02:00</lastmod></url><url><loc>/catego
[...]
\ No newline at end of file
+<?xml version="1.0" encoding="utf-8" standalone="yes"?><urlset
xmlns="http://www.sitemaps.org/schemas/sitemap/0.9";
xmlns:xhtml="http://www.w3.org/1999/xhtml";><url><loc>/blog/beam-2.41.0/</loc><lastmod>2022-08-23T21:36:06+00:00</lastmod></url><url><loc>/categories/blog/</loc><lastmod>2022-10-11T15:00:59+02:00</lastmod></url><url><loc>/blog/</loc><lastmod>2022-10-11T15:00:59+02:00</lastmod></url><url><loc>/categories/</loc><lastmod>2022-10-11T15:00:59+02:00</lastmod></url><url><loc>/catego
[...]
\ No newline at end of file
