[flink-web] branch asf-site updated: Rebuild website.
This is an automated email from the ASF dual-hosted git repository. jincheng pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/flink-web.git The following commit(s) were added to refs/heads/asf-site by this push: new 722f2d5 Rebuild website. 722f2d5 is described below commit 722f2d542a63e8cf2313d9f76d08c871aa49fa93 Author: sunjincheng121 AuthorDate: Fri May 31 12:25:06 2019 +0800 Rebuild website. --- content/downloads.html| 13 +++-- content/zh/downloads.html | 13 +++-- 2 files changed, 14 insertions(+), 12 deletions(-) diff --git a/content/downloads.html b/content/downloads.html index e95a572..5d50e95 100644 --- a/content/downloads.html +++ b/content/downloads.html @@ -226,19 +226,19 @@ HADOOP_CLASSPATH. -https://repo.maven.apache.org/maven2/org/apache/flink/flink-shaded-hadoop2-uber/2.4.1-1.8.0/flink-shaded-hadoop2-uber-2.4.1-1.8.0.jar"; class="ga-track" id="180-bundled-hadoop-241">Pre-bundled Hadoop 2.4.1 (https://repo.maven.apache.org/maven2/org/apache/flink/flink-shaded-hadoop2-uber/2.4.1-1.8.0/flink-shaded-hadoop2-uber-2.4.1-1.8.0.jar.asc";>asc, https://repo.maven.apache.org/maven2/org/apache/flink/flink-shaded-hadoop2-uber/2.4.1-1.8.0/flink-shaded-ha [...] +https://repo.maven.apache.org/maven2/org/apache/flink/flink-shaded-hadoop-2-uber/2.4.1-7.0/flink-shaded-hadoop-2-uber-2.4.1-7.0.jar"; class="ga-track" id="bundled-hadoop-241-70">Pre-bundled Hadoop 2.4.1 (https://repo.maven.apache.org/maven2/org/apache/flink/flink-shaded-hadoop-2-uber/2.4.1-7.0/flink-shaded-hadoop-2-uber-2.4.1-7.0.jar.asc";>asc, https://repo.maven.apache.org/maven2/org/apache/flink/flink-shaded-hadoop-2-uber/2.4.1-7.0/flink-shaded-hadoop-2 [...] -https://repo.maven.apache.org/maven2/org/apache/flink/flink-shaded-hadoop2-uber/2.6.5-1.8.0/flink-shaded-hadoop2-uber-2.6.5-1.8.0.jar"; class="ga-track" id="180-bundled-hadoop-265">Pre-bundled Hadoop 2.6.5 (https://repo.maven.apache.org/maven2/org/apache/flink/flink-shaded-hadoop2-uber/2.6.5-1.8.0/flink-shaded-hadoop2-uber-2.6.5-1.8.0.jar.asc";>asc, https://repo.maven.apache.org/maven2/org/apache/flink/flink-shaded-hadoop2-uber/2.6.5-1.8.0/flink-shaded-ha [...] +https://repo.maven.apache.org/maven2/org/apache/flink/flink-shaded-hadoop-2-uber/2.6.5-7.0/flink-shaded-hadoop-2-uber-2.6.5-7.0.jar"; class="ga-track" id="bundled-hadoop-265-70">Pre-bundled Hadoop 2.6.5 (https://repo.maven.apache.org/maven2/org/apache/flink/flink-shaded-hadoop-2-uber/2.6.5-7.0/flink-shaded-hadoop-2-uber-2.6.5-7.0.jar.asc";>asc, https://repo.maven.apache.org/maven2/org/apache/flink/flink-shaded-hadoop-2-uber/2.6.5-7.0/flink-shaded-hadoop-2 [...] -https://repo.maven.apache.org/maven2/org/apache/flink/flink-shaded-hadoop2-uber/2.7.5-1.8.0/flink-shaded-hadoop2-uber-2.7.5-1.8.0.jar"; class="ga-track" id="180-bundled-hadoop-275">Pre-bundled Hadoop 2.7.5 (https://repo.maven.apache.org/maven2/org/apache/flink/flink-shaded-hadoop2-uber/2.7.5-1.8.0/flink-shaded-hadoop2-uber-2.7.5-1.8.0.jar.asc";>asc, https://repo.maven.apache.org/maven2/org/apache/flink/flink-shaded-hadoop2-uber/2.7.5-1.8.0/flink-shaded-ha [...] +https://repo.maven.apache.org/maven2/org/apache/flink/flink-shaded-hadoop-2-uber/2.7.5-7.0/flink-shaded-hadoop-2-uber-2.7.5-7.0.jar"; class="ga-track" id="bundled-hadoop-275-70">Pre-bundled Hadoop 2.7.5 (https://repo.maven.apache.org/maven2/org/apache/flink/flink-shaded-hadoop-2-uber/2.7.5-7.0/flink-shaded-hadoop-2-uber-2.7.5-7.0.jar.asc";>asc, https://repo.maven.apache.org/maven2/org/apache/flink/flink-shaded-hadoop-2-uber/2.7.5-7.0/flink-shaded-hadoop-2 [...] -https://repo.maven.apache.org/maven2/org/apache/flink/flink-shaded-hadoop2-uber/2.8.3-1.8.0/flink-shaded-hadoop2-uber-2.8.3-1.8.0.jar"; class="ga-track" id="180-bundled-hadoop-283">Pre-bundled Hadoop 2.8.3 (https://repo.maven.apache.org/maven2/org/apache/flink/flink-shaded-hadoop2-uber/2.8.3-1.8.0/flink-shaded-hadoop2-uber-2.8.3-1.8.0.jar.asc";>asc, https://repo.maven.apache.org/maven2/org/apache/flink/flink-shaded-hadoop2-uber/2.8.3-1.8.0/flink-shaded-ha [...] +https://repo.maven.apache.org/maven2/org/apache/flink/flink-shaded-hadoop-2-uber/2.8.3-7.0/flink-shaded-hadoop-2-uber-2.8.3-7.0.jar"; class="ga-track" id="bundled-hadoop-283-70">Pre-bundled Hadoop 2.8.3 (https://repo.maven.apache.org/maven2/org/apache/flink/flink-shaded-hadoop-2-uber/2.8.3-7.0/flink-shaded-hadoop-2-uber-2.8.3-7.0.jar.asc";>asc, https://repo.maven.apache.org/maven2/org/apache/flink/flink-shaded-hadoop-2-uber/2.8.3-7.0/flink-shaded-hadoop-2 [...] Release Notes @@ -353,8 +353,8 @@ HADOOP_CLASSPATH. main Flink release: -https://www.apache.org/dyn/closer.lua/flink/flink-shaded-6.0/flink-shaded-6.0-src.tgz"; class="ga-track" id="s60-download-source">Apache Flink-shaded 6.0 -(https://www.apache.org/dist/flink/flink-shaded-6.0/flink-shaded-6.0-src.tgz.asc";>asc, https://www.apache.org/dist/flink/flink-shaded-6.0/flink-shaded-6.0-src.tgz.sha512";>sha512) +http
[flink-web] branch asf-site updated: Add flink-shaded-7.0 release.
This is an automated email from the ASF dual-hosted git repository. jincheng pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/flink-web.git The following commit(s) were added to refs/heads/asf-site by this push: new 7430c22 Add flink-shaded-7.0 release. 7430c22 is described below commit 7430c22604e31d26a10fb9ae2f5aab428fc957c7 Author: sunjincheng121 AuthorDate: Wed May 8 20:33:11 2019 +0800 Add flink-shaded-7.0 release. This closes #209 --- _config.yml | 42 +- downloads.md| 1 + downloads.zh.md | 1 + 3 files changed, 23 insertions(+), 21 deletions(-) diff --git a/_config.yml b/_config.yml index 6680ddb..a209cbd 100644 --- a/_config.yml +++ b/_config.yml @@ -77,34 +77,34 @@ flink_releases: name: "Pre-bundled Hadoop 2.4.1" category: "Pre-bundled Hadoop" scala_dependent: false - id: 180-bundled-hadoop-241 - url: https://repo.maven.apache.org/maven2/org/apache/flink/flink-shaded-hadoop2-uber/2.4.1-1.8.0/flink-shaded-hadoop2-uber-2.4.1-1.8.0.jar - asc_url: https://repo.maven.apache.org/maven2/org/apache/flink/flink-shaded-hadoop2-uber/2.4.1-1.8.0/flink-shaded-hadoop2-uber-2.4.1-1.8.0.jar.asc - sha_url: https://repo.maven.apache.org/maven2/org/apache/flink/flink-shaded-hadoop2-uber/2.4.1-1.8.0/flink-shaded-hadoop2-uber-2.4.1-1.8.0.jar.sha1 + id: bundled-hadoop-241-70 + url: https://repo.maven.apache.org/maven2/org/apache/flink/flink-shaded-hadoop-2-uber/2.4.1-7.0/flink-shaded-hadoop-2-uber-2.4.1-7.0.jar + asc_url: https://repo.maven.apache.org/maven2/org/apache/flink/flink-shaded-hadoop-2-uber/2.4.1-7.0/flink-shaded-hadoop-2-uber-2.4.1-7.0.jar.asc + sha_url: https://repo.maven.apache.org/maven2/org/apache/flink/flink-shaded-hadoop-2-uber/2.4.1-7.0/flink-shaded-hadoop-2-uber-2.4.1-7.0.jar.sha1 - name: "Pre-bundled Hadoop 2.6.5" category: "Pre-bundled Hadoop" scala_dependent: false - id: 180-bundled-hadoop-265 - url: https://repo.maven.apache.org/maven2/org/apache/flink/flink-shaded-hadoop2-uber/2.6.5-1.8.0/flink-shaded-hadoop2-uber-2.6.5-1.8.0.jar - asc_url: https://repo.maven.apache.org/maven2/org/apache/flink/flink-shaded-hadoop2-uber/2.6.5-1.8.0/flink-shaded-hadoop2-uber-2.6.5-1.8.0.jar.asc - sha_url: https://repo.maven.apache.org/maven2/org/apache/flink/flink-shaded-hadoop2-uber/2.6.5-1.8.0/flink-shaded-hadoop2-uber-2.6.5-1.8.0.jar.sha1 + id: bundled-hadoop-265-70 + url: https://repo.maven.apache.org/maven2/org/apache/flink/flink-shaded-hadoop-2-uber/2.6.5-7.0/flink-shaded-hadoop-2-uber-2.6.5-7.0.jar + asc_url: https://repo.maven.apache.org/maven2/org/apache/flink/flink-shaded-hadoop-2-uber/2.6.5-7.0/flink-shaded-hadoop-2-uber-2.6.5-7.0.jar.asc + sha_url: https://repo.maven.apache.org/maven2/org/apache/flink/flink-shaded-hadoop-2-uber/2.6.5-7.0/flink-shaded-hadoop-2-uber-2.6.5-7.0.jar.sha1 - name: "Pre-bundled Hadoop 2.7.5" category: "Pre-bundled Hadoop" scala_dependent: false - id: 180-bundled-hadoop-275 - url: https://repo.maven.apache.org/maven2/org/apache/flink/flink-shaded-hadoop2-uber/2.7.5-1.8.0/flink-shaded-hadoop2-uber-2.7.5-1.8.0.jar - asc_url: https://repo.maven.apache.org/maven2/org/apache/flink/flink-shaded-hadoop2-uber/2.7.5-1.8.0/flink-shaded-hadoop2-uber-2.7.5-1.8.0.jar.asc - sha_url: https://repo.maven.apache.org/maven2/org/apache/flink/flink-shaded-hadoop2-uber/2.7.5-1.8.0/flink-shaded-hadoop2-uber-2.7.5-1.8.0.jar.sha1 + id: bundled-hadoop-275-70 + url: https://repo.maven.apache.org/maven2/org/apache/flink/flink-shaded-hadoop-2-uber/2.7.5-7.0/flink-shaded-hadoop-2-uber-2.7.5-7.0.jar + asc_url: https://repo.maven.apache.org/maven2/org/apache/flink/flink-shaded-hadoop-2-uber/2.7.5-7.0/flink-shaded-hadoop-2-uber-2.7.5-7.0.jar.asc + sha_url: https://repo.maven.apache.org/maven2/org/apache/flink/flink-shaded-hadoop-2-uber/2.7.5-7.0/flink-shaded-hadoop-2-uber-2.7.5-7.0.jar.sha1 - name: "Pre-bundled Hadoop 2.8.3" category: "Pre-bundled Hadoop" scala_dependent: false - id: 180-bundled-hadoop-283 - url: https://repo.maven.apache.org/maven2/org/apache/flink/flink-shaded-hadoop2-uber/2.8.3-1.8.0/flink-shaded-hadoop2-uber-2.8.3-1.8.0.jar - asc_url: https://repo.maven.apache.org/maven2/org/apache/flink/flink-shaded-hadoop2-uber/2.8.3-1.8.0/flink-shaded-hadoop2-uber-2.8.3-1.8.0.jar.asc - sha_url: https://repo.maven.apache.org/maven2/org/apache/flink/flink-shaded-hadoop2-uber/2.8.3-1.8.0/flink-shaded-hadoop2-uber-2.8.3-1.8.0.jar.sha1 + id: bundled-hadoop-283-70 + url: https://repo.maven.apache.org/maven2/org/apache/flink/flink-shaded-hadoop-2-uber/2.8
[flink] branch master updated: [FLINK-12440][python] Add all connector support align Java Table API.
This is an automated email from the ASF dual-hosted git repository.
jincheng pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/flink.git
The following commit(s) were added to refs/heads/master by this push:
new 836fdff [FLINK-12440][python] Add all connector support align Java
Table API.
836fdff is described below
commit 836fdfff0db64ff8241f38e8dd362dd50a9d1895
Author: Wei Zhong
AuthorDate: Fri May 24 14:45:30 2019 +0800
[FLINK-12440][python] Add all connector support align Java Table API.
This closes #8531
---
.../main/flink-bin/bin/pyflink-gateway-server.sh | 2 +-
flink-python/pyflink/table/__init__.py | 4 +-
flink-python/pyflink/table/table_descriptor.py | 485 -
.../pyflink/table/tests/test_descriptor.py | 407 -
tools/travis_controller.sh | 2 +
5 files changed, 883 insertions(+), 17 deletions(-)
diff --git a/flink-dist/src/main/flink-bin/bin/pyflink-gateway-server.sh
b/flink-dist/src/main/flink-bin/bin/pyflink-gateway-server.sh
index 026f813..9e41ad5 100644
--- a/flink-dist/src/main/flink-bin/bin/pyflink-gateway-server.sh
+++ b/flink-dist/src/main/flink-bin/bin/pyflink-gateway-server.sh
@@ -63,7 +63,7 @@ if [[ -n "$FLINK_TESTING" ]]; then
else
FLINK_TEST_CLASSPATH="$FLINK_TEST_CLASSPATH":"$testJarFile"
fi
- done < <(find "$FLINK_SOURCE_ROOT_DIR" ! -type d -name 'flink-*-tests.jar'
-print0 | sort -z)
+ done < <(find "$FLINK_SOURCE_ROOT_DIR" ! -type d \( -name
'flink-*-tests.jar' -o -path
"${FLINK_SOURCE_ROOT_DIR}/flink-connectors/flink-connector-elasticsearch-base/target/flink*.jar"
-o -path
"${FLINK_SOURCE_ROOT_DIR}/flink-connectors/flink-connector-kafka-base/target/flink*.jar"
\) -print0 | sort -z)
fi
exec $JAVA_RUN $JVM_ARGS "${log_setting[@]}" -cp
${FLINK_CLASSPATH}:${TABLE_JAR_PATH}:${FLINK_TEST_CLASSPATH} ${DRIVER}
${ARGS[@]}
diff --git a/flink-python/pyflink/table/__init__.py
b/flink-python/pyflink/table/__init__.py
index 281647f..904264e 100644
--- a/flink-python/pyflink/table/__init__.py
+++ b/flink-python/pyflink/table/__init__.py
@@ -40,7 +40,7 @@ from pyflink.table.table_sink import TableSink, CsvTableSink
from pyflink.table.table_source import TableSource, CsvTableSource
from pyflink.table.types import DataTypes, UserDefinedType, Row
from pyflink.table.window import Tumble, Session, Slide, Over
-from pyflink.table.table_descriptor import Rowtime, Schema, OldCsv, FileSystem
+from pyflink.table.table_descriptor import Rowtime, Schema, OldCsv,
FileSystem, Kafka, Elasticsearch
__all__ = [
'TableEnvironment',
@@ -63,4 +63,6 @@ __all__ = [
'FileSystem',
'UserDefinedType',
'Row',
+'Kafka',
+'Elasticsearch'
]
diff --git a/flink-python/pyflink/table/table_descriptor.py
b/flink-python/pyflink/table/table_descriptor.py
index 1dfbde3..65161b4 100644
--- a/flink-python/pyflink/table/table_descriptor.py
+++ b/flink-python/pyflink/table/table_descriptor.py
@@ -30,7 +30,9 @@ __all__ = [
'Rowtime',
'Schema',
'OldCsv',
-'FileSystem'
+'FileSystem',
+'Kafka',
+'Elasticsearch'
]
@@ -256,7 +258,7 @@ class OldCsv(FormatDescriptor):
format in the dedicated `flink-formats/flink-csv` module instead when
writing to Kafka. Use
the old one for stream/batch filesystem operations for now.
-.. note::
+..note::
Deprecated: use the RFC-compliant `Csv` format instead when writing to
Kafka.
"""
@@ -373,6 +375,485 @@ class FileSystem(ConnectorDescriptor):
return self
+class Kafka(ConnectorDescriptor):
+"""
+Connector descriptor for the Apache Kafka message queue.
+"""
+
+def __init__(self):
+gateway = get_gateway()
+self._j_kafka = gateway.jvm.Kafka()
+super(Kafka, self).__init__(self._j_kafka)
+
+def version(self, version):
+"""
+Sets the Kafka version to be used.
+
+:param version: Kafka version. E.g., "0.8", "0.11", etc.
+:return: This object.
+"""
+if not isinstance(version, (str, unicode)):
+version = str(version)
+self._j_kafka = self._j_kafka.version(version)
+return self
+
+def topic(self, topic):
+"""
+Sets the topic from which the table is read.
+
+:param topic: The topic from which the table is read.
+:return: This object.
+"""
+self._j_kafka = self._j_kafka.topic(topic)
+return self
+
+def properties(self, property_dict):
+"""
+Sets the configuration properties for the Kafka consumer. Resets
previously set properties.
+
+:param property_dict: The dict object contains configuration
properties for the Kafka
+ consumer. Both the keys and values should be
strings.
+:return: This object.
+"""
+gateway = get_gateway()
+properties = gatewa
[flink-shaded] branch master updated: Update version to 8.0
This is an automated email from the ASF dual-hosted git repository.
chesnay pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/flink-shaded.git
The following commit(s) were added to refs/heads/master by this push:
new 5084d27 Update version to 8.0
5084d27 is described below
commit 5084d273a895750f43a5bc035678abf1e7e43854
Author: sunjincheng121
AuthorDate: Mon May 27 08:15:34 2019 +0800
Update version to 8.0
---
flink-shaded-asm-6/pom.xml | 4 ++--
flink-shaded-force-shading/pom.xml | 2 +-
flink-shaded-guava-18/pom.xml | 4 ++--
flink-shaded-hadoop-2-uber/pom.xml | 6 +++---
flink-shaded-hadoop-2/pom.xml | 4 ++--
flink-shaded-jackson-parent/flink-shaded-jackson-2/pom.xml | 2 +-
.../flink-shaded-jackson-module-jsonSchema-2/pom.xml| 2 +-
flink-shaded-jackson-parent/pom.xml | 4 ++--
flink-shaded-netty-4/pom.xml| 4 ++--
flink-shaded-netty-tcnative-dynamic/pom.xml | 4 ++--
flink-shaded-netty-tcnative-static/pom.xml | 4 ++--
pom.xml | 2 +-
tools/releasing/update_branch_version.sh| 0
13 files changed, 21 insertions(+), 21 deletions(-)
diff --git a/flink-shaded-asm-6/pom.xml b/flink-shaded-asm-6/pom.xml
index df46fa3..1d07d43 100644
--- a/flink-shaded-asm-6/pom.xml
+++ b/flink-shaded-asm-6/pom.xml
@@ -25,12 +25,12 @@ under the License.
org.apache.flink
flink-shaded
-7.0
+8.0
..
flink-shaded-asm-${asm.major.version}
-${asm.version}-7.0
+${asm.version}-8.0
jar
diff --git a/flink-shaded-force-shading/pom.xml
b/flink-shaded-force-shading/pom.xml
index 8e1b08a..1573e63 100644
--- a/flink-shaded-force-shading/pom.xml
+++ b/flink-shaded-force-shading/pom.xml
@@ -25,7 +25,7 @@ under the License.
flink-shaded
org.apache.flink
-7.0
+8.0
flink-shaded-force-shading
diff --git a/flink-shaded-guava-18/pom.xml b/flink-shaded-guava-18/pom.xml
index 98de8b2..2fcab24 100644
--- a/flink-shaded-guava-18/pom.xml
+++ b/flink-shaded-guava-18/pom.xml
@@ -25,13 +25,13 @@ under the License.
org.apache.flink
flink-shaded
-7.0
+8.0
..
flink-shaded-guava
flink-shaded-guava-18
-${guava.version}-7.0
+${guava.version}-8.0
jar
diff --git a/flink-shaded-hadoop-2-uber/pom.xml
b/flink-shaded-hadoop-2-uber/pom.xml
index 44bf03c..87bfbaa 100644
--- a/flink-shaded-hadoop-2-uber/pom.xml
+++ b/flink-shaded-hadoop-2-uber/pom.xml
@@ -26,7 +26,7 @@ under the License.
org.apache.flink
flink-shaded
- 7.0
+ 8.0
..
@@ -34,7 +34,7 @@ under the License.
flink-shaded-hadoop-2-uber
jar
- ${hadoop.version}-7.0
+ ${hadoop.version}-8.0
2.4.1
@@ -49,7 +49,7 @@ under the License.
org.apache.flink
flink-shaded-hadoop-2
- ${hadoop.version}-7.0
+ ${hadoop.version}-8.0
diff --git a/flink-shaded-hadoop-2/pom.xml b/flink-shaded-hadoop-2/pom.xml
index 3cbf744..c577efc 100644
--- a/flink-shaded-hadoop-2/pom.xml
+++ b/flink-shaded-hadoop-2/pom.xml
@@ -25,7 +25,7 @@ under the License.
org.apache.flink
flink-shaded
- 7.0
+ 8.0
..
@@ -33,7 +33,7 @@ under the License.
flink-shaded-hadoop-2
jar
- ${hadoop.version}-7.0
+ ${hadoop.version}-8.0
1.8.2
diff --git a/flink-shaded-jackson-parent/flink-shaded-jackson-2/pom.xml
b/flink-shaded-jackson-parent/flink-shaded-jackson-2/pom.xml
index 5d167a8..0d6fa6f 100644
--- a/flink-shaded-jackson-parent/flink-shaded-jackson-2/pom.xml
+++ b/flink-shaded-jackson-parent/flink-shaded-jackson-2/pom.xml
@@ -25,7 +25,7 @@ under the License.
org.apache.flink
flink-shaded-jackson-parent
-2.9.8-7.0
+2.9.8-8.0
..
diff --git
a/flink-shaded-jackson-parent/flink-shaded-jackson-module-jsonSchema-2/pom.xml
b/flink-shaded-jackson-parent/flink-shaded-jackson-module-jsonSchema-2/pom.xml
index 4cc53e4..ea3075d 100644
---
a/flink-shaded-jackson-parent/flink-shaded-jackson-module-jsonSchema-2/pom.xml
+++
b/flink-shaded-jackson-parent/flink-shaded-jackson-module-jsonSchema-2/pom.xml
@@ -25,7 +25,7 @@ under the License.
org.apache.flink
flink-shaded-jackson-parent
-
svn commit: r34324 - in /dev/flink: flink-shaded-7.0-rc1/ flink-shaded-7.0-rc2/
Author: jincheng Date: Thu May 30 11:02:39 2019 New Revision: 34324 Log: delete flink-shaded-7.0 rc1/2 Removed: dev/flink/flink-shaded-7.0-rc1/ dev/flink/flink-shaded-7.0-rc2/
[flink-shaded] annotated tag release-7.0 updated (f7df449 -> 3750331)
This is an automated email from the ASF dual-hosted git repository. jincheng pushed a change to annotated tag release-7.0 in repository https://gitbox.apache.org/repos/asf/flink-shaded.git. *** WARNING: tag release-7.0 was modified! *** from f7df449 (commit) to 3750331 (tag) tagging f7df4493b0946c8bf8c556600b32d593828a9e34 (commit) replaces release-6.0 by sunjincheng121 on Thu May 30 18:52:09 2019 +0800 - Log - release-7.0 -BEGIN PGP SIGNATURE- iQIzBAABCAAdFiEEj+oe6dAEjAzMcLdXMhGwcDt56g4FAlzvtdkACgkQMhGwcDt5 6g6IrQ//RSxbuPkp28VpKpp3QJP3m0X2iimSFc8GNi3CGskdqduBIzmWsc6sL5rx wAVstTiZh3HvaKKRbrnznDTDyxQoc0sX6t+ZXuGK/2Z2EHc7fh5sbuDKMIZ+gVlQ NmuGnhCUNdAbSXLfJ7fpXxpM0yEnRRTFU+mxSyCMR1TrQ6MGEMBT91xU4w5UfHS/ EWoRZ5gKMniZ8JIQkHGaG+HjJ7FZ2SZyVhL+BEpOiBzFye0oOi9kfbekjyF0+SIN dznUKShbhJCRcdt1ULtmzIbyQzE6HumDhEVMNi+z44pHaapd8xzSWf1A4NTigCbW xiYm/L5AqEWKYyMbA+TCATTvfVa5zgHmSaJdi7m5yRuKFTMmsAZgZ73MkwUVru5u 0kVJix81LvH2ZnsJ3lWCbco0K4BKhLyRsrPuguFk/BjdwtlxH9+AcAnP3/4Y0fw/ rIJ7NsbKWRveOFL4S5ooVrZEqkj8KcV4sY5fVfvBSIPYBZ15dWBPJyObtMERQjrU ZbelsLTvMOp5IFX/JT4nClSeoHEPEjdgad/1Kahlo9bdDW5MTvv9brPF/MD7GNPF KOlgSpIgeUJS6k4WDTR76u8TuxJXII3+txL6PvG03hzeFErayAn+hOFN1/AZ7BgY BxYYkn786q7cJzIIPL94mXQ+gyYcRhPOxyVmaq3qOW8aFUKcyPM= =dwwu -END PGP SIGNATURE- --- No new revisions were added by this update. Summary of changes:
[flink-shaded] branch release-7.0 created (now f7df449)
This is an automated email from the ASF dual-hosted git repository. jincheng pushed a change to branch release-7.0 in repository https://gitbox.apache.org/repos/asf/flink-shaded.git. at f7df449 [hotfix][hadoop] Set findbugs and slf4j-api to provided No new revisions were added by this update.
svn commit: r34323 - /release/flink/flink-shaded-6.0/
Author: chesnay Date: Thu May 30 10:39:38 2019 New Revision: 34323 Log: Remove Flink-shaded 6.0 files Removed: release/flink/flink-shaded-6.0/
svn commit: r34322 - /dev/flink/flink-shaded-7.0-rc3/ /release/flink/flink-shaded-7.0/
Author: chesnay Date: Thu May 30 10:38:19 2019 New Revision: 34322 Log: Release Flink-shaded 7.0 Added: release/flink/flink-shaded-7.0/ - copied from r34321, dev/flink/flink-shaded-7.0-rc3/ Removed: dev/flink/flink-shaded-7.0-rc3/
[flink] branch master updated: [FLINK-12530][network] Move Task.inputGatesById to NetworkEnvironment
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/flink.git The following commit(s) were added to refs/heads/master by this push: new 809e40d [FLINK-12530][network] Move Task.inputGatesById to NetworkEnvironment 809e40d is described below commit 809e40dadad68232c68ac34a3d56bfb69a9396d3 Author: Andrey Zagrebin AuthorDate: Wed May 15 13:12:26 2019 +0200 [FLINK-12530][network] Move Task.inputGatesById to NetworkEnvironment Task.inputGatesById indexes SingleInputGates by id. The end user of this indexing is NetworkEnvironment for two cases: - SingleInputGate triggers producer partition readiness check and then the successful result of check is dispatched back to this SingleInputGate by id. We can just return a future from TaskActions.triggerPartitionProducerStateCheck. SingleInputGate could use the future to react with re-triggering of the partition request if the producer is ready. Then inputGatesById is not needed for dispatching. - TaskExecutor.updatePartitions uses inputGatesById to dispatch PartitionInfo update to the right SingleInputGate. If inputGatesById is moved to NetworkEnvironment, which should be a better place for gate management, and NetworkEnvironment.updatePartitionInfo is added then TaskExecutor.updatePartitions could directly call NetworkEnvironment.updatePartitionInfo. Additional refactoring: - TaskActions.triggerPartitionProducerStateCheck is separated into another interface PartitionProducerStateProvider. TaskActions is too broad interface used also for other purposes. Shuffle API needs only PartitionProducerStateProvider. - PartitionProducerStateProvider returns future with the ResponseHandle which contains the producer state and accepts callbacks to cancel or fail consumption as a result of state check. - Task.triggerPartitionProducerStateCheck is also refactored into a RemoteChannelStateChecker which becomes internal detail of NetworkEnvironment. RemoteChannelStateChecker accepts ResponseHandle, checks whether producer is ready for consumption or aborts consumption using ResponseHandle.cancelConsumption or ResponseHandle.failConsumption. --- .../runtime/io/network/NetworkEnvironment.java | 52 ++- .../PartitionProducerStateProvider.java} | 48 --- .../io/network/partition/consumer/InputGateID.java | 85 .../consumer/RemoteChannelStateChecker.java| 125 + .../partition/consumer/RemoteInputChannel.java | 2 +- .../partition/consumer/SingleInputGate.java| 58 .../partition/consumer/SingleInputGateFactory.java | 16 ++- .../runtime/taskexecutor/JobManagerConnection.java | 1 - .../PartitionProducerStateChecker.java | 2 +- .../flink/runtime/taskexecutor/TaskExecutor.java | 45 +++--- .../taskexecutor/rpc/RpcPartitionStateChecker.java | 2 +- .../flink/runtime/taskmanager/NoOpTaskActions.java | 10 -- .../org/apache/flink/runtime/taskmanager/Task.java | 151 ++--- .../flink/runtime/taskmanager/TaskActions.java | 17 --- .../network/partition/InputGateFairnessTest.java | 20 +-- .../partition/consumer/SingleInputGateBuilder.java | 15 +- .../partition/consumer/SingleInputGateTest.java| 69 +- .../taskexecutor/TaskExecutorSubmissionTest.java | 49 --- .../runtime/taskexecutor/TaskExecutorTest.java | 1 - .../TaskSubmissionTestEnvironment.java | 42 -- .../runtime/taskmanager/TaskAsyncCallTest.java | 2 +- .../apache/flink/runtime/taskmanager/TaskTest.java | 68 ++ .../runtime/util/JvmExitOnFatalErrorTest.java | 2 +- .../StreamNetworkBenchmarkEnvironment.java | 7 +- .../tasks/InterruptSensitiveRestoreTest.java | 2 +- .../runtime/tasks/StreamTaskTerminationTest.java | 2 +- .../streaming/runtime/tasks/StreamTaskTest.java| 2 +- .../runtime/tasks/SynchronousCheckpointITCase.java | 2 +- .../tasks/TaskCheckpointingBehaviourTest.java | 2 +- 29 files changed, 587 insertions(+), 312 deletions(-) diff --git a/flink-runtime/src/main/java/org/apache/flink/runtime/io/network/NetworkEnvironment.java b/flink-runtime/src/main/java/org/apache/flink/runtime/io/network/NetworkEnvironment.java index 7ee2a20..43969e2 100644 --- a/flink-runtime/src/main/java/org/apache/flink/runtime/io/network/NetworkEnvironment.java +++ b/flink-runtime/src/main/java/org/apache/flink/runtime/io/network/NetworkEnvironment.java @@ -26,6 +26,7 @@ import org.apache.flink.metrics.MetricGroup; import org.apache.flink.runtime.deployment.InputGateDeploymentDescriptor; import org.apache.flink.runtime.deployment.ResultPartitionDeploymentDescriptor; import org.apache.flink.runtime.executiongraph.ExecutionAttemptID;
[flink] branch master updated: [hotfix] Fix the version number in NOTICE and pom in table-planner-blink
This is an automated email from the ASF dual-hosted git repository. jark pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/flink.git The following commit(s) were added to refs/heads/master by this push: new 0c99d3d [hotfix] Fix the version number in NOTICE and pom in table-planner-blink 0c99d3d is described below commit 0c99d3dbb01f12de5a96065261d71b9138ba6d25 Author: Jark Wu AuthorDate: Thu May 30 16:25:26 2019 +0800 [hotfix] Fix the version number in NOTICE and pom in table-planner-blink --- flink-table/flink-table-planner-blink/pom.xml | 6 +++--- .../flink-table-planner-blink/src/main/resources/META-INF/NOTICE| 4 ++-- 2 files changed, 5 insertions(+), 5 deletions(-) diff --git a/flink-table/flink-table-planner-blink/pom.xml b/flink-table/flink-table-planner-blink/pom.xml index 5fdada9..f960b47 100644 --- a/flink-table/flink-table-planner-blink/pom.xml +++ b/flink-table/flink-table-planner-blink/pom.xml @@ -131,11 +131,11 @@ under the License. Dependencies that are not needed for how we use Calcite right now. - "mvn dependency:tree" as of Calcite 1.18: + "mvn dependency:tree" as of Calcite 1.19: - [INFO] +- org.apache.calcite:calcite-core:jar:1.18.0:compile + [INFO] +- org.apache.calcite:calcite-core:jar:1.19.0:compile [INFO] | +- org.apache.calcite.avatica:avatica-core:jar:1.13.0:compile - [INFO] | +- org.apache.calcite:calcite-linq4j:jar:1.18.0:compile + [INFO] | +- org.apache.calcite:calcite-linq4j:jar:1.19.0:compile [INFO] | +- org.apache.commons:commons-lang3:jar:3.3.2:compile [INFO] | +- com.fasterxml.jackson.core:jackson-core:jar:2.9.6:compile [INFO] | +- com.fasterxml.jackson.core:jackson-annotations:jar:2.9.6:compile diff --git a/flink-table/flink-table-planner-blink/src/main/resources/META-INF/NOTICE b/flink-table/flink-table-planner-blink/src/main/resources/META-INF/NOTICE index f6a41ac..a87ebf7 100644 --- a/flink-table/flink-table-planner-blink/src/main/resources/META-INF/NOTICE +++ b/flink-table/flink-table-planner-blink/src/main/resources/META-INF/NOTICE @@ -12,8 +12,8 @@ This project bundles the following dependencies under the Apache Software Licens - com.fasterxml.jackson.core:jackson-databind:2.9.6 - com.jayway.jsonpath:json-path:2.4.0 - joda-time:joda-time:2.5 -- org.apache.calcite:calcite-core:1.18.0 -- org.apache.calcite:calcite-linq4j:1.18.0 +- org.apache.calcite:calcite-core:1.19.0 +- org.apache.calcite:calcite-linq4j:1.19.0 - org.apache.calcite.avatica:avatica-core:1.13.0 This project bundles the following dependencies under the BSD license.
