[beam] branch master updated (88918f1 -> b6a59b3)
This is an automated email from the ASF dual-hosted git repository. pabloem pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 88918f1 Merge pull request #13978: [BEAM-11125] bump checkerframework to 3.10.0 add b6a59b3 Merge #13558. [BEAM-11494][BEAM-11821] FileIO stops overwriting files on retries No new revisions were added by this update. Summary of changes: .../java/org/apache/beam/sdk/io/FileBasedSink.java | 6 ++- .../java/org/apache/beam/sdk/io/FileSystems.java | 46 ++ .../org/apache/beam/sdk/io/fs/MatchResult.java | 6 +++ .../org/apache/beam/sdk/io/fs/MoveOptions.java | 1 + .../sdk/extensions/gcp/storage/GcsFileSystem.java | 3 ++ .../apache/beam/sdk/io/aws/s3/S3FileSystem.java| 24 ++- .../azure/blobstore/AzureBlobStoreFileSystem.java | 25 +++- 7 files changed, 84 insertions(+), 27 deletions(-)
[beam] 01/01: Merge pull request #13978: [BEAM-11125] bump checkerframework to 3.10.0
This is an automated email from the ASF dual-hosted git repository. iemejia pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git commit 88918f10e5740baa8f2c2612dd43ace944325003 Merge: b8dd9cb 4178d26 Author: Ismaël Mejía AuthorDate: Thu Feb 18 07:35:18 2021 +0100 Merge pull request #13978: [BEAM-11125] bump checkerframework to 3.10.0 buildSrc/build.gradle.kts | 2 +- .../src/main/groovy/org/apache/beam/gradle/BeamModulePlugin.groovy| 2 +- sdks/java/expansion-service/build.gradle | 2 +- sdks/java/extensions/schemaio-expansion-service/build.gradle | 4 ++-- sdks/java/extensions/sql/build.gradle | 2 +- 5 files changed, 6 insertions(+), 6 deletions(-)
[beam] branch master updated (b8dd9cb -> 88918f1)
This is an automated email from the ASF dual-hosted git repository. iemejia pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from b8dd9cb Update go version to 1.12.7 (#13996) add 4178d26 [BEAM-11125] bump checkerframework to 3.10.0 new 88918f1 Merge pull request #13978: [BEAM-11125] bump checkerframework to 3.10.0 The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: buildSrc/build.gradle.kts | 2 +- .../src/main/groovy/org/apache/beam/gradle/BeamModulePlugin.groovy| 2 +- sdks/java/expansion-service/build.gradle | 2 +- sdks/java/extensions/schemaio-expansion-service/build.gradle | 4 ++-- sdks/java/extensions/sql/build.gradle | 2 +- 5 files changed, 6 insertions(+), 6 deletions(-)
[beam] branch master updated (364a4a0 -> b8dd9cb)
This is an automated email from the ASF dual-hosted git repository. lostluck pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 364a4a0 [BEAM-11211] Update pandas and pyarrow in python container (#13987) add b8dd9cb Update go version to 1.12.7 (#13996) No new revisions were added by this update. Summary of changes: .../org/apache/beam/gradle/BeamModulePlugin.groovy | 2 +- sdks/go/pkg/beam/artifact/materialize.go | 6 +- sdks/go/pkg/beam/core/graph/coder/double_test.go | 4 +- sdks/go/pkg/beam/pardo_test.go | 3 +- sdks/go/pkg/beam/transforms/stats/stats.shims.go | 151 ++--- 5 files changed, 82 insertions(+), 84 deletions(-)
[beam] tag nightly-master updated (edeaf67 -> 364a4a0)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to tag nightly-master in repository https://gitbox.apache.org/repos/asf/beam.git. *** WARNING: tag nightly-master was modified! *** from edeaf67 (commit) to 364a4a0 (commit) from edeaf67 Merge pull request #13999: [BEAM-11415] Fix misc. bugs affecting Go XLang tests. add c758a0d [BEAM-9615] Register Schemas on Beam Init (#13940) add ac5d258 Beam transform that uses DebeziumIO connector to support CDC add 32a0ff1 Merge pull request #13983 from [BEAM-11818] DebeziumIO connector to support CDC add 8f87957 [BEAM-11626] Upgrading Guava to 30.1-jre while keeping 25.1-jre for Hadoop/Cassandra modules (#13804) add 9c60fd5 Revert "[BEAM-2914] Add portable merging window support to Python. (#12995)" add 871e023 Merge pull request #14004 from ajamato/rollback add 01258f1 [BEANM-11827] checkJavaLinkage task requires a spread operator for args (#14006) add 078a146 Fixing dashboard add dd2e739 Merge pull request #14000 from [BEAM-11791] Fixing dashboard for FnApiRunner benchmarks add 4f78ab3 [BEAM-11805] Replace user-agent for spanner (#13990) add 812149c [BEAM-10925] Support selecting Calc for ZetaSQL testing add 788025e Merge pull request #14009: [BEAM-10925] Support selecting Calc for ZetaSQL testing add dbb19b0 [BEAM-11779] Use shuffle_mode=appliance when using dataflow runner v2 add 292d788 Add comment to remove the patch add c1530a6 minor fix to run_integration_test.sh in python sdk add fc511f6 Merge pull request #13986: [BEAM-11779] Use shuffle_mode=appliance when using dataflow runner v2 add 364a4a0 [BEAM-11211] Update pandas and pyarrow in python container (#13987) No new revisions were added by this update. Summary of changes: .../jenkins/job_LoadTests_Combine_Python.groovy| 3 +- .../jenkins/job_LoadTests_GBK_Python.groovy| 3 +- .../job_LoadTests_GBK_Python_reiterate.groovy | 3 +- .../jenkins/job_LoadTests_ParDo_Python.groovy | 3 +- .../jenkins/job_LoadTests_SideInput_Python.groovy | 3 +- .../jenkins/job_PerformanceTests_KafkaIO_IT.groovy | 6 +- .../Python_FnApiRunner_ubenchmarks.json| 1 + CHANGES.md | 5 + build.gradle.kts | 5 +- .../org/apache/beam/gradle/BeamModulePlugin.groovy | 18 +- runners/google-cloud-dataflow-java/build.gradle| 7 +- sdks/go/pkg/beam/core/runtime/genx/genx.go | 2 - .../core/runtime/graphx/schema/logicaltypes.go | 7 + .../pkg/beam/core/runtime/graphx/schema/schema.go | 211 +++-- .../beam/core/runtime/graphx/schema/schema_test.go | 40 +- sdks/go/pkg/beam/forward.go| 8 + sdks/go/pkg/beam/runners/dataflow/dataflow.go | 3 + .../container/license_scripts/dep_urls_java.yaml | 2 +- .../sql/zetasql/ZetaSQLQueryPlanner.java | 21 +- sdks/java/io/cassandra/build.gradle| 7 + sdks/java/io/debezium/build.gradle | 83 sdks/java/io/debezium/src/README.md| 178 +++ .../org/apache/beam/io/debezium/DebeziumIO.java| 515 + .../beam/io/debezium/KafkaSourceConsumerFn.java| 394 .../apache/beam/io/debezium/SourceRecordJson.java | 287 .../beam/io/debezium/SourceRecordMapper.java} | 16 +- .../org/apache/beam/io/debezium}/package-info.java | 7 +- .../io/debezium/DebeziumIOMySqlConnectorIT.java| 108 + .../apache/beam/io/debezium/DebeziumIOTest.java| 101 .../io/debezium/KafkaSourceConsumerFnTest.java | 264 +++ .../apache/beam/io/debezium/OffsetTrackerTest.java | 71 +++ .../beam/io/debezium/SourceRecordJsonTest.java | 113 + sdks/java/io/google-cloud-platform/build.gradle| 3 +- .../beam/sdk/io/gcp/spanner/SpannerAccessor.java | 106 - sdks/java/io/hadoop-file-system/build.gradle | 7 + sdks/java/io/hadoop-format/build.gradle| 7 + .../runners/portability/flink_runner_test.py | 3 - .../runners/portability/fn_api_runner/execution.py | 241 +- .../portability/fn_api_runner/fn_runner_test.py| 37 -- .../runners/portability/spark_runner_test.py | 3 - .../apache_beam/runners/worker/bundle_processor.py | 43 -- sdks/python/container/base_image_requirements.txt | 4 +- sdks/python/scripts/run_integration_test.sh| 2 + settings.gradle.kts| 1 + 44 files changed, 2558 insertions(+), 394 deletions(-) create mode 100644 sdks/java/io/debezium/build.gradle create mode 100644 sdks/java/io/debezium/src/README.md create mode 100644 sdks/java/io/debezium/src/main/java/org/apache/beam/io/debezium/DebeziumIO.java create mode 100644 sdks/java/io/debezium/src/main/java/org/apache/beam/io/debezium/KafkaSou
[beam] branch master updated (fc511f6 -> 364a4a0)
This is an automated email from the ASF dual-hosted git repository. bhulette pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from fc511f6 Merge pull request #13986: [BEAM-11779] Use shuffle_mode=appliance when using dataflow runner v2 add 364a4a0 [BEAM-11211] Update pandas and pyarrow in python container (#13987) No new revisions were added by this update. Summary of changes: sdks/python/container/base_image_requirements.txt | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-)
[beam] branch master updated (788025e -> fc511f6)
This is an automated email from the ASF dual-hosted git repository. chamikara pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 788025e Merge pull request #14009: [BEAM-10925] Support selecting Calc for ZetaSQL testing add dbb19b0 [BEAM-11779] Use shuffle_mode=appliance when using dataflow runner v2 add 292d788 Add comment to remove the patch add c1530a6 minor fix to run_integration_test.sh in python sdk add fc511f6 Merge pull request #13986: [BEAM-11779] Use shuffle_mode=appliance when using dataflow runner v2 No new revisions were added by this update. Summary of changes: .test-infra/jenkins/job_LoadTests_Combine_Python.groovy | 3 ++- .test-infra/jenkins/job_LoadTests_GBK_Python.groovy | 3 ++- .test-infra/jenkins/job_LoadTests_GBK_Python_reiterate.groovy | 3 ++- .test-infra/jenkins/job_LoadTests_ParDo_Python.groovy | 3 ++- .test-infra/jenkins/job_LoadTests_SideInput_Python.groovy | 3 ++- .test-infra/jenkins/job_PerformanceTests_KafkaIO_IT.groovy| 6 -- runners/google-cloud-dataflow-java/build.gradle | 7 +-- sdks/go/pkg/beam/runners/dataflow/dataflow.go | 3 +++ sdks/python/scripts/run_integration_test.sh | 2 ++ 9 files changed, 24 insertions(+), 9 deletions(-)
[beam] 01/01: Merge pull request #14009: [BEAM-10925] Support selecting Calc for ZetaSQL testing
This is an automated email from the ASF dual-hosted git repository. apilloud pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git commit 788025e167e7b9d70ba7bd74ee2f7a099172c5a9 Merge: 4f78ab3 812149c Author: Andrew Pilloud AuthorDate: Wed Feb 17 16:34:26 2021 -0700 Merge pull request #14009: [BEAM-10925] Support selecting Calc for ZetaSQL testing .../extensions/sql/zetasql/ZetaSQLQueryPlanner.java | 21 - 1 file changed, 16 insertions(+), 5 deletions(-)
[beam] branch master updated (4f78ab3 -> 788025e)
This is an automated email from the ASF dual-hosted git repository. apilloud pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 4f78ab3 [BEAM-11805] Replace user-agent for spanner (#13990) add 812149c [BEAM-10925] Support selecting Calc for ZetaSQL testing new 788025e Merge pull request #14009: [BEAM-10925] Support selecting Calc for ZetaSQL testing The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: .../extensions/sql/zetasql/ZetaSQLQueryPlanner.java | 21 - 1 file changed, 16 insertions(+), 5 deletions(-)
[beam] branch master updated (dd2e739 -> 4f78ab3)
This is an automated email from the ASF dual-hosted git repository. bhulette pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from dd2e739 Merge pull request #14000 from [BEAM-11791] Fixing dashboard for FnApiRunner benchmarks add 4f78ab3 [BEAM-11805] Replace user-agent for spanner (#13990) No new revisions were added by this update. Summary of changes: .../org/apache/beam/gradle/BeamModulePlugin.groovy | 16 ++-- .../container/license_scripts/dep_urls_java.yaml | 2 +- sdks/java/io/google-cloud-platform/build.gradle| 3 +- .../beam/sdk/io/gcp/spanner/SpannerAccessor.java | 106 - 4 files changed, 113 insertions(+), 14 deletions(-)
[beam] branch master updated: Fixing dashboard
This is an automated email from the ASF dual-hosted git repository. pabloem pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/master by this push: new 078a146 Fixing dashboard new dd2e739 Merge pull request #14000 from [BEAM-11791] Fixing dashboard for FnApiRunner benchmarks 078a146 is described below commit 078a1460545883f8ce1ff644ff244cc9bff0e7ee Author: Pablo Estrada AuthorDate: Tue Feb 16 17:08:58 2021 -0800 Fixing dashboard --- .../dashboards/perftests_metrics/Python_FnApiRunner_ubenchmarks.json | 1 + 1 file changed, 1 insertion(+) diff --git a/.test-infra/metrics/grafana/dashboards/perftests_metrics/Python_FnApiRunner_ubenchmarks.json b/.test-infra/metrics/grafana/dashboards/perftests_metrics/Python_FnApiRunner_ubenchmarks.json index 3b2f2eb..ccbf253 100644 --- a/.test-infra/metrics/grafana/dashboards/perftests_metrics/Python_FnApiRunner_ubenchmarks.json +++ b/.test-infra/metrics/grafana/dashboards/perftests_metrics/Python_FnApiRunner_ubenchmarks.json @@ -139,6 +139,7 @@ "align": false, "alignLevel": null } +} ], "schemaVersion": 22, "style": "dark",
[beam] branch master updated (871e023 -> 01258f1)
This is an automated email from the ASF dual-hosted git repository. bhulette pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 871e023 Merge pull request #14004 from ajamato/rollback add 01258f1 [BEANM-11827] checkJavaLinkage task requires a spread operator for args (#14006) No new revisions were added by this update. Summary of changes: build.gradle.kts | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-)
[beam] branch master updated: Revert "[BEAM-2914] Add portable merging window support to Python. (#12995)"
This is an automated email from the ASF dual-hosted git repository.
robertwb pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/master by this push:
new 9c60fd5 Revert "[BEAM-2914] Add portable merging window support to
Python. (#12995)"
new 871e023 Merge pull request #14004 from ajamato/rollback
9c60fd5 is described below
commit 9c60fd546458f48912285d38bce52a31d2eb4472
Author: Alex Amato
AuthorDate: Wed Feb 17 11:04:53 2021 -0800
Revert "[BEAM-2914] Add portable merging window support to Python. (#12995)"
This reverts commit 625ee1f6e27636f26672e973ecbcecf19a8cb361.
---
.../runners/portability/flink_runner_test.py | 3 -
.../runners/portability/fn_api_runner/execution.py | 241 +
.../portability/fn_api_runner/fn_runner_test.py| 37
.../runners/portability/spark_runner_test.py | 3 -
.../apache_beam/runners/worker/bundle_processor.py | 43
5 files changed, 12 insertions(+), 315 deletions(-)
diff --git a/sdks/python/apache_beam/runners/portability/flink_runner_test.py
b/sdks/python/apache_beam/runners/portability/flink_runner_test.py
index e97ce49..94e30bf 100644
--- a/sdks/python/apache_beam/runners/portability/flink_runner_test.py
+++ b/sdks/python/apache_beam/runners/portability/flink_runner_test.py
@@ -398,9 +398,6 @@ class
FlinkRunnerTest(portable_runner_test.PortableRunnerTest):
def test_register_finalizations(self):
raise unittest.SkipTest("BEAM-11021")
- def test_custom_merging_window(self):
-raise unittest.SkipTest("BEAM-11004")
-
# Inherits all other tests.
diff --git
a/sdks/python/apache_beam/runners/portability/fn_api_runner/execution.py
b/sdks/python/apache_beam/runners/portability/fn_api_runner/execution.py
index a08aa5f..bc69123 100644
--- a/sdks/python/apache_beam/runners/portability/fn_api_runner/execution.py
+++ b/sdks/python/apache_beam/runners/portability/fn_api_runner/execution.py
@@ -24,8 +24,6 @@ from __future__ import absolute_import
import collections
import copy
import itertools
-import uuid
-import weakref
from typing import TYPE_CHECKING
from typing import Any
from typing import DefaultDict
@@ -57,7 +55,6 @@ from
apache_beam.runners.portability.fn_api_runner.translations import only_elem
from apache_beam.runners.portability.fn_api_runner.translations import
split_buffer_id
from apache_beam.runners.portability.fn_api_runner.translations import
unique_name
from apache_beam.runners.worker import bundle_processor
-from apache_beam.transforms import core
from apache_beam.transforms import trigger
from apache_beam.transforms import window
from apache_beam.transforms.window import GlobalWindow
@@ -72,6 +69,7 @@ if TYPE_CHECKING:
from apache_beam.runners.portability.fn_api_runner.fn_runner import
DataOutput
from apache_beam.runners.portability.fn_api_runner.fn_runner import
OutputTimers
from apache_beam.runners.portability.fn_api_runner.translations import
DataSideInput
+ from apache_beam.transforms import core
from apache_beam.transforms.window import BoundedWindow
ENCODED_IMPULSE_VALUE = WindowedValueCoder(
@@ -340,222 +338,6 @@ class
GenericNonMergingWindowFn(window.NonMergingWindowFn):
context.coders[window_coder_id.decode('utf-8')])
-class GenericMergingWindowFn(window.WindowFn):
-
- URN = 'internal-generic-merging'
-
- TO_SDK_TRANSFORM = 'read'
- FROM_SDK_TRANSFORM = 'write'
-
- _HANDLES = {} # type: Dict[str, GenericMergingWindowFn]
-
- def __init__(self, execution_context, windowing_strategy_proto):
-# type: (FnApiRunnerExecutionContext,
beam_runner_api_pb2.WindowingStrategy) -> None
-self._worker_handler = None # type:
Optional[worker_handlers.WorkerHandler]
-self._handle_id = handle_id = uuid.uuid4().hex
-self._HANDLES[handle_id] = self
-# ExecutionContexts are expensive, we don't want to keep them in the
-# static dictionary forever. Instead we hold a weakref and pop self
-# out of the dict once this context goes away.
-self._execution_context_ref_obj = weakref.ref(
-execution_context, lambda _: self._HANDLES.pop(handle_id, None))
-self._windowing_strategy_proto = windowing_strategy_proto
-self._counter = 0
-# Lazily created in make_process_bundle_descriptor()
-self._process_bundle_descriptor = None
-self._bundle_processor_id = None # type: Optional[str]
-self.windowed_input_coder_impl = None # type: Optional[CoderImpl]
-self.windowed_output_coder_impl = None # type: Optional[CoderImpl]
-
- def _execution_context_ref(self):
-# type: () -> FnApiRunnerExecutionContext
-result = self._execution_context_ref_obj()
-assert result is not None
-return result
-
- def payload(self):
-# type: () -> bytes
-return self._handle_id.encode('utf-8')
-
- @staticmethod
- @window.urns.RunnerApiFn.register_urn(URN, bytes)
- def from_runner_api_
[beam] branch master updated (32a0ff1 -> 8f87957)
This is an automated email from the ASF dual-hosted git repository. kenn pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 32a0ff1 Merge pull request #13983 from [BEAM-11818] DebeziumIO connector to support CDC add 8f87957 [BEAM-11626] Upgrading Guava to 30.1-jre while keeping 25.1-jre for Hadoop/Cassandra modules (#13804) No new revisions were added by this update. Summary of changes: CHANGES.md | 5 + .../src/main/groovy/org/apache/beam/gradle/BeamModulePlugin.groovy | 2 +- sdks/java/io/cassandra/build.gradle| 7 +++ sdks/java/io/hadoop-file-system/build.gradle | 7 +++ sdks/java/io/hadoop-format/build.gradle| 7 +++ 5 files changed, 27 insertions(+), 1 deletion(-)
[beam] branch master updated: Beam transform that uses DebeziumIO connector to support CDC
This is an automated email from the ASF dual-hosted git repository. pabloem pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/master by this push: new ac5d258 Beam transform that uses DebeziumIO connector to support CDC new 32a0ff1 Merge pull request #13983 from [BEAM-11818] DebeziumIO connector to support CDC ac5d258 is described below commit ac5d258dcc598a2ef13f0609debefae38530d14a Author: Juan Sandoval AuthorDate: Tue Feb 16 20:01:40 2021 -0800 Beam transform that uses DebeziumIO connector to support CDC Debeziumio PoC (#7) * New DebeziumIO class. * Merge connector code * DebeziumIO and MySqlConnector integrated. * Added FormatFuntion param to Read builder on DebeziumIO. * Added arguments checker to DebeziumIO. * Add simple JSON mapper object (#1) * Add simple JSON mapper object * Fixed Mapper. * Add SqlServer connector test * Added PostgreSql Connector Test PostgreSql now works with Json mapper * Added PostgreSql Connector Test PostgreSql now works with Json mapper * Fixing MySQL schema DataException Using file instead of schema should fix it * MySQL Connector updated from 1.3.0 to 1.3.1 Co-authored-by: osvaldo-salinas Co-authored-by: Carlos Dominguez Co-authored-by: Carlos Domínguez * Add debeziumio tests * Debeziumio testing json mapper (#3) * Some code refactors. Use a default DBHistory if not provided * Add basic tests for Json mapper * Debeziumio time restriction (#5) * Add simple JSON mapper object * Fixed Mapper. * Add SqlServer connector test * Added PostgreSql Connector Test PostgreSql now works with Json mapper * Added PostgreSql Connector Test PostgreSql now works with Json mapper * Fixing MySQL schema DataException Using file instead of schema should fix it * MySQL Connector updated from 1.3.0 to 1.3.1 * Some code refactors. Use a default DBHistory if not provided * Adding based-time restriction Stop polling after specified amount of time * Add basic tests for Json mapper * Adding new restriction Uses a time-based restriction * Adding optional restrcition Uses an optional time-based restriction Co-authored-by: juanitodread Co-authored-by: osvaldo-salinas * Upgrade DebeziumIO connector (#4) * Address comments (Change dependencies to testCompile, Set JsonMapper/Coder as default, refactors) (#8) * Revert file * Change dependencies to testCompile * Move Counter sample to unit test * Set JsonMapper as default mapper function * Set String Coder as default coder when using JsonMapper * Change logs from info to debug * Debeziumio javadoc (#9) * Adding javadoc * Added some titles and examples * Added SourceRecordJson doc * Added Basic Connector doc * Added KafkaSourceConsumer doc * Javadoc cleanup * Removing BasicConnector No usages of this class were found overall * Editing documentation * Debeziumio fetched records restriction (#10) * Adding javadoc * Adding restriction by number of fetched records Also adding a quick-fix for null value within SourceRecords Minor fix on both MySQL and PostgreSQL Connectors Tests * Run either by time or by number of records * Added DebeziumOffsetTrackerTest Tests both restrictions: By amount of time and by Number of records * Removing comment * DebeziumIO test for DB2. (#11) * DebeziumIO test for DB2. * DebeziumIO javadoc. * Clean code:removed commented code lines on DebeziumIOConnectorTest.java * Clean code:removing unused imports and using readAsJson(). Co-authored-by: Carlos Domínguez <74681048+carlosdomingue...@users.noreply.github.com> * Debezium limit records (now configurable) (#12) * Adding javadoc * Records Limit is now configurable (It was fixed before) * Debeziumio dockerize (#13) * Add mysql docker container to tests * Move debezium mysql integration test to its own file * Add assertion to verify that the results contains a record. * Debeziumio readme (#15) * Adding javadoc * Adding README file * Add number of records configuration to the DebeziumIO component (#16) * Code refactors (#17) * Remove/ignore null warnings * Remove DB2 code * Remove docker dependency in DebeziumIO unit test and max number of recods to MySql integration test
