This is an automated email from the ASF dual-hosted git repository.
chamikara pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.
from 20405c3 [BEAM-3774] Adds support for reading from/writing to more BQ
geographical locations (#5001)
add f078f4a Add HadoopFileSystemOptions support for Dataflow.
add 6caab3b Fix HadoopFileSystem.match bugs.
add 825e797 Test HDFS reads in integration test.
add 9ed922f Fix linter errors and add missing license.
new 4641fdb Merge pull request #4979: [BEAM-3965] HDFS Read fixes
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
sdks/python/apache_beam/io/filesystem.py | 3 +-
sdks/python/apache_beam/io/filesystems.py | 7 ++-
sdks/python/apache_beam/io/hadoopfilesystem.py | 42 +++++++------
.../python/apache_beam/io/hadoopfilesystem_test.py | 68 +++++++++++++++++-----
.../io/hdfs_integration_test/Dockerfile | 12 +++-
.../io/hdfs_integration_test/hdfscli.cfg} | 10 ++--
sdks/python/run_postcommit.sh | 2 +-
7 files changed, 102 insertions(+), 42 deletions(-)
copy sdks/{java/core/src/main/resources/org/apache/beam/sdk/sdk.properties =>
python/apache_beam/io/hdfs_integration_test/hdfscli.cfg} (90%)
--
To stop receiving notification emails like this one, please contact
[email protected].
