[jira] [Created] (HDFS-14342) WebHDFS: expose NEW_BLOCK flag in APPEND operation
Anatoli Shein created HDFS-14342: Summary: WebHDFS: expose NEW_BLOCK flag in APPEND operation Key: HDFS-14342 URL: https://issues.apache.org/jira/browse/HDFS-14342 Project: Hadoop HDFS Issue Type: Task Components: webhdfs Reporter: Anatoli Shein Assignee: Anatoli Shein After the support for variable length blocks was added (HDFS-3689), we should expose the NEW_BLOCK flag of APPEND operation in webhdfs, so that this functionality will be usable over the rest api. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-14047) [libhdfs++] Fix hdfsGetLastExceptionRootCause bug in test_libhdfs_threaded.c
Anatoli Shein created HDFS-14047: Summary: [libhdfs++] Fix hdfsGetLastExceptionRootCause bug in test_libhdfs_threaded.c Key: HDFS-14047 URL: https://issues.apache.org/jira/browse/HDFS-14047 Project: Hadoop HDFS Issue Type: Sub-task Components: libhdfs, native Reporter: Anatoli Shein Assignee: Anatoli Shein Currently the native client CI tests break deterministically with these errors: Libhdfs 1 - test_test_libhdfs_threaded_hdfs_static (Failed) [exec] TEST_ERROR: failed on /testptch/hadoop/hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfs-tests/test_libhdfs_threaded.c:180 with NULL return return value (errno: 2): expected substring: File does not exist [exec] TEST_ERROR: failed on /testptch/hadoop/hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfs-tests/test_libhdfs_threaded.c:336 with return code -1 (errno: 2): got nonzero from doTestHdfsOperations(ti, fs, &paths) [exec] hdfsOpenFile(/tlhData0001/file1): FileSystem#open((Lorg/apache/hadoop/fs/Path;I)Lorg/apache/hadoop/fs/FSDataInputStream;) error: [exec] (unable to get root cause for java.io.FileNotFoundException) [exec] (unable to get stack trace for java.io.FileNotFoundException) Libhdfs++ 34 - test_libhdfs_threaded_hdfspp_test_shim_static (Failed) [exec] TEST_ERROR: failed on /testptch/hadoop/hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfs-tests/test_libhdfs_threaded.c:180 with NULL return return value (errno: 2): expected substring: File does not exist [exec] TEST_ERROR: failed on /testptch/hadoop/hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfs-tests/test_libhdfs_threaded.c:336 with return code -1 (errno: 2): got nonzero from doTestHdfsOperations(ti, fs, &paths) [exec] hdfsOpenFile(/tlhData0001/file1): FileSystem#open((Lorg/apache/hadoop/fs/Path;I)Lorg/apache/hadoop/fs/FSDataInputStream;) error: [exec] (unable to get root cause for java.io.FileNotFoundException) [exec] (unable to get stack trace for java.io.FileNotFoundException) -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-14033) [libhdfs++] Disable libhdfs++ build on systems that do not support thread_local
Anatoli Shein created HDFS-14033: Summary: [libhdfs++] Disable libhdfs++ build on systems that do not support thread_local Key: HDFS-14033 URL: https://issues.apache.org/jira/browse/HDFS-14033 Project: Hadoop HDFS Issue Type: Sub-task Reporter: Anatoli Shein In order to still be able to build Hadoop on older systems (such as rhel 6) we need to disable libhdfs++ build on systems that do not support thread_local. We should also emit a warning saying libhdfs++ wasn't built. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-12276) libhdfs++: uri parser has clang warnings that break external projects
Anatoli Shein created HDFS-12276:
Summary: libhdfs++: uri parser has clang warnings that break
external projects
Key: HDFS-12276
URL: https://issues.apache.org/jira/browse/HDFS-12276
Project: Hadoop HDFS
Issue Type: Sub-task
Reporter: Anatoli Shein
When trying to do a clang build of libhdfs++ as part of the ORC project I get
some warnings that are treated as errors:
In file included from
/home/travis/build/apache/orc/c++/libs/libhdfspp/include/hdfspp/options.h:21:
/home/travis/build/apache/orc/c++/libs/libhdfspp/include/hdfspp/uri.h:30:7:
error: 'uri_parse_error' has no out-of-line virtual method definitions; its
vtable will be emitted in every translation unit [-Werror,-Wweak-vtables]
class uri_parse_error : public std::invalid_argument {
^
2 errors generated.
These should be fixed.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Reopened] (HDFS-12237) libhdfs++: PROTOC_IS_COMPATIBLE check fails if protobuf library is built from source
[ https://issues.apache.org/jira/browse/HDFS-12237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anatoli Shein reopened HDFS-12237: -- > libhdfs++: PROTOC_IS_COMPATIBLE check fails if protobuf library is built from > source > > > Key: HDFS-12237 > URL: https://issues.apache.org/jira/browse/HDFS-12237 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: hdfs-client >Reporter: Anatoli Shein >Assignee: Anatoli Shein > Attachments: HDFS-12237.HDFS-8707.000.patch > > > Looks like the PROTOC_IS_COMPATIBLE check fails when Protobuf library is > built from source. This happens because the check if performed during the > cmake phase, and the protobuf library needed for this test is build from > source only during the make phase, so the check fails with "ld: cannot find > -lprotobuf" because it was not built yet. We should probably restrict this > test to run only in cases when Protobuf library is already present and not > being built from source. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Resolved] (HDFS-12237) libhdfs++: PROTOC_IS_COMPATIBLE check fails if protobuf library is built from source
[ https://issues.apache.org/jira/browse/HDFS-12237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anatoli Shein resolved HDFS-12237. -- Resolution: Fixed > libhdfs++: PROTOC_IS_COMPATIBLE check fails if protobuf library is built from > source > > > Key: HDFS-12237 > URL: https://issues.apache.org/jira/browse/HDFS-12237 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: hdfs-client >Reporter: Anatoli Shein >Assignee: Anatoli Shein > > Looks like the PROTOC_IS_COMPATIBLE check fails when Protobuf library is > built from source. This happens because the check if performed during the > cmake phase, and the protobuf library needed for this test is build from > source only during the make phase, so the check fails with "ld: cannot find > -lprotobuf" because it was not built yet. We should probably restrict this > test to run only in cases when Protobuf library is already present and not > being built from source. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-12237) libhdfs++: PROTOC_IS_COMPATIBLE check fails if protobuf library is built from source
Anatoli Shein created HDFS-12237: Summary: libhdfs++: PROTOC_IS_COMPATIBLE check fails if protobuf library is built from source Key: HDFS-12237 URL: https://issues.apache.org/jira/browse/HDFS-12237 Project: Hadoop HDFS Issue Type: Sub-task Reporter: Anatoli Shein Looks like the PROTOC_IS_COMPATIBLE check fails when Protobuf library is built from source. This happens because the check if performed during the cmake phase, and the protobuf library needed for this test is build from source only during the make phase, so the check fails with "ld: cannot find -lprotobuf" because it was not built yet. We should probably restrict this test to run only in cases when Protobuf library is already present and not being built from source. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Resolved] (HDFS-12097) libhdfs++: add Clang build and tests to the CI system
[ https://issues.apache.org/jira/browse/HDFS-12097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anatoli Shein resolved HDFS-12097. -- Resolution: Fixed Fixed as part of HDFS-12026. > libhdfs++: add Clang build and tests to the CI system > - > > Key: HDFS-12097 > URL: https://issues.apache.org/jira/browse/HDFS-12097 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: hdfs-client >Reporter: Anatoli Shein >Assignee: Anatoli Shein > > For better portability we should add a Clang build and tests of libhdfs++ > library to the CI system. To accomplish that the Dockerfile will need to be > updated with the environment setup, and the maven files should be updated to > build libhdfs++ using Clang and then run the tests. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-12097) libhdfs++: add Clang build and tests to the CI system
Anatoli Shein created HDFS-12097: Summary: libhdfs++: add Clang build and tests to the CI system Key: HDFS-12097 URL: https://issues.apache.org/jira/browse/HDFS-12097 Project: Hadoop HDFS Issue Type: Sub-task Reporter: Anatoli Shein For better portability we should add a Clang build and tests of libhdfs++ library to the CI system. To accomplish that the Dockerfile will need to be updated with the environment setup, and the maven files should be updated to build libhdfs++ using Clang and then run the tests. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-12026) libhdfspp: Fix compilation errors and warnings when compiling with Clang
Anatoli Shein created HDFS-12026: Summary: libhdfspp: Fix compilation errors and warnings when compiling with Clang Key: HDFS-12026 URL: https://issues.apache.org/jira/browse/HDFS-12026 Project: Hadoop HDFS Issue Type: Sub-task Reporter: Anatoli Shein Assignee: Anatoli Shein Currently multiple errors and warnings prevent libhdfspp from being compiled with clang. It should compile cleanly using flags: -std=c++11 -stdlib=libc++ and also warning flags: -Weverything -Wno-c++98-compat -Wno-missing-prototypes -Wno-c++98-compat-pedantic -Wno-padded -Wno-covered-switch-default -Wno-missing-noreturn -Wno-unknown-pragmas -Wconversion -Werror -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-11973) libhdfs++: Remove redundant directories in examples
Anatoli Shein created HDFS-11973: Summary: libhdfs++: Remove redundant directories in examples Key: HDFS-11973 URL: https://issues.apache.org/jira/browse/HDFS-11973 Project: Hadoop HDFS Issue Type: Sub-task Reporter: Anatoli Shein -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-11971) libhdfs++: A few portability issues
Anatoli Shein created HDFS-11971:
Summary: libhdfs++: A few portability issues
Key: HDFS-11971
URL: https://issues.apache.org/jira/browse/HDFS-11971
Project: Hadoop HDFS
Issue Type: Sub-task
Reporter: Anatoli Shein
I recently encountered a few portability issues with libhdfs++ while trying to
build it as a stand alone project (and also as part of another Apache project).
1. Method fixCase in configuration.h file produces a warning "conversion to
‘char’ from ‘int’ may alter its value [-Werror=conversion]" which does not
allow libhdfs++ to be compiled as part of the codebase that treats such
warnings as errors (can be fixed with a simple cast).
2. In CMakeLists.txt file (in libhdfspp directory) we do find_package(Threads)
however we do not link it to the targets (e.g. hdfspp_static), which causes the
build to fail with pthread errors. After the Threads package is found we need
to link it using ${CMAKE_THREAD_LIBS_INIT}.
3. All the tools and examples fail to build as part of a standalone libhdfs++
because they are missing multiple libraries such as protobuf, ssl, pthread,
etc. This happens because we link them to a shared library hdfspp instead of
hdfspp_static library. We should either link all the tools and examples to
hdfspp_static library or explicitly add linking to all missing libraries for
each tool/example.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-11930) libhdfs++: Docker script fails while trying to download JDK 7.
Anatoli Shein created HDFS-11930: Summary: libhdfs++: Docker script fails while trying to download JDK 7. Key: HDFS-11930 URL: https://issues.apache.org/jira/browse/HDFS-11930 Project: Hadoop HDFS Issue Type: Sub-task Reporter: Anatoli Shein Assignee: Anatoli Shein The CI system Apache Yetus crashes with: Docker failed to build yetus/hadoop:78fc6b6 The error appears to be caused by: Location: http://download.oracle.com/otn-pub/java/jdk/7u80-b15/jdk-7u80-linux-x64.tar.gz?AuthParam=1495630848_6203b920eab45659a5ec46a07cf84db9 [following] --2017-05-24 12:58:48-- http://download.oracle.com/otn-pub/java/jdk/7u80-b15/jdk-7u80-linux-x64.tar.gz?AuthParam=1495630848_6203b920eab45659a5ec46a07cf84db9 Connecting to download.oracle.com (download.oracle.com)|23.59.189.81|:80... [0m[91mconnected. HTTP request sent, awaiting response... [0m[91m404 Not Found [0m[91m2017-05-24 12:58:49 ERROR 404: Not Found. [0m[91m [0m[91mdownload failed Oracle JDK 7 is NOT installed. [0m[91mdpkg: error processing package oracle-java7-installer (--configure): subprocess installed post-installation script returned error exit status 1 It looks like the docker scripts need to be updated to resolve this issue. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-10787) libhdfs++: hdfs_configuration and configuration_loader should be accessible from our public API
Anatoli Shein created HDFS-10787: Summary: libhdfs++: hdfs_configuration and configuration_loader should be accessible from our public API Key: HDFS-10787 URL: https://issues.apache.org/jira/browse/HDFS-10787 Project: Hadoop HDFS Issue Type: Sub-task Reporter: Anatoli Shein Currently, libhdfspp examples and tools all have this: #include "hdfspp/hdfspp.h" #include "common/hdfs_configuration.h" #include "common/configuration_loader.h" This is done in order to read configs and connect. We want hdfs_configuration and configuration_loader to be accessible just by including our hdfspp.h. One way to achieve that would be to create a builder, and would include the above libraries. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-10785) libhdfs++: Implement the rest of the tools
Anatoli Shein created HDFS-10785: Summary: libhdfs++: Implement the rest of the tools Key: HDFS-10785 URL: https://issues.apache.org/jira/browse/HDFS-10785 Project: Hadoop HDFS Issue Type: Sub-task Reporter: Anatoli Shein -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-10754) libhdfs++: Create tools directory and implement hdfs_cat
Anatoli Shein created HDFS-10754: Summary: libhdfs++: Create tools directory and implement hdfs_cat Key: HDFS-10754 URL: https://issues.apache.org/jira/browse/HDFS-10754 Project: Hadoop HDFS Issue Type: Sub-task Reporter: Anatoli Shein -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-10746) libhdfs++: synchronize access to working_directory and bytes_read_.
Anatoli Shein created HDFS-10746: Summary: libhdfs++: synchronize access to working_directory and bytes_read_. Key: HDFS-10746 URL: https://issues.apache.org/jira/browse/HDFS-10746 Project: Hadoop HDFS Issue Type: Sub-task Reporter: Anatoli Shein std::string working_directory is located in hdfs.cc and access to it should be synchronized with locks. uint64_t bytes_read_; is located in filehandle.h and it should be made atomic in order to be thread safe when multithreading becomes available. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-10740) libhdfs++: Implement recursive directory generator
Anatoli Shein created HDFS-10740: Summary: libhdfs++: Implement recursive directory generator Key: HDFS-10740 URL: https://issues.apache.org/jira/browse/HDFS-10740 Project: Hadoop HDFS Issue Type: Sub-task Reporter: Anatoli Shein This tool will allow us do benchmarking/testing our find functionality, and will be a good example showing how to call a large number or namenode operations reqursively. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-10739) libhdfs++: In RPC engine replace vector with deque for pending requests
Anatoli Shein created HDFS-10739: Summary: libhdfs++: In RPC engine replace vector with deque for pending requests Key: HDFS-10739 URL: https://issues.apache.org/jira/browse/HDFS-10739 Project: Hadoop HDFS Issue Type: Sub-task Reporter: Anatoli Shein Needs to be added in order to improve performance -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-10679) libhdfs++: Implement parallel find with wildcards tool
Anatoli Shein created HDFS-10679: Summary: libhdfs++: Implement parallel find with wildcards tool Key: HDFS-10679 URL: https://issues.apache.org/jira/browse/HDFS-10679 Project: Hadoop HDFS Issue Type: Sub-task Reporter: Anatoli Shein The find tool will issue the GetListing namenode operation on a given directory, and filter the results using posix globbing library. If the recursive option is selected, for each returned entry that is a directory the tool will issue another asynchronous call GetListing and repeat the result processing in a recursive fashion. One implementation issue that needs to be addressed is the way how results are returned back to the user: we can either buffer the results and return them to the user in bulk, or we can return results continuously as they arrive. While buffering would be an easier solution, returning results as they arrive would be more beneficial to the user in terms of performance, since the result processing can start as soon as the first results arrive without any delay. In order to do that we need the user to use a loop to process arriving results, and we need to send a special message back to the user when the search is over. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-10672) libhdfs++: reorder directories in src/main/libhdfspp/examples, and add C++ version of cat tool
Anatoli Shein created HDFS-10672: Summary: libhdfs++: reorder directories in src/main/libhdfspp/examples, and add C++ version of cat tool Key: HDFS-10672 URL: https://issues.apache.org/jira/browse/HDFS-10672 Project: Hadoop HDFS Issue Type: Sub-task Reporter: Anatoli Shein Assignee: Anatoli Shein src/main/libhdfspp/examples should be structured like examples/language/utility instead of examples/utility/language for easier access by different developers. Additionally implementing C++ version of cat tool. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-10621) libhdfs++: Implement . (dot) and .. (double-dot) semantics
Anatoli Shein created HDFS-10621: Summary: libhdfs++: Implement . (dot) and .. (double-dot) semantics Key: HDFS-10621 URL: https://issues.apache.org/jira/browse/HDFS-10621 Project: Hadoop HDFS Issue Type: Sub-task Reporter: Anatoli Shein We need to implement . (dot) and .. (double-dot) semantics in hdfs.cc in getAbsolutePath, hdfsSetWorkingDirectory, hdfsGetWorkingDirectory. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-10596) libhdfs++: Implement hdfsFileIsEncrypted
Anatoli Shein created HDFS-10596: Summary: libhdfs++: Implement hdfsFileIsEncrypted Key: HDFS-10596 URL: https://issues.apache.org/jira/browse/HDFS-10596 Project: Hadoop HDFS Issue Type: Sub-task Reporter: Anatoli Shein -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-10595) libhdfs++: Client Name Protobuf Error
Anatoli Shein created HDFS-10595: Summary: libhdfs++: Client Name Protobuf Error Key: HDFS-10595 URL: https://issues.apache.org/jira/browse/HDFS-10595 Project: Hadoop HDFS Issue Type: Sub-task Reporter: Anatoli Shein When running a cat tool (/hadoop-hdfs-native-client/src/main/native/libhdfspp/examples/cat/c/cat.c) I get the following error: [libprotobuf ERROR google/protobuf/wire_format.cc:1053] String field contains invalid UTF-8 data when serializing a protocol buffer. Use the 'bytes' type if you intend to send raw bytes. However it executes correctly. Looks like this error happens when trying to serialize Client name in ClientOperationHeaderProto::SerializeWithCachedSizes (/hadoop-hdfs-native-client/target/main/native/libhdfspp/lib/proto/datatransfer.pb.cc) Possibly the problem is caused by generating client name as a UUID in GetRandomClientName (/hadoop-hdfs-native-client/src/main/native/libhdfspp/lib/common/util.cc) In Java client it looks like there are two different unique client identifiers: ClientName and ClientId: Client name is generated as: clientName = "DFSClient_" + dfsClientConf.getTaskId() + "_" + ThreadLocalRandom.current().nextInt() + "_" + Thread.currentThread().getId(); (/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DFSClient.java) ClientId is generated as a UUID in (/hadoop-common/src/main/java/org/apache/hadoop/ipc/ClientId.java) In libhdfs++ we need to possibly also have two unique client identifiers, or fix the current client name to work without protobuf warnings/errors. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-10524) libhdfs++: Implement chmod and chown
Anatoli Shein created HDFS-10524: Summary: libhdfs++: Implement chmod and chown Key: HDFS-10524 URL: https://issues.apache.org/jira/browse/HDFS-10524 Project: Hadoop HDFS Issue Type: Sub-task Reporter: Anatoli Shein -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-10515) libhdfs++: Implement mkdirs, rmdir, rename, and remove
Anatoli Shein created HDFS-10515: Summary: libhdfs++: Implement mkdirs, rmdir, rename, and remove Key: HDFS-10515 URL: https://issues.apache.org/jira/browse/HDFS-10515 Project: Hadoop HDFS Issue Type: Sub-task Reporter: Anatoli Shein -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-10513) libhdfs++: Ensure we're connected when FS methods are called
Anatoli Shein created HDFS-10513: Summary: libhdfs++: Ensure we're connected when FS methods are called Key: HDFS-10513 URL: https://issues.apache.org/jira/browse/HDFS-10513 Project: Hadoop HDFS Issue Type: Sub-task Reporter: Anatoli Shein We can either transparently connect or complain if we're not -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-10511) libhdfs++: make error returning mechanism consistent across all hdfs operations
Anatoli Shein created HDFS-10511: Summary: libhdfs++: make error returning mechanism consistent across all hdfs operations Key: HDFS-10511 URL: https://issues.apache.org/jira/browse/HDFS-10511 Project: Hadoop HDFS Issue Type: Sub-task Reporter: Anatoli Shein Errno should always be set. If function is returning a code on stack, it should be consistent with errno. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-10494) libhdfs++: Implement snapshot operations
Anatoli Shein created HDFS-10494: Summary: libhdfs++: Implement snapshot operations Key: HDFS-10494 URL: https://issues.apache.org/jira/browse/HDFS-10494 Project: Hadoop HDFS Issue Type: Sub-task Reporter: Anatoli Shein -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-10491) libhdfs++: Implement GetFsStats
Anatoli Shein created HDFS-10491: Summary: libhdfs++: Implement GetFsStats Key: HDFS-10491 URL: https://issues.apache.org/jira/browse/HDFS-10491 Project: Hadoop HDFS Issue Type: Sub-task Reporter: Anatoli Shein -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-10454) libhdfspp: Move NameNodeOp to a separate file
Anatoli Shein created HDFS-10454: Summary: libhdfspp: Move NameNodeOp to a separate file Key: HDFS-10454 URL: https://issues.apache.org/jira/browse/HDFS-10454 Project: Hadoop HDFS Issue Type: Sub-task Reporter: Anatoli Shein Priority: Minor -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
