[jira] [Comment Edited] (HDDS-368) all tests in TestOzoneRestClient failed due to "zh_CN" OS language
[
https://issues.apache.org/jira/browse/HDDS-368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16620987#comment-16620987
]
Tsz Wo Nicholas Sze edited comment on HDDS-368 at 9/19/18 6:16 PM:
---
{code}
$mvn --version
Apache Maven 3.5.4 (1edded0938998edf8bf061f1ceb3cfdeccf443fe;
2018-06-17T11:33:14-07:00)
Maven home: /usr/local/Cellar/maven/3.5.4/libexec
Java version: 1.8.0_172, vendor: Oracle Corporation, runtime:
/Library/Java/JavaVirtualMachines/jdk1.8.0_172.jdk/Contents/Home/jre
Default locale: zh_CN, platform encoding: UTF-8
OS name: "mac os x", version: "10.13.6", arch: "x86_64", family: "mac"
{code}
[~GeLiXin], I have set my locale to zh_CN. I can see some compiler warnings in
Chinese but TestOzoneRestClient have not failed. Could you try updating your
maven/java versions?
{code}
[INFO] Compiling 23 source files to
/Users/szetszwo/hadoop/apache-hadoop/hadoop-ozone/integration-test/target/test-classes
[WARNING]
/Users/szetszwo/hadoop/apache-hadoop/hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/web/client/TestKeys.java:
某些输入文件使用了未经检查或不安全的操作。
[WARNING]
/Users/szetszwo/hadoop/apache-hadoop/hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/web/client/TestKeys.java:
有关详细信息, 请使用 -Xlint:unchecked 重新编译。
[INFO]
[INFO] --- maven-surefire-plugin:2.21.0:test (default-test) @
hadoop-ozone-integration-test ---
[INFO]
[INFO] ---
[INFO] T E S T S
[INFO] ---
[INFO] Running org.apache.hadoop.ozone.client.rest.TestOzoneRestClient
[INFO] Tests run: 21, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 12.136
s - in org.apache.hadoop.ozone.client.rest.TestOzoneRestClient
[INFO]
[INFO] Results:
[INFO]
[INFO] Tests run: 21, Failures: 0, Errors: 0, Skipped: 0
[INFO]
{code}
was (Author: szetszwo):
{code}
$mvn --version
Apache Maven 3.5.4 (1edded0938998edf8bf061f1ceb3cfdeccf443fe;
2018-06-17T11:33:14-07:00)
Maven home: /usr/local/Cellar/maven/3.5.4/libexec
Java version: 1.8.0_172, vendor: Oracle Corporation, runtime:
/Library/Java/JavaVirtualMachines/jdk1.8.0_172.jdk/Contents/Home/jre
Default locale: zh_CN, platform encoding: UTF-8
OS name: "mac os x", version: "10.13.6", arch: "x86_64", family: "mac"
HW14119:apache-hadoop$
{code}
[~GeLiXin], I have set my locale to zh_CN. I can see some compiler warnings in
Chinese but TestOzoneRestClient have not failed. Could you try updating your
maven/java versions?
{code}
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @
hadoop-ozone-integration-test ---
[INFO] Compiling 23 source files to
/Users/szetszwo/hadoop/apache-hadoop/hadoop-ozone/integration-test/target/test-classes
[WARNING]
/Users/szetszwo/hadoop/apache-hadoop/hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/web/client/TestKeys.java:
某些输入文件使用了未经检查或不安全的操作。
[WARNING]
/Users/szetszwo/hadoop/apache-hadoop/hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/web/client/TestKeys.java:
有关详细信息, 请使用 -Xlint:unchecked 重新编译。
[INFO]
[INFO] --- maven-surefire-plugin:2.21.0:test (default-test) @
hadoop-ozone-integration-test ---
[INFO]
[INFO] ---
[INFO] T E S T S
[INFO] ---
[INFO] Running org.apache.hadoop.ozone.client.rest.TestOzoneRestClient
[INFO] Tests run: 21, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 12.136
s - in org.apache.hadoop.ozone.client.rest.TestOzoneRestClient
[INFO]
[INFO] Results:
[INFO]
[INFO] Tests run: 21, Failures: 0, Errors: 0, Skipped: 0
[INFO]
{code}
> all tests in TestOzoneRestClient failed due to "zh_CN" OS language
> --
>
> Key: HDDS-368
> URL: https://issues.apache.org/jira/browse/HDDS-368
> Project: Hadoop Distributed Data Store
> Issue Type: Bug
> Components: test
>Affects Versions: 0.2.1
>Reporter: LiXin Ge
>Priority: Critical
> Labels: alpha2
>
> OS: Ubuntu 16.04.1 LTS (GNU/Linux 4.4.0-116-generic x86_64)
> java version: 1.8.0_111
> mvn: Apache Maven 3.3.9
> Default locale: zh_CN, platform encoding: UTF-8
> Test command: mvn test -Dtest=TestOzoneRestClient -Phdds
>
> All the tests in TestOzoneRestClient failed in my local machine with
> exception like below, does it mean anybody who have runtime environment like
> me can't run the Ozone Rest test now?
> {noformat}
> [ERROR]
> testCreateBucket(org.apache.hadoop.ozone.client.rest.TestOzoneRestClient)
> Time elapsed: 0.01 s <<< ERROR!
> java.io.IOException: org.apache.hadoop.ozone.client.rest.OzoneException:
> Unparseable date: "m, 28 1970 19:23:50 GMT"
> at
> org.apache.hadoop.ozone.client.rest.RestClient.executeHttpRequest(Re
[jira] [Comment Edited] (HDDS-368) all tests in TestOzoneRestClient failed due to "zh_CN" OS language
[
https://issues.apache.org/jira/browse/HDDS-368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16620987#comment-16620987
]
Tsz Wo Nicholas Sze edited comment on HDDS-368 at 9/19/18 6:22 PM:
---
{code}
$mvn --version
Apache Maven 3.5.4 (1edded0938998edf8bf061f1ceb3cfdeccf443fe;
2018-06-17T11:33:14-07:00)
Maven home: /usr/local/Cellar/maven/3.5.4/libexec
Java version: 1.8.0_172, vendor: Oracle Corporation, runtime:
/Library/Java/JavaVirtualMachines/jdk1.8.0_172.jdk/Contents/Home/jre
Default locale: zh_CN, platform encoding: UTF-8
OS name: "mac os x", version: "10.13.6", arch: "x86_64", family: "mac"
{code}
[~GeLiXin], I have set my locale to zh_CN. I can see some compiler warnings in
Chinese but TestOzoneRestClient has not failed. Could you try updating your
maven/java versions?
{code}
[INFO] Compiling 23 source files to
/Users/szetszwo/hadoop/apache-hadoop/hadoop-ozone/integration-test/target/test-classes
[WARNING]
/Users/szetszwo/hadoop/apache-hadoop/hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/web/client/TestKeys.java:
某些输入文件使用了未经检查或不安全的操作。
[WARNING]
/Users/szetszwo/hadoop/apache-hadoop/hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/web/client/TestKeys.java:
有关详细信息, 请使用 -Xlint:unchecked 重新编译。
[INFO]
[INFO] --- maven-surefire-plugin:2.21.0:test (default-test) @
hadoop-ozone-integration-test ---
[INFO]
[INFO] ---
[INFO] T E S T S
[INFO] ---
[INFO] Running org.apache.hadoop.ozone.client.rest.TestOzoneRestClient
[INFO] Tests run: 21, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 12.136
s - in org.apache.hadoop.ozone.client.rest.TestOzoneRestClient
[INFO]
[INFO] Results:
[INFO]
[INFO] Tests run: 21, Failures: 0, Errors: 0, Skipped: 0
{code}
was (Author: szetszwo):
{code}
$mvn --version
Apache Maven 3.5.4 (1edded0938998edf8bf061f1ceb3cfdeccf443fe;
2018-06-17T11:33:14-07:00)
Maven home: /usr/local/Cellar/maven/3.5.4/libexec
Java version: 1.8.0_172, vendor: Oracle Corporation, runtime:
/Library/Java/JavaVirtualMachines/jdk1.8.0_172.jdk/Contents/Home/jre
Default locale: zh_CN, platform encoding: UTF-8
OS name: "mac os x", version: "10.13.6", arch: "x86_64", family: "mac"
{code}
[~GeLiXin], I have set my locale to zh_CN. I can see some compiler warnings in
Chinese but TestOzoneRestClient have not failed. Could you try updating your
maven/java versions?
{code}
[INFO] Compiling 23 source files to
/Users/szetszwo/hadoop/apache-hadoop/hadoop-ozone/integration-test/target/test-classes
[WARNING]
/Users/szetszwo/hadoop/apache-hadoop/hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/web/client/TestKeys.java:
某些输入文件使用了未经检查或不安全的操作。
[WARNING]
/Users/szetszwo/hadoop/apache-hadoop/hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/web/client/TestKeys.java:
有关详细信息, 请使用 -Xlint:unchecked 重新编译。
[INFO]
[INFO] --- maven-surefire-plugin:2.21.0:test (default-test) @
hadoop-ozone-integration-test ---
[INFO]
[INFO] ---
[INFO] T E S T S
[INFO] ---
[INFO] Running org.apache.hadoop.ozone.client.rest.TestOzoneRestClient
[INFO] Tests run: 21, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 12.136
s - in org.apache.hadoop.ozone.client.rest.TestOzoneRestClient
[INFO]
[INFO] Results:
[INFO]
[INFO] Tests run: 21, Failures: 0, Errors: 0, Skipped: 0
[INFO]
{code}
> all tests in TestOzoneRestClient failed due to "zh_CN" OS language
> --
>
> Key: HDDS-368
> URL: https://issues.apache.org/jira/browse/HDDS-368
> Project: Hadoop Distributed Data Store
> Issue Type: Bug
> Components: test
>Affects Versions: 0.2.1
>Reporter: LiXin Ge
>Priority: Critical
> Labels: alpha2
>
> OS: Ubuntu 16.04.1 LTS (GNU/Linux 4.4.0-116-generic x86_64)
> java version: 1.8.0_111
> mvn: Apache Maven 3.3.9
> Default locale: zh_CN, platform encoding: UTF-8
> Test command: mvn test -Dtest=TestOzoneRestClient -Phdds
>
> All the tests in TestOzoneRestClient failed in my local machine with
> exception like below, does it mean anybody who have runtime environment like
> me can't run the Ozone Rest test now?
> {noformat}
> [ERROR]
> testCreateBucket(org.apache.hadoop.ozone.client.rest.TestOzoneRestClient)
> Time elapsed: 0.01 s <<< ERROR!
> java.io.IOException: org.apache.hadoop.ozone.client.rest.OzoneException:
> Unparseable date: "m, 28 1970 19:23:50 GMT"
> at
> org.apache.hadoop.ozone.client.rest.RestClient.executeHttpRequest(RestClient.java:853)
> at
> org.apache.hadoop.ozone.client.rest.RestClient.createVolume(RestClient.java:252)
> at
> org.apache.hadoop.ozon
[jira] [Comment Edited] (HDDS-368) all tests in TestOzoneRestClient failed due to "zh_CN" OS language
[
https://issues.apache.org/jira/browse/HDDS-368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16621869#comment-16621869
]
LiXin Ge edited comment on HDDS-368 at 9/20/18 11:44 AM:
-
Thanks [~szetszwo] for the testing. I have updated my maven version to 3.5.4 as
your advice, but it didn't work, I can reproduce this issue every time by set
locale to zh_CN. Maybe this is a problem mixed with locale and somethings else,
such as OS or something.
FYI, Once the string transfered by HTTP have Chinese character(or character not
in english letters and numbers), The "string".length() will shorter than the
"string".getBytes().length, and then the data will be truncated by transfer and
the error occured.
{noformat}
hadoop@hadoop:/home/glx/hadoop$ mvn -v
Apache Maven 3.5.4 (1edded0938998edf8bf061f1ceb3cfdeccf443fe;
2018-06-18T02:33:14+08:00)
Maven home: /home/maven/apache-maven-3.5.4
Java version: 1.8.0_111, vendor: Oracle Corporation, runtime:
/home/hadoop/liuhua/hadoop/jdk1.8.0_111/jre
Default locale: zh_CN, platform encoding: UTF-8
OS name: "linux", version: "4.4.0-116-generic", arch: "amd64", family: "unix"
{noformat}
{noformat}
[ERROR]
testCreateBucket(org.apache.hadoop.ozone.client.rest.TestOzoneRestClient) Time
elapsed: 0.013 s <<< ERROR!
com.fasterxml.jackson.core.io.JsonEOFException:
Unexpected end-of-input: expected close marker for Object (start marker at
[Source:
(String)"{"httpCode":400,"shortMessage":"badDate","resource":"ed709d90-601a-4039-b515-0a5c89b74f6d","message":"Unparseable
date: \"�, 30 \u\b 1970 03:15:11
GMT\"","requestID":"e9a66c77-6b8c-4f58-821b-c3e2fbd04758","hostName":"hadoop"";
line: 1, column: 1])
at [Source:
(String)"{"httpCode":400,"shortMessage":"badDate","resource":"ed709d90-601a-4039-b515-0a5c89b74f6d","message":"Unparseable
date: \"�, 30 \u\b 1970 03:15:11
GMT\"","requestID":"e9a66c77-6b8c-4f58-821b-c3e2fbd04758","hostName":"hadoop"";
line: 1, column: 459]
at
com.fasterxml.jackson.core.base.ParserMinimalBase._reportInvalidEOF(ParserMinimalBase.java:588)
at
com.fasterxml.jackson.core.base.ParserBase._handleEOF(ParserBase.java:485)
at
com.fasterxml.jackson.core.base.ParserBase._eofAsNextChar(ParserBase.java:497)
at
com.fasterxml.jackson.core.json.ReaderBasedJsonParser._skipWSOrEnd(ReaderBasedJsonParser.java:2332)
at
com.fasterxml.jackson.core.json.ReaderBasedJsonParser.nextToken(ReaderBasedJsonParser.java:646)
at
com.fasterxml.jackson.databind.deser.std.ThrowableDeserializer.deserializeFromObject(ThrowableDeserializer.java:87)
at
com.fasterxml.jackson.databind.deser.BeanDeserializer.deserialize(BeanDeserializer.java:159)
at
com.fasterxml.jackson.databind.ObjectReader._bindAndClose(ObjectReader.java:1611)
at
com.fasterxml.jackson.databind.ObjectReader.readValue(ObjectReader.java:1219)
at
org.apache.hadoop.ozone.client.rest.OzoneException.parse(OzoneException.java:265)
at
org.apache.hadoop.ozone.client.rest.RestClient.executeHttpRequest(RestClient.java:856)
at
org.apache.hadoop.ozone.client.rest.RestClient.createVolume(RestClient.java:249)
at
org.apache.hadoop.ozone.client.rest.RestClient.createVolume(RestClient.java:207)
{noformat}
{noformat}
[ERROR] Errors:
[ERROR] TestOzoneRestClient.testAddBucketAcl:253 » JsonEOF Unexpected
end-of-input: ex...
[ERROR] TestOzoneRestClient.testCreateBucket:169 » JsonEOF Unexpected
end-of-input: ex...
[ERROR] TestOzoneRestClient.testCreateBucketWithAcls:215 » SocketTimeout Read
timed ou...
[ERROR] TestOzoneRestClient.testCreateBucketWithAllArgument:234 »
SocketTimeout Read t...
[ERROR] TestOzoneRestClient.testCreateBucketWithStorageType:196 » JsonEOF
Unexpected e...
[ERROR] TestOzoneRestClient.testCreateBucketWithVersioning:181 » JsonEOF
Unexpected en...
[ERROR] TestOzoneRestClient.testCreateVolume:87 » SocketTimeout Read timed out
[ERROR] TestOzoneRestClient.testCreateVolumeWithOwner:98 » SocketTimeout Read
timed ou...
[ERROR] TestOzoneRestClient.testCreateVolumeWithQuota:110 » JsonEOF
Unexpected end-of-...
[ERROR] TestOzoneRestClient.testGetKeyDetails:421 » JsonEOF Unexpected
end-of-input: e...
[ERROR] TestOzoneRestClient.testPutKey:342 » JsonEOF Unexpected end-of-input:
expected...
[ERROR] TestOzoneRestClient.testRemoveBucketAcl:276 » JsonEOF Unexpected
end-of-input:...
[ERROR] TestOzoneRestClient.testRenameKey:394 » JsonEOF Unexpected
end-of-input: expec...
[ERROR] TestOzoneRestClient.testSetBucketStorageType:308 » SocketTimeout Read
timed ou...
[ERROR] TestOzoneRestClient.testSetBucketVersioning:293 » SocketTimeout Read
timed out
[ERROR] TestOzoneRestClient.testSetVolumeOwner:135 » SocketTimeout Read timed
out
[ERROR] TestOzoneRestClient.testSetVolumeQuota:145 » JsonEOF Unexpected
end-of-input: ...
[ERROR] TestOzoneRestClient.testVolumeAlreadyE
