mustafaiman commented on issue #1815: HADOOP-16801: S3Guard-listFiles will not query s3 if all listings are… URL: https://github.com/apache/hadoop/pull/1815#issuecomment-578995276 Re-ran the tests after rebase. Against s3 us-west-1. Options: "-Dscale -Ds3guard -Dauth -Ddynamo". Only one test fails. I checked the trunk branch. The same test fails consistently on trunk branch too. So not related to my changes: ``` 14:41:46 [ERROR] test_120_terasort[directory](org.apache.hadoop.fs.s3a.commit.terasort.ITestTerasortOnS3A) Time elapsed: 5.802 s <<< FAILURE! 14:41:46 java.lang.AssertionError: terasort(s3a://cloudera-dev-7hd9am/terasort-directory/sortin, s3a://cloudera-dev-7hd9am/terasort-directory/sortout) failed expected:<0> but was:<1> 14:41:46 at org.junit.Assert.fail(Assert.java:88) 14:41:46 at org.junit.Assert.failNotEquals(Assert.java:834) 14:41:46 at org.junit.Assert.assertEquals(Assert.java:645) 14:41:46 at org.apache.hadoop.fs.s3a.commit.terasort.ITestTerasortOnS3A.executeStage(ITestTerasortOnS3A.java:241) 14:41:46 at org.apache.hadoop.fs.s3a.commit.terasort.ITestTerasortOnS3A.test_120_terasort(ITestTerasortOnS3A.java:291) 14:41:46 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 14:41:46 at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) 14:41:46 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 14:41:46 at java.lang.reflect.Method.invoke(Method.java:498) 14:41:46 at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) 14:41:46 at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) 14:41:46 at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) 14:41:46 at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) 14:41:46 at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) 14:41:46 at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) 14:41:46 at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) 14:41:46 at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) 14:41:46 at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) 14:41:46 at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) 14:41:46 at java.util.concurrent.FutureTask.run(FutureTask.java:266) 14:41:46 at java.lang.Thread.run(Thread.java:748) 14:41:46 14:41:46 [ERROR] test_120_terasort[magic](org.apache.hadoop.fs.s3a.commit.terasort.ITestTerasortOnS3A) Time elapsed: 6.705 s <<< FAILURE! 14:41:46 java.lang.AssertionError: terasort(s3a://cloudera-dev-7hd9am/terasort-magic/sortin, s3a://cloudera-dev-7hd9am/terasort-magic/sortout) failed expected:<0> but was:<1> 14:41:46 at org.junit.Assert.fail(Assert.java:88) 14:41:46 at org.junit.Assert.failNotEquals(Assert.java:834) 14:41:46 at org.junit.Assert.assertEquals(Assert.java:645) 14:41:46 at org.apache.hadoop.fs.s3a.commit.terasort.ITestTerasortOnS3A.executeStage(ITestTerasortOnS3A.java:241) 14:41:46 at org.apache.hadoop.fs.s3a.commit.terasort.ITestTerasortOnS3A.test_120_terasort(ITestTerasortOnS3A.java:291) 14:41:46 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 14:41:46 at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) 14:41:46 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 14:41:46 at java.lang.reflect.Method.invoke(Method.java:498) 14:41:46 at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) 14:41:46 at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) 14:41:46 at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) 14:41:46 at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) 14:41:46 at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) 14:41:46 at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) 14:41:46 at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) 14:41:46 at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) 14:41:46 at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) 14:41:46 at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) 14:41:46 at java.util.concurrent.FutureTask.run(FutureTask.java:266) 14:41:46 at java.lang.Thread.run(Thread.java:748) ```
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
