[
https://issues.apache.org/jira/browse/HADOOP-17018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17094399#comment-17094399
]
Steve Loughran edited comment on HADOOP-17018 at 4/29/20, 2:23 PM:
-------------------------------------------------------------------
Stack trace
{code}
----
2020-04-28 15:49:04,106 DEBUG [JUnit-testAbfsStreamOps]: services.AbfsClient
(AbfsRestOperation.java:execute(133)) - First execution of REST operation -
GetAcl2020-04-28 15:49:04,106 DEBUG [JUnit-testAbfsStreamOps]:
services.AbfsClient (AbfsRestOperation.java:execute(133)) - First execution of
REST operation - GetAcl2020-04-28 15:49:04,151 DEBUG [JUnit-testAbfsStreamOps]:
services.AbfsClient (AbfsRestOperation.java:executeHttpOperation(175)) -
Signing request with shared key2020-04-28 15:49:08,430 DEBUG
[JUnit-testAbfsStreamOps]: services.AbfsClient
(AbfsRestOperation.java:executeHttpOperation(223)) - HttpRequest:
404,,cid=1a653b2f-8796-4c5d-ab72-f04bb1296d08,rid=8026b894-a01f-005a-6846-1d2ad8000000,sent=0,recv=0,HEAD,https://mehakmeetdata.dfs.core.windows.net/abfs-testcontainer-ce1153dd-6c16-402b-91c8-099051333a12//?upn=false&action=getAccessControl&timeout=902020-04-28
15:49:08,446 DEBUG [JUnit-testAbfsStreamOps]: services.AbfsClient
(AbfsRestOperation.java:execute(133)) - First execution of REST operation -
CreateFileSystem2020-04-28 15:49:08,446 DEBUG [JUnit-testAbfsStreamOps]:
services.AbfsClient (AbfsRestOperation.java:executeHttpOperation(175)) -
Signing request with shared key2020-04-28 15:49:08,752 DEBUG
[JUnit-testAbfsStreamOps]: services.AbfsClient
(AbfsRestOperation.java:executeHttpOperation(223)) - HttpRequest:
201,,cid=494b1081-ddfc-4f7f-8b58-ff93ef1e1813,rid=8026b896-a01f-005a-6a46-1d2ad8000000,sent=0,recv=0,PUT,https://mehakmeetdata.dfs.core.windows.net/abfs-testcontainer-ce1153dd-6c16-402b-91c8-099051333a12?resource=filesystem2020-04-28
15:49:08,774 DEBUG [JUnit-testAbfsStreamOps]: services.AbfsClient
(AbfsRestOperation.java:execute(133)) - First execution of REST operation -
GetAcl2020-04-28 15:49:08,775 DEBUG [JUnit-testAbfsStreamOps]:
services.AbfsClient (AbfsRestOperation.java:executeHttpOperation(175)) -
Signing request with shared key2020-04-28 15:49:09,019 DEBUG
[JUnit-testAbfsStreamOps]: services.AbfsClient
(AbfsRestOperation.java:executeHttpOperation(223)) - HttpRequest:
200,,cid=8b51c94e-53d6-4bf9-95ae-a220452926d3,rid=8026b8a9-a01f-005a-7d46-1d2ad8000000,sent=0,recv=0,HEAD,https://mehakmeetdata.dfs.core.windows.net/abfs-testcontainer-ce1153dd-6c16-402b-91c8-099051333a12//?upn=false&action=getAccessControl&timeout=902020-04-28
15:49:09,020 INFO [JUnit-testAbfsStreamOps]:
azurebfs.AbstractAbfsTestWithTimeout
(AbstractAbfsTestWithTimeout.java:describe(88)) -
testAbfsStreamOps: Test to see correct population of read and write operations
in Abfs
2020-04-28 15:49:09,035 DEBUG [JUnit-testAbfsStreamOps]: services.AbfsClient
(AbfsRestOperation.java:execute(133)) - First execution of REST operation -
CreatePath2020-04-28 15:49:09,035 DEBUG [JUnit-testAbfsStreamOps]:
services.AbfsClient (AbfsRestOperation.java:executeHttpOperation(175)) -
Signing request with shared key2020-04-28 15:49:09,300 DEBUG
[JUnit-testAbfsStreamOps]: services.AbfsClient
(AbfsRestOperation.java:executeHttpOperation(223)) - HttpRequest:
201,,cid=eb705c96-722d-4775-9100-161c64f11145,rid=8026b8be-a01f-005a-1246-1d2ad8000000,sent=0,recv=0,PUT,https://mehakmeetdata.dfs.core.windows.net/abfs-testcontainer-ce1153dd-6c16-402b-91c8-099051333a12/user/mehakmeet.singh/testOneReadWriteOps?resource=file&timeout=902020-04-28
15:49:09,319 DEBUG [pool-2-thread-1]: services.AbfsClient
(AbfsRestOperation.java:execute(133)) - First execution of REST operation -
Append2020-04-28 15:49:09,319 DEBUG [pool-2-thread-1]: services.AbfsClient
(AbfsRestOperation.java:executeHttpOperation(175)) - Signing request with
shared key2020-04-28 15:49:09,565 DEBUG [pool-2-thread-1]: services.AbfsClient
(AbfsRestOperation.java:executeHttpOperation(223)) - HttpRequest:
202,,cid=b7680b95-e3d0-42dd-9a2f-2fe33652d4ba,rid=8026b8c8-a01f-005a-1c46-1d2ad8000000,sent=9,recv=0,PUT,https://mehakmeetdata.dfs.core.windows.net/abfs-testcontainer-ce1153dd-6c16-402b-91c8-099051333a12/user/mehakmeet.singh/testOneReadWriteOps?action=append&position=0&timeout=902020-04-28
15:49:09,571 DEBUG [JUnit-testAbfsStreamOps]: services.AbfsClient
(AbfsRestOperation.java:execute(133)) - First execution of REST operation -
Flush2020-04-28 15:49:09,571 DEBUG [JUnit-testAbfsStreamOps]:
services.AbfsClient (AbfsRestOperation.java:executeHttpOperation(175)) -
Signing request with shared key2020-04-28 15:49:09,825 DEBUG
[JUnit-testAbfsStreamOps]: services.AbfsClient
(AbfsRestOperation.java:executeHttpOperation(223)) - HttpRequest:
200,,cid=e8dad7d3-4f4a-4b87-90a4-81ced45fa71b,rid=8026b8d9-a01f-005a-2c46-1d2ad8000000,sent=0,recv=0,PUT,https://mehakmeetdata.dfs.core.windows.net/abfs-testcontainer-ce1153dd-6c16-402b-91c8-099051333a12/user/mehakmeet.singh/testOneReadWriteOps?action=flush&retainUncommittedData=false&position=9&close=false&timeout=902020-04-28
15:49:09,826 DEBUG [JUnit-testAbfsStreamOps]: services.AbfsClient
(AbfsRestOperation.java:execute(133)) - First execution of REST operation -
GetPathStatus2020-04-28 15:49:09,827 DEBUG [JUnit-testAbfsStreamOps]:
services.AbfsClient (AbfsRestOperation.java:executeHttpOperation(175)) -
Signing request with shared key2020-04-28 15:49:10,573 DEBUG
[JUnit-testAbfsStreamOps]: services.AbfsClient
(AbfsRestOperation.java:executeHttpOperation(223)) - HttpRequest:
200,,cid=f0b7fda3-ae2a-4a74-811c-4d7647f773a6,rid=8026b8e9-a01f-005a-3c46-1d2ad8000000,sent=0,recv=0,HEAD,https://mehakmeetdata.dfs.core.windows.net/abfs-testcontainer-ce1153dd-6c16-402b-91c8-099051333a12/user/mehakmeet.singh/testOneReadWriteOps?upn=false&timeout=902020-04-28
15:49:10,644 DEBUG [ABFS-prefetch-4]: services.AbfsClient
(AbfsRestOperation.java:execute(133)) - First execution of REST operation -
ReadFile2020-04-28 15:49:10,646 DEBUG [ABFS-prefetch-4]: services.AbfsClient
(AbfsRestOperation.java:executeHttpOperation(175)) - Signing request with
shared key2020-04-28 15:49:11,389 DEBUG [ABFS-prefetch-4]: services.AbfsClient
(AbfsRestOperation.java:executeHttpOperation(223)) - HttpRequest:
206,,cid=fe0d1b0b-3f46-41fd-8611-5f8fa7c75564,rid=8026b8f0-a01f-005a-4346-1d2ad8000000,sent=0,recv=9,GET,https://mehakmeetdata.dfs.core.windows.net/abfs-testcontainer-ce1153dd-6c16-402b-91c8-099051333a12/user/mehakmeet.singh/testOneReadWriteOps?timeout=902020-04-28
15:49:11,389 INFO [JUnit-testAbfsStreamOps]:
azurebfs.ITestAbfsStreamStatistics
(ITestAbfsStreamStatistics.java:testAbfsStreamOps(85)) - Result of Read
operation : 92020-04-28 15:49:11,389 DEBUG [JUnit-testAbfsStreamOps]:
services.AbfsClient (AbfsRestOperation.java:execute(133)) - First execution of
REST operation - Flush2020-04-28 15:49:11,390 DEBUG [JUnit-testAbfsStreamOps]:
services.AbfsClient (AbfsRestOperation.java:executeHttpOperation(175)) -
Signing request with shared key2020-04-28 15:49:12,132 DEBUG
[JUnit-testAbfsStreamOps]: services.AbfsClient
(AbfsRestOperation.java:executeHttpOperation(223)) - HttpRequest:
200,,cid=cb07f1b1-6067-4547-8fce-e5b18d8c8ef7,rid=8026b8fc-a01f-005a-4f46-1d2ad8000000,sent=0,recv=0,PUT,https://mehakmeetdata.dfs.core.windows.net/abfs-testcontainer-ce1153dd-6c16-402b-91c8-099051333a12/user/mehakmeet.singh/testOneReadWriteOps?action=flush&retainUncommittedData=false&position=9&close=true&timeout=902020-04-28
15:49:12,134 DEBUG [JUnit-testAbfsStreamOps]: services.AbfsClient
(AbfsRestOperation.java:execute(133)) - First execution of REST operation -
DeleteFileSystem2020-04-28 15:49:12,134 DEBUG [JUnit-testAbfsStreamOps]:
services.AbfsClient (AbfsRestOperation.java:executeHttpOperation(175)) -
Signing request with shared key2020-04-28 15:49:13,179 DEBUG
[JUnit-testAbfsStreamOps]: services.AbfsClient
(AbfsRestOperation.java:executeHttpOperation(223)) - HttpRequest:
202,,cid=f8fb143a-f007-4d1e-9fe1-b74ed981bbb8,rid=8026b948-a01f-005a-1b46-1d2ad8000000,sent=0,recv=0,DELETE,https://mehakmeetdata.dfs.core.windows.net/abfs-testcontainer-ce1153dd-6c16-402b-91c8-099051333a12?resource=filesystem&timeout=902020-04-28
15:49:13,196 DEBUG [JUnit-testAbfsStreamOps]: services.AbfsClient
(AbfsRestOperation.java:execute(133)) - First execution of REST operation -
GetFileSystemProperties2020-04-28 15:49:13,197 DEBUG [JUnit-testAbfsStreamOps]:
services.AbfsClient (AbfsRestOperation.java:executeHttpOperation(175)) -
Signing request with shared key2020-04-28 15:49:13,439 DEBUG
[JUnit-testAbfsStreamOps]: services.AbfsClient
(AbfsRestOperation.java:executeHttpOperation(223)) - *HttpRequest:
404,,cid=0b9689d7-970f-4817-b153-54d906ee5d64,rid=8026b95c-a01f-005a-2f46-1d2ad8000000,sent=0,recv=0,HEAD,https://mehakmeetdata.dfs.core.windows.net/abfs-testcontainer-ce1153dd-6c16-402b-91c8-099051333a12?resource=filesystem&timeout=90*
*java.lang.AssertionError: Mismatch in read operations Expected :2Actual :3
<Click to see difference>*
at org.junit.Assert.fail(Assert.java:88) at
org.junit.Assert.failNotEquals(Assert.java:834) at
org.junit.Assert.assertEquals(Assert.java:645) at
org.apache.hadoop.fs.azurebfs.ITestAbfsStreamStatistics.assertReadWriteOps(ITestAbfsStreamStatistics.java:154)
at
org.apache.hadoop.fs.azurebfs.ITestAbfsStreamStatistics.testAbfsStreamOps(ITestAbfsStreamStatistics.java:92)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498) at
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
at
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
at
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at
org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at
org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298)
at
org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292)
at java.util.concurrent.FutureTask.run(FutureTask.java:266) at
java.lang.Thread.run(Thread.java:748)
----
{code}
Http 404 error before the assertion error seems to be the reason for the
failure.
was (Author: mehakmeetsingh):
Stack trace
----
2020-04-28 15:49:04,106 DEBUG [JUnit-testAbfsStreamOps]: services.AbfsClient
(AbfsRestOperation.java:execute(133)) - First execution of REST operation -
GetAcl2020-04-28 15:49:04,106 DEBUG [JUnit-testAbfsStreamOps]:
services.AbfsClient (AbfsRestOperation.java:execute(133)) - First execution of
REST operation - GetAcl2020-04-28 15:49:04,151 DEBUG [JUnit-testAbfsStreamOps]:
services.AbfsClient (AbfsRestOperation.java:executeHttpOperation(175)) -
Signing request with shared key2020-04-28 15:49:08,430 DEBUG
[JUnit-testAbfsStreamOps]: services.AbfsClient
(AbfsRestOperation.java:executeHttpOperation(223)) - HttpRequest:
404,,cid=1a653b2f-8796-4c5d-ab72-f04bb1296d08,rid=8026b894-a01f-005a-6846-1d2ad8000000,sent=0,recv=0,HEAD,https://mehakmeetdata.dfs.core.windows.net/abfs-testcontainer-ce1153dd-6c16-402b-91c8-099051333a12//?upn=false&action=getAccessControl&timeout=902020-04-28
15:49:08,446 DEBUG [JUnit-testAbfsStreamOps]: services.AbfsClient
(AbfsRestOperation.java:execute(133)) - First execution of REST operation -
CreateFileSystem2020-04-28 15:49:08,446 DEBUG [JUnit-testAbfsStreamOps]:
services.AbfsClient (AbfsRestOperation.java:executeHttpOperation(175)) -
Signing request with shared key2020-04-28 15:49:08,752 DEBUG
[JUnit-testAbfsStreamOps]: services.AbfsClient
(AbfsRestOperation.java:executeHttpOperation(223)) - HttpRequest:
201,,cid=494b1081-ddfc-4f7f-8b58-ff93ef1e1813,rid=8026b896-a01f-005a-6a46-1d2ad8000000,sent=0,recv=0,PUT,https://mehakmeetdata.dfs.core.windows.net/abfs-testcontainer-ce1153dd-6c16-402b-91c8-099051333a12?resource=filesystem2020-04-28
15:49:08,774 DEBUG [JUnit-testAbfsStreamOps]: services.AbfsClient
(AbfsRestOperation.java:execute(133)) - First execution of REST operation -
GetAcl2020-04-28 15:49:08,775 DEBUG [JUnit-testAbfsStreamOps]:
services.AbfsClient (AbfsRestOperation.java:executeHttpOperation(175)) -
Signing request with shared key2020-04-28 15:49:09,019 DEBUG
[JUnit-testAbfsStreamOps]: services.AbfsClient
(AbfsRestOperation.java:executeHttpOperation(223)) - HttpRequest:
200,,cid=8b51c94e-53d6-4bf9-95ae-a220452926d3,rid=8026b8a9-a01f-005a-7d46-1d2ad8000000,sent=0,recv=0,HEAD,https://mehakmeetdata.dfs.core.windows.net/abfs-testcontainer-ce1153dd-6c16-402b-91c8-099051333a12//?upn=false&action=getAccessControl&timeout=902020-04-28
15:49:09,020 INFO [JUnit-testAbfsStreamOps]:
azurebfs.AbstractAbfsTestWithTimeout
(AbstractAbfsTestWithTimeout.java:describe(88)) -
testAbfsStreamOps: Test to see correct population of read and write operations
in Abfs
2020-04-28 15:49:09,035 DEBUG [JUnit-testAbfsStreamOps]: services.AbfsClient
(AbfsRestOperation.java:execute(133)) - First execution of REST operation -
CreatePath2020-04-28 15:49:09,035 DEBUG [JUnit-testAbfsStreamOps]:
services.AbfsClient (AbfsRestOperation.java:executeHttpOperation(175)) -
Signing request with shared key2020-04-28 15:49:09,300 DEBUG
[JUnit-testAbfsStreamOps]: services.AbfsClient
(AbfsRestOperation.java:executeHttpOperation(223)) - HttpRequest:
201,,cid=eb705c96-722d-4775-9100-161c64f11145,rid=8026b8be-a01f-005a-1246-1d2ad8000000,sent=0,recv=0,PUT,https://mehakmeetdata.dfs.core.windows.net/abfs-testcontainer-ce1153dd-6c16-402b-91c8-099051333a12/user/mehakmeet.singh/testOneReadWriteOps?resource=file&timeout=902020-04-28
15:49:09,319 DEBUG [pool-2-thread-1]: services.AbfsClient
(AbfsRestOperation.java:execute(133)) - First execution of REST operation -
Append2020-04-28 15:49:09,319 DEBUG [pool-2-thread-1]: services.AbfsClient
(AbfsRestOperation.java:executeHttpOperation(175)) - Signing request with
shared key2020-04-28 15:49:09,565 DEBUG [pool-2-thread-1]: services.AbfsClient
(AbfsRestOperation.java:executeHttpOperation(223)) - HttpRequest:
202,,cid=b7680b95-e3d0-42dd-9a2f-2fe33652d4ba,rid=8026b8c8-a01f-005a-1c46-1d2ad8000000,sent=9,recv=0,PUT,https://mehakmeetdata.dfs.core.windows.net/abfs-testcontainer-ce1153dd-6c16-402b-91c8-099051333a12/user/mehakmeet.singh/testOneReadWriteOps?action=append&position=0&timeout=902020-04-28
15:49:09,571 DEBUG [JUnit-testAbfsStreamOps]: services.AbfsClient
(AbfsRestOperation.java:execute(133)) - First execution of REST operation -
Flush2020-04-28 15:49:09,571 DEBUG [JUnit-testAbfsStreamOps]:
services.AbfsClient (AbfsRestOperation.java:executeHttpOperation(175)) -
Signing request with shared key2020-04-28 15:49:09,825 DEBUG
[JUnit-testAbfsStreamOps]: services.AbfsClient
(AbfsRestOperation.java:executeHttpOperation(223)) - HttpRequest:
200,,cid=e8dad7d3-4f4a-4b87-90a4-81ced45fa71b,rid=8026b8d9-a01f-005a-2c46-1d2ad8000000,sent=0,recv=0,PUT,https://mehakmeetdata.dfs.core.windows.net/abfs-testcontainer-ce1153dd-6c16-402b-91c8-099051333a12/user/mehakmeet.singh/testOneReadWriteOps?action=flush&retainUncommittedData=false&position=9&close=false&timeout=902020-04-28
15:49:09,826 DEBUG [JUnit-testAbfsStreamOps]: services.AbfsClient
(AbfsRestOperation.java:execute(133)) - First execution of REST operation -
GetPathStatus2020-04-28 15:49:09,827 DEBUG [JUnit-testAbfsStreamOps]:
services.AbfsClient (AbfsRestOperation.java:executeHttpOperation(175)) -
Signing request with shared key2020-04-28 15:49:10,573 DEBUG
[JUnit-testAbfsStreamOps]: services.AbfsClient
(AbfsRestOperation.java:executeHttpOperation(223)) - HttpRequest:
200,,cid=f0b7fda3-ae2a-4a74-811c-4d7647f773a6,rid=8026b8e9-a01f-005a-3c46-1d2ad8000000,sent=0,recv=0,HEAD,https://mehakmeetdata.dfs.core.windows.net/abfs-testcontainer-ce1153dd-6c16-402b-91c8-099051333a12/user/mehakmeet.singh/testOneReadWriteOps?upn=false&timeout=902020-04-28
15:49:10,644 DEBUG [ABFS-prefetch-4]: services.AbfsClient
(AbfsRestOperation.java:execute(133)) - First execution of REST operation -
ReadFile2020-04-28 15:49:10,646 DEBUG [ABFS-prefetch-4]: services.AbfsClient
(AbfsRestOperation.java:executeHttpOperation(175)) - Signing request with
shared key2020-04-28 15:49:11,389 DEBUG [ABFS-prefetch-4]: services.AbfsClient
(AbfsRestOperation.java:executeHttpOperation(223)) - HttpRequest:
206,,cid=fe0d1b0b-3f46-41fd-8611-5f8fa7c75564,rid=8026b8f0-a01f-005a-4346-1d2ad8000000,sent=0,recv=9,GET,https://mehakmeetdata.dfs.core.windows.net/abfs-testcontainer-ce1153dd-6c16-402b-91c8-099051333a12/user/mehakmeet.singh/testOneReadWriteOps?timeout=902020-04-28
15:49:11,389 INFO [JUnit-testAbfsStreamOps]:
azurebfs.ITestAbfsStreamStatistics
(ITestAbfsStreamStatistics.java:testAbfsStreamOps(85)) - Result of Read
operation : 92020-04-28 15:49:11,389 DEBUG [JUnit-testAbfsStreamOps]:
services.AbfsClient (AbfsRestOperation.java:execute(133)) - First execution of
REST operation - Flush2020-04-28 15:49:11,390 DEBUG [JUnit-testAbfsStreamOps]:
services.AbfsClient (AbfsRestOperation.java:executeHttpOperation(175)) -
Signing request with shared key2020-04-28 15:49:12,132 DEBUG
[JUnit-testAbfsStreamOps]: services.AbfsClient
(AbfsRestOperation.java:executeHttpOperation(223)) - HttpRequest:
200,,cid=cb07f1b1-6067-4547-8fce-e5b18d8c8ef7,rid=8026b8fc-a01f-005a-4f46-1d2ad8000000,sent=0,recv=0,PUT,https://mehakmeetdata.dfs.core.windows.net/abfs-testcontainer-ce1153dd-6c16-402b-91c8-099051333a12/user/mehakmeet.singh/testOneReadWriteOps?action=flush&retainUncommittedData=false&position=9&close=true&timeout=902020-04-28
15:49:12,134 DEBUG [JUnit-testAbfsStreamOps]: services.AbfsClient
(AbfsRestOperation.java:execute(133)) - First execution of REST operation -
DeleteFileSystem2020-04-28 15:49:12,134 DEBUG [JUnit-testAbfsStreamOps]:
services.AbfsClient (AbfsRestOperation.java:executeHttpOperation(175)) -
Signing request with shared key2020-04-28 15:49:13,179 DEBUG
[JUnit-testAbfsStreamOps]: services.AbfsClient
(AbfsRestOperation.java:executeHttpOperation(223)) - HttpRequest:
202,,cid=f8fb143a-f007-4d1e-9fe1-b74ed981bbb8,rid=8026b948-a01f-005a-1b46-1d2ad8000000,sent=0,recv=0,DELETE,https://mehakmeetdata.dfs.core.windows.net/abfs-testcontainer-ce1153dd-6c16-402b-91c8-099051333a12?resource=filesystem&timeout=902020-04-28
15:49:13,196 DEBUG [JUnit-testAbfsStreamOps]: services.AbfsClient
(AbfsRestOperation.java:execute(133)) - First execution of REST operation -
GetFileSystemProperties2020-04-28 15:49:13,197 DEBUG [JUnit-testAbfsStreamOps]:
services.AbfsClient (AbfsRestOperation.java:executeHttpOperation(175)) -
Signing request with shared key2020-04-28 15:49:13,439 DEBUG
[JUnit-testAbfsStreamOps]: services.AbfsClient
(AbfsRestOperation.java:executeHttpOperation(223)) - *HttpRequest:
404,,cid=0b9689d7-970f-4817-b153-54d906ee5d64,rid=8026b95c-a01f-005a-2f46-1d2ad8000000,sent=0,recv=0,HEAD,https://mehakmeetdata.dfs.core.windows.net/abfs-testcontainer-ce1153dd-6c16-402b-91c8-099051333a12?resource=filesystem&timeout=90*
*java.lang.AssertionError: Mismatch in read operations Expected :2Actual :3
<Click to see difference>*
at org.junit.Assert.fail(Assert.java:88) at
org.junit.Assert.failNotEquals(Assert.java:834) at
org.junit.Assert.assertEquals(Assert.java:645) at
org.apache.hadoop.fs.azurebfs.ITestAbfsStreamStatistics.assertReadWriteOps(ITestAbfsStreamStatistics.java:154)
at
org.apache.hadoop.fs.azurebfs.ITestAbfsStreamStatistics.testAbfsStreamOps(ITestAbfsStreamStatistics.java:92)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498) at
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
at
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
at
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at
org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at
org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298)
at
org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292)
at java.util.concurrent.FutureTask.run(FutureTask.java:266) at
java.lang.Thread.run(Thread.java:748)
----
Http 404 error before the assertion error seems to be the reason for the
failure.
> Intermittent failing of ITestAbfsStreamStatistics in ABFS
> ---------------------------------------------------------
>
> Key: HADOOP-17018
> URL: https://issues.apache.org/jira/browse/HADOOP-17018
> Project: Hadoop Common
> Issue Type: Bug
> Components: fs/azure
> Affects Versions: 3.2.1
> Reporter: Mehakmeet Singh
> Assignee: Mehakmeet Singh
> Priority: Major
>
> There are intermittent failures of a test inside ITestAbfsStreamStatistics in
> ABFS.
> Did consecutive runs of the test and failure seemed random. Stack Trace in
> the comments.
> Propose:
> - Change the assertion of the test for it to be passed, Since the production
> code seems fine.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
