Paul Rogers created DRILL-5074: ---------------------------------- Summary: Excessive logging for permission denied error in CTAS Key: DRILL-5074 URL: https://issues.apache.org/jira/browse/DRILL-5074 Project: Apache Drill Issue Type: Bug Affects Versions: 1.8.0 Reporter: Paul Rogers Priority: Minor
Consider the test TestImpersonationMetadata.testCreateTableInWSWithNoPermissionsForQueryUser. This test attempts to do a CTAS in a workspace without proper permissions. A perfectly fine test for perfectly normal scenario. However, the test displays the following very long log message for what is, in essence, a very simple condition. Expected that Drill would expect permission problems, would log a single message ("User fred attempted to access Table foo without proper permissions"), and omit the gory details of the stack trace. Since this is a normal operating problem, and not a code fault, the stack trace simply clutters the log (and test output.) Note: the test is being modified to suppress the logging. If you attempt to reproduce the problem using the test after that modification, comment out the call to {{disableWriterLogging()}}. {code} 22:01:29.890 [27c58945-c8c1-5c3d-6ebc-9926c33ced48:frag:0:0] ERROR o.a.d.e.p.impl.WriterRecordBatch - Failure during query org.apache.hadoop.security.AccessControlException: Permission denied: user=drillTestUser2, access=WRITE, inode="/drillTestGrp0_755/table1/0_0_0.parquet":fred:drillTestGrp0:drwxr-xr-x at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:320) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:292) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:213) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:190) ... at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [na:1.8.0_102] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [na:1.8.0_102] at java.lang.Thread.run(Thread.java:745) [na:1.8.0_102] Caused by: org.apache.hadoop.ipc.RemoteException: Permission denied: user=drillTestUser2, access=WRITE, inode="/drillTestGrp0_755/table1/0_0_0.parquet":fred:drillTestGrp0:drwxr-xr-x at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:320) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:292) ... at com.sun.proxy.$Proxy67.create(Unknown Source) ~[na:na] at org.apache.hadoop.hdfs.DFSOutputStream.newStreamForCreate(DFSOutputStream.java:1623) ~[hadoop-hdfs-2.7.1.jar:na] ... 35 common frames omitted 22:01:29.987 [27c58945-c8c1-5c3d-6ebc-9926c33ced48:frag:0:0] ERROR o.a.d.e.w.fragment.FragmentExecutor - SYSTEM ERROR: RemoteException: Permission denied: user=drillTestUser2, access=WRITE, inode="/drillTestGrp0_755/table1/0_0_0.parquet":fred:drillTestGrp0:drwxr-xr-x at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:320) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:292) ... at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2045) Fragment 0:0 [Error Id: fff615a2-006d-4a33-a87c-f0d1c25d246f on 172.30.1.66:31013] org.apache.drill.common.exceptions.UserException: SYSTEM ERROR: RemoteException: Permission denied: user=drillTestUser2, access=WRITE, inode="/drillTestGrp0_755/table1/0_0_0.parquet":fred:drillTestGrp0:drwxr-xr-x at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:320) ... at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2045) Fragment 0:0 [Error Id: fff615a2-006d-4a33-a87c-f0d1c25d246f on 172.30.1.66:31013] at org.apache.drill.common.exceptions.UserException$Builder.build(UserException.java:543) ~[drill-common-1.9.0-SNAPSHOT.jar:1.9.0-SNAPSHOT] ... at java.lang.Thread.run(Thread.java:745) [na:1.8.0_102] Caused by: org.apache.hadoop.security.AccessControlException: Permission denied: user=drillTestUser2, access=WRITE, inode="/drillTestGrp0_755/table1/0_0_0.parquet":fred:drillTestGrp0:drwxr-xr-x at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:320) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:292) ... at org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:226) [classes/:na] ... 4 common frames omitted Caused by: org.apache.hadoop.ipc.RemoteException: Permission denied: user=drillTestUser2, access=WRITE, inode="/drillTestGrp0_755/table1/0_0_0.parquet":fred:drillTestGrp0:drwxr-xr-x at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:320) ... {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)