[ https://issues.apache.org/jira/browse/DRILL-2417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Chris Westin updated DRILL-2417: -------------------------------- Assignee: Sudheesh Katkam (was: Steven Phillips) > Exception seen when system parameter is set to `store.parquet.compression` = > 'snappy' > ------------------------------------------------------------------------------------- > > Key: DRILL-2417 > URL: https://issues.apache.org/jira/browse/DRILL-2417 > Project: Apache Drill > Issue Type: Bug > Components: Storage - Parquet > Affects Versions: 0.8.0 > Environment: Administrators-MacBook-Pro-11:log kfaraaz$ uname -a > Darwin Administrators-MacBook-Pro-11.local 14.0.0 Darwin Kernel Version > 14.0.0: Fri Sep 19 00:26:44 PDT 2014; root:xnu-2782.1.97~2/RELEASE_X86_64 > x86_64 > Reporter: Khurram Faraaz > Assignee: Sudheesh Katkam > Fix For: 0.9.0 > > > Attempt to, alter system set `store.parquet.compression` = 'snappy' > results in an Exception > Details of driblet version that I am working with are > 0: jdbc:drill:zk=local> select * from sys.version; > +------------+----------------+-------------+-------------+------------+ > | commit_id | commit_message | commit_time | build_email | build_time | > +------------+----------------+-------------+-------------+------------+ > | a84f7b9e88b1827e6b4da8cdd25c6d4f12dcdadc | DRILL-2338: Fix > Decimal38/Decimal28 vector's get() to copy the scale and precision into the > holder | 02.03.2015 @ 14:13:27 EST | Unknown | 02.03.2015 @ 15:43:47 EST | > +------------+----------------+-------------+-------------+------------+ > 1 row selected (0.334 seconds) > Failing alter system set statement > 0: jdbc:drill:zk=local> alter system set `store.parquet.compression`='snappy'; > +------------+------------+ > | ok | summary | > +------------+------------+ > | true | store.parquet.compression updated. | > Query failed: RemoteRpcException: Failure while running fragment., Failure > while closing accountor. Expected private and shared pools to be set to > initial values. However, one or more were not. Stats are > zone init allocated delta > private 1000000 738112 261888 > shared 9999000000 9999261888 -261888. [ > 669998c2-d44f-446d-85b1-bc19b0a33003 on 10.250.0.35:31010 ] > [ 669998c2-d44f-446d-85b1-bc19b0a33003 on 10.250.0.35:31010 ] > java.lang.RuntimeException: java.sql.SQLException: Failure while executing > query. > at sqlline.SqlLine$IncrementalRows.hasNext(SqlLine.java:2514) > at sqlline.SqlLine$TableOutputFormat.print(SqlLine.java:2148) > at sqlline.SqlLine.print(SqlLine.java:1809) > at sqlline.SqlLine$Commands.execute(SqlLine.java:3766) > at sqlline.SqlLine$Commands.sql(SqlLine.java:3663) > at sqlline.SqlLine.dispatch(SqlLine.java:889) > at sqlline.SqlLine.begin(SqlLine.java:763) > at sqlline.SqlLine.start(SqlLine.java:498) > at sqlline.SqlLine.main(SqlLine.java:460) > 0: jdbc:drill:zk=local> > From the log file > 2015-03-10 10:29:05,183 [2b00d61d-b6c2-e7a4-2baa-6bb5f23f6098:frag:0:0] ERROR > o.a.d.e.w.f.AbstractStatusReporter - Error > 669998c2-d44f-446d-85b1-bc19b0a33003: Failure while running fragment. > java.lang.IllegalStateException: Failure while closing accountor. Expected > private and shared pools to be set to initial values. However, one or more > were not. Stats are > zone init allocated delta > private 1000000 738112 261888 > shared 9999000000 9999261888 -261888. > at > org.apache.drill.exec.memory.AtomicRemainder.close(AtomicRemainder.java:200) > ~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT] > at org.apache.drill.exec.memory.Accountor.close(Accountor.java:376) > ~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT] > at > org.apache.drill.exec.memory.TopLevelAllocator$ChildAllocator.close(TopLevelAllocator.java:284) > ~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT] > at > org.apache.drill.exec.ops.OperatorContext.close(OperatorContext.java:118) > ~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT] > at > org.apache.drill.exec.physical.impl.ScanBatch.cleanup(ScanBatch.java:351) > ~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT] > at > org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.cleanup(IteratorValidatorBatchIterator.java:148) > ~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT] > at > org.apache.drill.exec.physical.impl.ScreenCreator$ScreenRoot.internalStop(ScreenCreator.java:178) > ~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT] > at > org.apache.drill.exec.physical.impl.ScreenCreator$ScreenRoot.innerNext(ScreenCreator.java:124) > ~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT] > at > org.apache.drill.exec.physical.impl.BaseRootExec.next(BaseRootExec.java:57) > ~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT] > at > org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:121) > ~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT] > at > org.apache.drill.exec.work.WorkManager$RunnableWrapper.run(WorkManager.java:303) > [drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT] > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > [na:1.7.0_75] > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > [na:1.7.0_75] > at java.lang.Thread.run(Thread.java:745) [na:1.7.0_75] > 2015-03-10 10:29:05,183 [2b00d61d-b6c2-e7a4-2baa-6bb5f23f6098:frag:0:0] INFO > o.a.drill.exec.work.foreman.Foreman - State change requested. RUNNING --> > FAILED > org.apache.drill.exec.rpc.RemoteRpcException: Failure while running > fragment., Failure while closing accountor. Expected private and shared > pools to be set to initial values. However, one or more were not. Stats are > zone init allocated delta > private 1000000 738112 261888 > shared 9999000000 9999261888 -261888. [ > 669998c2-d44f-446d-85b1-bc19b0a33003 on 10.250.0.35:31010 ] > [ 669998c2-d44f-446d-85b1-bc19b0a33003 on 10.250.0.35:31010 ] > at > org.apache.drill.exec.work.foreman.QueryManager.statusUpdate(QueryManager.java:95) > [drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT] > at > org.apache.drill.exec.work.foreman.QueryManager$RootStatusReporter.statusChange(QueryManager.java:154) > [drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT] > at > org.apache.drill.exec.work.fragment.AbstractStatusReporter.fail(AbstractStatusReporter.java:114) > [drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT] > at > org.apache.drill.exec.work.fragment.AbstractStatusReporter.fail(AbstractStatusReporter.java:110) > [drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT] > at > org.apache.drill.exec.work.fragment.FragmentExecutor.internalFail(FragmentExecutor.java:176) > [drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT] > at > org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:136) > [drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT] > at > org.apache.drill.exec.work.WorkManager$RunnableWrapper.run(WorkManager.java:303) > [drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT] > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > [na:1.7.0_75] > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > [na:1.7.0_75] > at java.lang.Thread.run(Thread.java:745) [na:1.7.0_75] > ... > 2015-03-10 10:29:05,191 [2b00d61d-b6c2-e7a4-2baa-6bb5f23f6098:frag:0:0] WARN > o.a.d.e.w.fragment.FragmentExecutor - Failure while closing out resources. > java.lang.IllegalStateException: Failure while trying to close child > allocator: Child level allocators not closed. Fragment 0:0. Stack trace: > > org.apache.drill.exec.ops.OperatorContext.<init>(OperatorContext.java:43) > > org.apache.drill.exec.physical.impl.ScanBatch.<init>(ScanBatch.java:112) > > org.apache.drill.exec.store.direct.DirectBatchCreator.getBatch(DirectBatchCreator.java:35) > > org.apache.drill.exec.store.direct.DirectBatchCreator.getBatch(DirectBatchCreator.java:29) > > org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:62) > > org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:39) > > org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitSubScan(AbstractPhysicalVisitor.java:125) > > org.apache.drill.exec.physical.base.AbstractSubScan.accept(AbstractSubScan.java:39) > > org.apache.drill.exec.physical.impl.ImplCreator.getChildren(ImplCreator.java:74) > > org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:62) > > org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:39) > > org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitIteratorValidator(AbstractPhysicalVisitor.java:208) > > org.apache.drill.exec.physical.config.IteratorValidator.accept(IteratorValidator.java:34) > > org.apache.drill.exec.physical.impl.ImplCreator.getChildren(ImplCreator.java:74) > > org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:59) > > org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:39) > > org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitStore(AbstractPhysicalVisitor.java:130) > > org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitScreen(AbstractPhysicalVisitor.java:188) > > org.apache.drill.exec.physical.config.Screen.accept(Screen.java:97) > > org.apache.drill.exec.physical.impl.ImplCreator.getExec(ImplCreator.java:87) > > org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:109) > > org.apache.drill.exec.work.WorkManager$RunnableWrapper.run(WorkManager.java:303) > > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > java.lang.Thread.run(Thread.java:745) > at > org.apache.drill.exec.memory.TopLevelAllocator$ChildAllocator.close(TopLevelAllocator.java:273) > ~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT] > at > org.apache.drill.exec.ops.FragmentContext.close(FragmentContext.java:317) > ~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT] > at > org.apache.drill.exec.work.fragment.FragmentExecutor.closeOutResources(FragmentExecutor.java:163) > [drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT] > at > org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:142) > [drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT] > at > org.apache.drill.exec.work.WorkManager$RunnableWrapper.run(WorkManager.java:303) > [drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT] > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > [na:1.7.0_75] > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > [na:1.7.0_75] > at java.lang.Thread.run(Thread.java:745) [na:1.7.0_75] -- This message was sent by Atlassian JIRA (v6.3.4#6332)