The assertion at the bottom of the stack indicates that the row count for the HBase table was found as negative. One of the info messages indicates 'TableStatsCalculator - Region size calculation disabled.' What is the value of your exec.hbase.scan.sizecalculator.enabled setting in sys.options ?
Even with this disabled, I would think you should not see the assertion, so you are probably hitting a bug....perhaps Aditya will have input on this. On Mon, Dec 15, 2014 at 2:48 PM, Jinfeng Ni <[email protected]> wrote: > > The log shows this is query planner error, when it tries to apply the > optimizer rule : DrillPushProjIntoScan. > > java.lang.AssertionError: Internal error: Error while applying rule > DrillPushProjIntoScan, args > [rel#13473:ProjectRel.NONE.ANY([]).[](child=rel#13472: > Subset#0.ENUMERABLE.ANY([]).[],row_key=$0,dependent_vars=$1, > independent_vars=$2), > rel#13464:EnumerableTableAccessRel.ENUMERABLE.ANY([]).[](table=[maprdb, > excel])] > > On Mon, Dec 15, 2014 at 2:29 PM, Sungwook Yoon <[email protected]> wrote: > > > > Hi, > > > > Do you have some comment on this yet? > > > > Thanks, > > > > Sungwook > > > > > > On Sun, Dec 14, 2014 at 8:34 PM, Sungwook Yoon <[email protected]> > wrote: > > > > > > > > Hi, > > > > > > Sorry for delayed response, was traveling. > > > Can you take a look at the log? > > > > > > Thanks, > > > > > > Sungwook > > > > > > > > > 2014-12-12 19:02:24,849 [5ac94869-8e24-4f26-8fd0-b9df6f96b7a1:frag:0:0] > > > WARN o.a.d.exec.work.foreman.QueryStatus - Update finished query > state : > > > COMPLETED > > > 2014-12-12 19:02:24,906 [UserServer-1] WARN > > > o.a.d.exec.work.foreman.QueryStatus - Update running or pending query > > > state : PENDING > > > 2014-12-12 19:02:24,974 [1a48def7-07e1-4250-b42f-4f3f8012fba6:foreman] > > > INFO o.a.d.e.s.hbase.TableStatsCalculator - Region size calculation > > > disabled. > > > 2014-12-12 19:02:24,984 [1a48def7-07e1-4250-b42f-4f3f8012fba6:foreman] > > > ERROR o.a.drill.exec.work.foreman.Foreman - Error > > > 1c924dfc-8d60-470e-b328-641997f76a4f: Failure while setting up Foreman. > > > java.lang.AssertionError: Internal error: Error while applying rule > > > DrillPushProjIntoScan, args > > > > > > [rel#13473:ProjectRel.NONE.ANY([]).[](child=rel#13472:Subset#0.ENUMERABLE.ANY([]).[],row_key=$0,dependent_vars=$1,independent_vars=$2), > > > rel#13464:EnumerableTableAccessRel.ENUMERABLE.ANY([]).[](table=[maprdb, > > > excel])] > > > at org.eigenbase.util.Util.newInternal(Util.java:750) > > > ~[optiq-core-0.9-drill-r8.jar:na] > > > at > > > > > > org.eigenbase.relopt.volcano.VolcanoRuleCall.onMatch(VolcanoRuleCall.java:246) > > > ~[optiq-core-0.9-drill-r8.jar:na] > > > at > > > > > > org.eigenbase.relopt.volcano.VolcanoPlanner.findBestExp(VolcanoPlanner.java:661) > > > ~[optiq-core-0.9-drill-r8.jar:na] > > > at > > > > net.hydromatic.optiq.tools.Programs$RuleSetProgram.run(Programs.java:165) > > > ~[optiq-core-0.9-drill-r8.jar:na] > > > at > > > > net.hydromatic.optiq.prepare.PlannerImpl.transform(PlannerImpl.java:273) > > > ~[optiq-core-0.9-drill-r8.jar:na] > > > at > > > > > > org.apache.drill.exec.planner.sql.handlers.DefaultSqlHandler.convertToDrel(DefaultSqlHandler.java:155) > > > > > > ~[drill-java-exec-0.6.0.r2-incubating-SNAPSHOT-rebuffed.jar:0.6.0.r2-incubating-SNAPSHOT] > > > at > > > > > > org.apache.drill.exec.planner.sql.handlers.DefaultSqlHandler.getPlan(DefaultSqlHandler.java:134) > > > > > > ~[drill-java-exec-0.6.0.r2-incubating-SNAPSHOT-rebuffed.jar:0.6.0.r2-incubating-SNAPSHOT] > > > at > > > > > > org.apache.drill.exec.planner.sql.DrillSqlWorker.getPlan(DrillSqlWorker.java:132) > > > > > > ~[drill-java-exec-0.6.0.r2-incubating-SNAPSHOT-rebuffed.jar:0.6.0.r2-incubating-SNAPSHOT] > > > at > org.apache.drill.exec.work.foreman.Foreman.runSQL(Foreman.java:385) > > > > > > ~[drill-java-exec-0.6.0.r2-incubating-SNAPSHOT-rebuffed.jar:0.6.0.r2-incubating-SNAPSHOT] > > > at org.apache.drill.exec.work.foreman.Foreman.run(Foreman.java:204) > > > > > > ~[drill-java-exec-0.6.0.r2-incubating-SNAPSHOT-rebuffed.jar:0.6.0.r2-incubating-SNAPSHOT] > > > at > > > > > > org.apache.drill.exec.work.WorkManager$RunnableWrapper.run(WorkManager.java:249) > > > > > > [drill-java-exec-0.6.0.r2-incubating-SNAPSHOT-rebuffed.jar:0.6.0.r2-incubating-SNAPSHOT] > > > at > > > > > > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > > > [na:1.7.0_55] > > > at > > > > > > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > > > [na:1.7.0_55] > > > at java.lang.Thread.run(Thread.java:744) [na:1.7.0_55] > > > Caused by: java.lang.AssertionError: Internal error: Error occurred > while > > > applying rule DrillPushProjIntoScan > > > at org.eigenbase.util.Util.newInternal(Util.java:750) > > > ~[optiq-core-0.9-drill-r8.jar:na] > > > at > > > > > > org.eigenbase.relopt.volcano.VolcanoRuleCall.transformTo(VolcanoRuleCall.java:143) > > > ~[optiq-core-0.9-drill-r8.jar:na] > > > at > > > > org.eigenbase.relopt.RelOptRuleCall.transformTo(RelOptRuleCall.java:210) > > > ~[optiq-core-0.9-drill-r8.jar:na] > > > at > > > > > > org.apache.drill.exec.planner.logical.DrillPushProjIntoScan.onMatch(DrillPushProjIntoScan.java:85) > > > > > > ~[drill-java-exec-0.6.0.r2-incubating-SNAPSHOT-rebuffed.jar:0.6.0.r2-incubating-SNAPSHOT] > > > at > > > > > > org.eigenbase.relopt.volcano.VolcanoRuleCall.onMatch(VolcanoRuleCall.java:223) > > > ~[optiq-core-0.9-drill-r8.jar:na] > > > ... 12 common frames omitted > > > Caused by: java.lang.reflect.UndeclaredThrowableException: null > > > at com.sun.proxy.$Proxy94.getNonCumulativeCost(Unknown Source) > ~[na:na] > > > at > > > > > > org.eigenbase.rel.metadata.RelMetadataQuery.getNonCumulativeCost(RelMetadataQuery.java:125) > > > ~[optiq-core-0.9-drill-r8.jar:na] > > > at > > > > > > org.eigenbase.relopt.volcano.VolcanoPlanner.getCost(VolcanoPlanner.java:926) > > > ~[optiq-core-0.9-drill-r8.jar:na] > > > at > > > > > > org.eigenbase.relopt.volcano.RelSubset.propagateCostImprovements0(RelSubset.java:333) > > > ~[optiq-core-0.9-drill-r8.jar:na] > > > at > > > > > > org.eigenbase.relopt.volcano.RelSubset.propagateCostImprovements(RelSubset.java:314) > > > ~[optiq-core-0.9-drill-r8.jar:na] > > > at > > > > org.eigenbase.relopt.volcano.VolcanoPlanner.asd(VolcanoPlanner.java:1635) > > > ~[optiq-core-0.9-drill-r8.jar:na] > > > at > > > > > > org.eigenbase.relopt.volcano.VolcanoPlanner.registerImpl(VolcanoPlanner.java:1568) > > > ~[optiq-core-0.9-drill-r8.jar:na] > > > at > > > > > > org.eigenbase.relopt.volcano.VolcanoPlanner.register(VolcanoPlanner.java:837) > > > ~[optiq-core-0.9-drill-r8.jar:na] > > > at > > > > > > org.eigenbase.relopt.volcano.VolcanoPlanner.ensureRegistered(VolcanoPlanner.java:860) > > > ~[optiq-core-0.9-drill-r8.jar:na] > > > at > > > > > > org.eigenbase.relopt.volcano.VolcanoPlanner.ensureRegistered(VolcanoPlanner.java:1750) > > > ~[optiq-core-0.9-drill-r8.jar:na] > > > Caused by: java.lang.reflect.InvocationTargetException: null > > > at sun.reflect.GeneratedMethodAccessor23.invoke(Unknown Source) > > ~[na:na] > > > at > > > > > > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > > > ~[na:1.7.0_55] > > > at java.lang.reflect.Method.invoke(Method.java:606) ~[na:1.7.0_55] > > > at > > > > > > org.eigenbase.rel.metadata.ReflectiveRelMetadataProvider$2$1.invoke(ReflectiveRelMetadataProvider.java:135) > > > ~[optiq-core-0.9-drill-r8.jar:na] > > > ... 26 common frames omitted > > > Caused by: java.lang.reflect.UndeclaredThrowableException: null > > > at com.sun.proxy.$Proxy96.getRowCount(Unknown Source) ~[na:na] > > > at > > > > > > org.eigenbase.rel.metadata.RelMetadataQuery.getRowCount(RelMetadataQuery.java:96) > > > ~[optiq-core-0.9-drill-r8.jar:na] > > > at > > > > > > org.apache.drill.exec.planner.common.DrillProjectRelBase.computeSelfCost(DrillProjectRelBase.java:64) > > > > > > ~[drill-java-exec-0.6.0.r2-incubating-SNAPSHOT-rebuffed.jar:0.6.0.r2-incubating-SNAPSHOT] > > > at > > > > > > org.eigenbase.rel.metadata.RelMdPercentageOriginalRows.getNonCumulativeCost(RelMdPercentageOriginalRows.java:159) > > > ~[optiq-core-0.9-drill-r8.jar:na] > > > ... 30 common frames omitted > > > Caused by: java.lang.reflect.InvocationTargetException: null > > > at sun.reflect.GeneratedMethodAccessor39.invoke(Unknown Source) > > ~[na:na] > > > at > > > > > > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > > > ~[na:1.7.0_55] > > > at java.lang.reflect.Method.invoke(Method.java:606) ~[na:1.7.0_55] > > > at > > > > > > org.eigenbase.rel.metadata.ReflectiveRelMetadataProvider$2$1.invoke(ReflectiveRelMetadataProvider.java:135) > > > ~[optiq-core-0.9-drill-r8.jar:na] > > > ... 34 common frames omitted > > > Caused by: java.lang.reflect.UndeclaredThrowableException: null > > > at com.sun.proxy.$Proxy96.getRowCount(Unknown Source) ~[na:na] > > > at > > > > > > org.eigenbase.rel.metadata.RelMetadataQuery.getRowCount(RelMetadataQuery.java:96) > > > ~[optiq-core-0.9-drill-r8.jar:na] > > > at > > > > > > org.eigenbase.rel.metadata.RelMdRowCount.getRowCount(RelMdRowCount.java:62) > > > ~[optiq-core-0.9-drill-r8.jar:na] > > > ... 38 common frames omitted > > > Caused by: java.lang.reflect.InvocationTargetException: null > > > at sun.reflect.GeneratedMethodAccessor24.invoke(Unknown Source) > > ~[na:na] > > > at > > > > > > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > > > ~[na:1.7.0_55] > > > at java.lang.reflect.Method.invoke(Method.java:606) ~[na:1.7.0_55] > > > at > > > > > > org.eigenbase.rel.metadata.ReflectiveRelMetadataProvider$2$1.invoke(ReflectiveRelMetadataProvider.java:135) > > > ~[optiq-core-0.9-drill-r8.jar:na] > > > ... 41 common frames omitted > > > Caused by: java.lang.AssertionError: null > > > at > > > > > > org.eigenbase.rel.metadata.RelMetadataQuery.isNonNegative(RelMetadataQuery.java:368) > > > ~[optiq-core-0.9-drill-r8.jar:na] > > > at > > > > > > org.eigenbase.rel.metadata.RelMetadataQuery.validateResult(RelMetadataQuery.java:387) > > > ~[optiq-core-0.9-drill-r8.jar:na] > > > at > > > > > > org.eigenbase.rel.metadata.RelMetadataQuery.getRowCount(RelMetadataQuery.java:97) > > > ~[optiq-core-0.9-drill-r8.jar:na] > > > at org.eigenbase.relopt.volcano.RelSubset.getRows(RelSubset.java:135) > > > ~[optiq-core-0.9-drill-r8.jar:na] > > > at > > > > > > org.eigenbase.rel.metadata.RelMdRowCount.getRowCount(RelMdRowCount.java:103) > > > ~[optiq-core-0.9-drill-r8.jar:na] > > > ... 45 common frames omitted > > > 2014-12-12 19:02:24,985 [1a48def7-07e1-4250-b42f-4f3f8012fba6:foreman] > > > WARN o.a.d.exec.work.foreman.QueryStatus - Update finished query > state : > > > FAILED > > > 2014-12-12 19:02:24,999 [UserServer-1] INFO > > > o.a.drill.exec.rpc.user.UserServer - Channel closed between local > > > 0.0.0.0/0.0.0.0:31010 and remote /10.190.22.16:51773 > > > > > > > > > > > > On Fri, Dec 12, 2014 at 10:16 AM, Steven Phillips < > > [email protected]> > > > wrote: > > > > > >> You need to look at the drillbit logs to see what the problem is. We > > can't > > >> diagnose this without that information. > > >> > > >> On Fri, Dec 12, 2014 at 9:49 AM, James Sun <[email protected]> wrote: > > >> > > > >> > Sungwook, > > >> > > > >> > What's the column family permission? You probably want to do > > something > > >> > like this to give r/w permissions: > > >> > > > >> > maprcli table cf edit -cfname dependent_vars -path '/tables/lecxe' > > >> > -readperm 'u:root|u:mapr' > > >> > maprcli table cf edit -cfname dependent_vars -path '/tables/lecxe' > > >> > -writeperm 'u:root|u:mapr' > > >> > > > >> > -James > > >> > > > >> > > > >> > On 12/12/14, 6:44 AM, Sungwook Yoon wrote: > > >> > > > >> >> Querying maprdb, I got this error. > > >> >> > > >> >> 0: jdbc:drill:zk=10.180.98.244:5181,10.180.98> select * from excel > > >> limit > > >> >> 2; > > >> >> Query failed: Failure while setting up Foreman. > > >> >> > > >> >> Error: exception while executing query: Failure while executing > > query. > > >> >> (state=,code=0) > > >> >> > > >> >> > > >> >> What's going on? > > >> >> Drillbit reads the column family information correctly, just does > not > > >> go > > >> >> to > > >> >> columns. > > >> >> Thanks, > > >> >> > > >> >> Sungwook > > >> >> > > >> >> > > >> > > > >> > > >> -- > > >> Steven Phillips > > >> Software Engineer > > >> > > >> mapr.com > > >> > > > > > > > > >
