Xiao Meng created DRILL-947:
-------------------------------
Summary: Select query failed for json files with mutant
Key: DRILL-947
URL: https://issues.apache.org/jira/browse/DRILL-947
Project: Apache Drill
Issue Type: Bug
Reporter: Xiao Meng
Given a json file with mutant like the one in DRILL-835, where the majority has
the schema
{code}
(name, isDirectory, isFile, isSymlink, length, ownerName, groupName,
modificationTime, accessTime, permission)
{code}
and there exists a record with different schema
{code}
(name, mutant, age, firstName, powers)
{code}
the following query generated by Tableau fails:
{code}
SELECT 1 AS `Number_of_Records`,
`/opt/drill/raw-files/metadata-evolution-test5.json`.`accessTime` AS
`accessTime`,
`/opt/drill/raw-files/metadata-evolution-test5.json`.`groupName` AS
`groupName`,
`/opt/drill/raw-files/metadata-evolution-test5.json`.`isDirectory` AS
`isDirectory`,
`/opt/drill/raw-files/metadata-evolution-test5.json`.`isFile` AS `isFile`,
`/opt/drill/raw-files/metadata-evolution-test5.json`.`isSymlink` AS
`isSymlink`,
`/opt/drill/raw-files/metadata-evolution-test5.json`.`length` AS `length`,
`/opt/drill/raw-files/metadata-evolution-test5.json`.`modificationTime` AS
`modificationTime`,
`/opt/drill/raw-files/metadata-evolution-test5.json`.`name` AS `name`,
`/opt/drill/raw-files/metadata-evolution-test5.json`.`ownerName` AS
`ownerName`,
`/opt/drill/raw-files/metadata-evolution-test5.json`.`permission` AS
`permission`
FROM `dfs.default`.`/opt/drill/raw-files/metadata-evolution-test5.json`
`/opt/drill/raw-files/metadata-evolution-test5.json`
LIMIT 10000
{code}
The stacktrace is
{code}
2014-06-10 16:20:37,771 [cd37bd9c-bc0b-4e2a-972d-36ec548661f8:frag:0:0] DEBUG
o.a.d.e.w.fragment.FragmentExecutor - Caught exception while running fragment
java.lang.UnsupportedOperationException: Attemped to access a DeadBuf. This
would happen if you attempted to interact with a buffer that has been moved or
not yet initialized.
at org.apache.drill.exec.record.DeadBuf.retain(DeadBuf.java:792)
~[drill-java-exec-1.0.0-m2-incubating-SNAPSHOT-rebuffed.jar:1.0.0-m2-incubating-SNAPSHOT]
at
org.apache.drill.exec.vector.IntVector.transferTo(IntVector.java:195)
~[drill-java-exec-1.0.0-m2-incubating-SNAPSHOT-rebuffed.jar:1.0.0-m2-incubating-SNAPSHOT]
at
org.apache.drill.exec.vector.IntVector$TransferImpl.transfer(IntVector.java:226)
~[drill-java-exec-1.0.0-m2-incubating-SNAPSHOT-rebuffed.jar:1.0.0-m2-incubating-SNAPSHOT]
at
org.apache.drill.exec.physical.impl.limit.LimitRecordBatch.doWork(LimitRecordBatch.java:110)
~[drill-java-exec-1.0.0-m2-incubating-SNAPSHOT-rebuffed.jar:1.0.0-m2-incubating-SNAPSHOT]
at
org.apache.drill.exec.record.AbstractSingleRecordBatch.next(AbstractSingleRecordBatch.java:71)
~[drill-java-exec-1.0.0-m2-incubating-SNAPSHOT-rebuffed.jar:1.0.0-m2-incubating-SNAPSHOT]
at
org.apache.drill.exec.physical.impl.limit.LimitRecordBatch.next(LimitRecordBatch.java:99)
~[drill-java-exec-1.0.0-m2-incubating-SNAPSHOT-rebuffed.jar:1.0.0-m2-incubating-SNAPSHOT]
at
org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:69)
~[drill-java-exec-1.0.0-m2-incubating-SNAPSHOT-rebuffed.jar:1.0.0-m2-incubating-SNAPSHOT]
at
org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:63)
~[drill-java-exec-1.0.0-m2-incubating-SNAPSHOT-rebuffed.jar:1.0.0-m2-incubating-SNAPSHOT]
at
org.apache.drill.exec.record.AbstractSingleRecordBatch.next(AbstractSingleRecordBatch.java:47)
~[drill-java-exec-1.0.0-m2-incubating-SNAPSHOT-rebuffed.jar:1.0.0-m2-incubating-SNAPSHOT]
at
org.apache.drill.exec.physical.impl.svremover.RemovingRecordBatch.next(RemovingRecordBatch.java:91)
~[drill-java-exec-1.0.0-m2-incubating-SNAPSHOT-rebuffed.jar:1.0.0-m2-incubating-SNAPSHOT]
at
org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:69)
~[drill-java-exec-1.0.0-m2-incubating-SNAPSHOT-rebuffed.jar:1.0.0-m2-incubating-SNAPSHOT]
at
org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:63)
~[drill-java-exec-1.0.0-m2-incubating-SNAPSHOT-rebuffed.jar:1.0.0-m2-incubating-SNAPSHOT]
at
org.apache.drill.exec.record.AbstractSingleRecordBatch.next(AbstractSingleRecordBatch.java:47)
~[drill-java-exec-1.0.0-m2-incubating-SNAPSHOT-rebuffed.jar:1.0.0-m2-incubating-SNAPSHOT]
at
org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.next(ProjectRecordBatch.java:83)
~[drill-java-exec-1.0.0-m2-incubating-SNAPSHOT-rebuffed.jar:1.0.0-m2-incubating-SNAPSHOT]
at
org.apache.drill.exec.physical.impl.ScreenCreator$ScreenRoot.next(ScreenCreator.java:81)
~[drill-java-exec-1.0.0-m2-incubating-SNAPSHOT-rebuffed.jar:1.0.0-m2-incubating-SNAPSHOT]
at
org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:98)
~[drill-java-exec-1.0.0-m2-incubating-SNAPSHOT-rebuffed.jar:1.0.0-m2-incubating-SNAPSHOT]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[na:1.7.0_51]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[na:1.7.0_51]
at java.lang.Thread.run(Thread.java:744) [na:1.7.0_51]
{code}
--
This message was sent by Atlassian JIRA
(v6.2#6252)
