[jira] [Commented] (DRILL-4339) Avro Reader can not read records - Regression
[ https://issues.apache.org/jira/browse/DRILL-4339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15129381#comment-15129381 ] Steven Phillips commented on DRILL-4339: I personally don't have much problem with having to recompile my code, I was just wondering if this would create problems for others. If reverting the signature change could avoid a few headaches, and there is very little cost in making the change, I say we go ahead and merge it. +1 > Avro Reader can not read records - Regression > - > > Key: DRILL-4339 > URL: https://issues.apache.org/jira/browse/DRILL-4339 > Project: Apache Drill > Issue Type: Bug > Components: Storage - Other >Affects Versions: 1.5.0 >Reporter: Stefán Baxter >Priority: Blocker > Fix For: 1.5.0 > > > Simple reading of Avro records no longer works > 0: jdbc:drill:zk=local> select * from dfs.asa.`/`; > Exception in thread "drill-executor-2" java.lang.NoSuchMethodError: > org.apache.drill.exec.store.avro.AvroRecordReader.setColumns(Ljava/util/Collection;)V > at > org.apache.drill.exec.store.avro.AvroRecordReader.(AvroRecordReader.java:99) > at > org.apache.drill.exec.store.avro.AvroFormatPlugin.getRecordReader(AvroFormatPlugin.java:73) > at > org.apache.drill.exec.store.dfs.easy.EasyFormatPlugin.getReaderBatch(EasyFormatPlugin.java:172) > at > org.apache.drill.exec.store.dfs.easy.EasyReaderBatchCreator.getBatch(EasyReaderBatchCreator.java:35) > at > org.apache.drill.exec.store.dfs.easy.EasyReaderBatchCreator.getBatch(EasyReaderBatchCreator.java:28) > at > org.apache.drill.exec.physical.impl.ImplCreator.getRecordBatch(ImplCreator.java:147) > at > org.apache.drill.exec.physical.impl.ImplCreator.getChildren(ImplCreator.java:170) > at > org.apache.drill.exec.physical.impl.ImplCreator.getRecordBatch(ImplCreator.java:127) > at > org.apache.drill.exec.physical.impl.ImplCreator.getChildren(ImplCreator.java:170) > at > org.apache.drill.exec.physical.impl.ImplCreator.getRecordBatch(ImplCreator.java:127) > at > org.apache.drill.exec.physical.impl.ImplCreator.getChildren(ImplCreator.java:170) > at > org.apache.drill.exec.physical.impl.ImplCreator.getRootExec(ImplCreator.java:101) > at > org.apache.drill.exec.physical.impl.ImplCreator.getExec(ImplCreator.java:79) > at > org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:230) > at > org.apache.drill.common.SelfCleaningRunnable.run(SelfCleaningRunnable.java:38) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > We have been using the Avro reader for a while and this looks like a > regression. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (DRILL-4339) Avro Reader can not read records - Regression
[ https://issues.apache.org/jira/browse/DRILL-4339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15129373#comment-15129373 ] Jinfeng Ni commented on DRILL-4339: --- [~sphillips], I have a patch which reverts the setColumn's signature change [1]. I run the pre-commit and unit test, and did not see any issue. If you prefer to use the old setColumn signature, I can merge this patch. As I said earlier, the change to setColumn signature is not necessary. As a side note, we probably need cleaner definition of public api, so that people would be more cautious to touch this kind of code in the future release. [1] https://github.com/jinfengni/incubator-drill/commit/6a36a704bc139aa05deb3919e792f21b3fcd7794 > Avro Reader can not read records - Regression > - > > Key: DRILL-4339 > URL: https://issues.apache.org/jira/browse/DRILL-4339 > Project: Apache Drill > Issue Type: Bug > Components: Storage - Other >Affects Versions: 1.5.0 >Reporter: Stefán Baxter >Priority: Blocker > Fix For: 1.5.0 > > > Simple reading of Avro records no longer works > 0: jdbc:drill:zk=local> select * from dfs.asa.`/`; > Exception in thread "drill-executor-2" java.lang.NoSuchMethodError: > org.apache.drill.exec.store.avro.AvroRecordReader.setColumns(Ljava/util/Collection;)V > at > org.apache.drill.exec.store.avro.AvroRecordReader.(AvroRecordReader.java:99) > at > org.apache.drill.exec.store.avro.AvroFormatPlugin.getRecordReader(AvroFormatPlugin.java:73) > at > org.apache.drill.exec.store.dfs.easy.EasyFormatPlugin.getReaderBatch(EasyFormatPlugin.java:172) > at > org.apache.drill.exec.store.dfs.easy.EasyReaderBatchCreator.getBatch(EasyReaderBatchCreator.java:35) > at > org.apache.drill.exec.store.dfs.easy.EasyReaderBatchCreator.getBatch(EasyReaderBatchCreator.java:28) > at > org.apache.drill.exec.physical.impl.ImplCreator.getRecordBatch(ImplCreator.java:147) > at > org.apache.drill.exec.physical.impl.ImplCreator.getChildren(ImplCreator.java:170) > at > org.apache.drill.exec.physical.impl.ImplCreator.getRecordBatch(ImplCreator.java:127) > at > org.apache.drill.exec.physical.impl.ImplCreator.getChildren(ImplCreator.java:170) > at > org.apache.drill.exec.physical.impl.ImplCreator.getRecordBatch(ImplCreator.java:127) > at > org.apache.drill.exec.physical.impl.ImplCreator.getChildren(ImplCreator.java:170) > at > org.apache.drill.exec.physical.impl.ImplCreator.getRootExec(ImplCreator.java:101) > at > org.apache.drill.exec.physical.impl.ImplCreator.getExec(ImplCreator.java:79) > at > org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:230) > at > org.apache.drill.common.SelfCleaningRunnable.run(SelfCleaningRunnable.java:38) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > We have been using the Avro reader for a while and this looks like a > regression. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (DRILL-4339) Avro Reader can not read records - Regression
[ https://issues.apache.org/jira/browse/DRILL-4339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15128993#comment-15128993 ] Stefán Baxter commented on DRILL-4339: -- Thank you, I will look for the mismatch in my code base. > Avro Reader can not read records - Regression > - > > Key: DRILL-4339 > URL: https://issues.apache.org/jira/browse/DRILL-4339 > Project: Apache Drill > Issue Type: Bug > Components: Storage - Other >Affects Versions: 1.5.0 >Reporter: Stefán Baxter >Priority: Blocker > Fix For: 1.5.0 > > > Simple reading of Avro records no longer works > 0: jdbc:drill:zk=local> select * from dfs.asa.`/`; > Exception in thread "drill-executor-2" java.lang.NoSuchMethodError: > org.apache.drill.exec.store.avro.AvroRecordReader.setColumns(Ljava/util/Collection;)V > at > org.apache.drill.exec.store.avro.AvroRecordReader.(AvroRecordReader.java:99) > at > org.apache.drill.exec.store.avro.AvroFormatPlugin.getRecordReader(AvroFormatPlugin.java:73) > at > org.apache.drill.exec.store.dfs.easy.EasyFormatPlugin.getReaderBatch(EasyFormatPlugin.java:172) > at > org.apache.drill.exec.store.dfs.easy.EasyReaderBatchCreator.getBatch(EasyReaderBatchCreator.java:35) > at > org.apache.drill.exec.store.dfs.easy.EasyReaderBatchCreator.getBatch(EasyReaderBatchCreator.java:28) > at > org.apache.drill.exec.physical.impl.ImplCreator.getRecordBatch(ImplCreator.java:147) > at > org.apache.drill.exec.physical.impl.ImplCreator.getChildren(ImplCreator.java:170) > at > org.apache.drill.exec.physical.impl.ImplCreator.getRecordBatch(ImplCreator.java:127) > at > org.apache.drill.exec.physical.impl.ImplCreator.getChildren(ImplCreator.java:170) > at > org.apache.drill.exec.physical.impl.ImplCreator.getRecordBatch(ImplCreator.java:127) > at > org.apache.drill.exec.physical.impl.ImplCreator.getChildren(ImplCreator.java:170) > at > org.apache.drill.exec.physical.impl.ImplCreator.getRootExec(ImplCreator.java:101) > at > org.apache.drill.exec.physical.impl.ImplCreator.getExec(ImplCreator.java:79) > at > org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:230) > at > org.apache.drill.common.SelfCleaningRunnable.run(SelfCleaningRunnable.java:38) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > We have been using the Avro reader for a while and this looks like a > regression. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (DRILL-4339) Avro Reader can not read records - Regression
[ https://issues.apache.org/jira/browse/DRILL-4339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15128954#comment-15128954 ] Jinfeng Ni commented on DRILL-4339: --- On a second thought, seems that it's easy to change the function setColumn's signature. That will avoid the re-compile. However, without re-compile, I'm not sure if your customer storage plugin will work or not, since the implementation of this method actually is changed in 1.5.0. > Avro Reader can not read records - Regression > - > > Key: DRILL-4339 > URL: https://issues.apache.org/jira/browse/DRILL-4339 > Project: Apache Drill > Issue Type: Bug > Components: Storage - Other >Affects Versions: 1.5.0 >Reporter: Stefán Baxter >Priority: Blocker > Fix For: 1.5.0 > > > Simple reading of Avro records no longer works > 0: jdbc:drill:zk=local> select * from dfs.asa.`/`; > Exception in thread "drill-executor-2" java.lang.NoSuchMethodError: > org.apache.drill.exec.store.avro.AvroRecordReader.setColumns(Ljava/util/Collection;)V > at > org.apache.drill.exec.store.avro.AvroRecordReader.(AvroRecordReader.java:99) > at > org.apache.drill.exec.store.avro.AvroFormatPlugin.getRecordReader(AvroFormatPlugin.java:73) > at > org.apache.drill.exec.store.dfs.easy.EasyFormatPlugin.getReaderBatch(EasyFormatPlugin.java:172) > at > org.apache.drill.exec.store.dfs.easy.EasyReaderBatchCreator.getBatch(EasyReaderBatchCreator.java:35) > at > org.apache.drill.exec.store.dfs.easy.EasyReaderBatchCreator.getBatch(EasyReaderBatchCreator.java:28) > at > org.apache.drill.exec.physical.impl.ImplCreator.getRecordBatch(ImplCreator.java:147) > at > org.apache.drill.exec.physical.impl.ImplCreator.getChildren(ImplCreator.java:170) > at > org.apache.drill.exec.physical.impl.ImplCreator.getRecordBatch(ImplCreator.java:127) > at > org.apache.drill.exec.physical.impl.ImplCreator.getChildren(ImplCreator.java:170) > at > org.apache.drill.exec.physical.impl.ImplCreator.getRecordBatch(ImplCreator.java:127) > at > org.apache.drill.exec.physical.impl.ImplCreator.getChildren(ImplCreator.java:170) > at > org.apache.drill.exec.physical.impl.ImplCreator.getRootExec(ImplCreator.java:101) > at > org.apache.drill.exec.physical.impl.ImplCreator.getExec(ImplCreator.java:79) > at > org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:230) > at > org.apache.drill.common.SelfCleaningRunnable.run(SelfCleaningRunnable.java:38) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > We have been using the Avro reader for a while and this looks like a > regression. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (DRILL-4339) Avro Reader can not read records - Regression
[ https://issues.apache.org/jira/browse/DRILL-4339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15128941#comment-15128941 ] Jinfeng Ni commented on DRILL-4339: --- If the storage plugin has subclass of AbstractRecordReader, I think the plugin has to recompile. Are we supposedly going to keep this not-required-for-recompile for storage plugin with each new release? Actually, I just realized this method's signature does not have to change at all ( Maybe I had to change it because of other codes which are not included in the patch, but I forgot to change it back). I can change it back to the original signature of setColumns(). > Avro Reader can not read records - Regression > - > > Key: DRILL-4339 > URL: https://issues.apache.org/jira/browse/DRILL-4339 > Project: Apache Drill > Issue Type: Bug > Components: Storage - Other >Affects Versions: 1.5.0 >Reporter: Stefán Baxter >Priority: Blocker > Fix For: 1.5.0 > > > Simple reading of Avro records no longer works > 0: jdbc:drill:zk=local> select * from dfs.asa.`/`; > Exception in thread "drill-executor-2" java.lang.NoSuchMethodError: > org.apache.drill.exec.store.avro.AvroRecordReader.setColumns(Ljava/util/Collection;)V > at > org.apache.drill.exec.store.avro.AvroRecordReader.(AvroRecordReader.java:99) > at > org.apache.drill.exec.store.avro.AvroFormatPlugin.getRecordReader(AvroFormatPlugin.java:73) > at > org.apache.drill.exec.store.dfs.easy.EasyFormatPlugin.getReaderBatch(EasyFormatPlugin.java:172) > at > org.apache.drill.exec.store.dfs.easy.EasyReaderBatchCreator.getBatch(EasyReaderBatchCreator.java:35) > at > org.apache.drill.exec.store.dfs.easy.EasyReaderBatchCreator.getBatch(EasyReaderBatchCreator.java:28) > at > org.apache.drill.exec.physical.impl.ImplCreator.getRecordBatch(ImplCreator.java:147) > at > org.apache.drill.exec.physical.impl.ImplCreator.getChildren(ImplCreator.java:170) > at > org.apache.drill.exec.physical.impl.ImplCreator.getRecordBatch(ImplCreator.java:127) > at > org.apache.drill.exec.physical.impl.ImplCreator.getChildren(ImplCreator.java:170) > at > org.apache.drill.exec.physical.impl.ImplCreator.getRecordBatch(ImplCreator.java:127) > at > org.apache.drill.exec.physical.impl.ImplCreator.getChildren(ImplCreator.java:170) > at > org.apache.drill.exec.physical.impl.ImplCreator.getRootExec(ImplCreator.java:101) > at > org.apache.drill.exec.physical.impl.ImplCreator.getExec(ImplCreator.java:79) > at > org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:230) > at > org.apache.drill.common.SelfCleaningRunnable.run(SelfCleaningRunnable.java:38) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > We have been using the Avro reader for a while and this looks like a > regression. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (DRILL-4339) Avro Reader can not read records - Regression
[ https://issues.apache.org/jira/browse/DRILL-4339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15128914#comment-15128914 ] Steven Phillips commented on DRILL-4339: Does the method signature change require external plugins to be recompiled? I was hitting this same problem with a customer storage plugin last night. > Avro Reader can not read records - Regression > - > > Key: DRILL-4339 > URL: https://issues.apache.org/jira/browse/DRILL-4339 > Project: Apache Drill > Issue Type: Bug > Components: Storage - Other >Affects Versions: 1.5.0 >Reporter: Stefán Baxter >Priority: Blocker > Fix For: 1.5.0 > > > Simple reading of Avro records no longer works > 0: jdbc:drill:zk=local> select * from dfs.asa.`/`; > Exception in thread "drill-executor-2" java.lang.NoSuchMethodError: > org.apache.drill.exec.store.avro.AvroRecordReader.setColumns(Ljava/util/Collection;)V > at > org.apache.drill.exec.store.avro.AvroRecordReader.(AvroRecordReader.java:99) > at > org.apache.drill.exec.store.avro.AvroFormatPlugin.getRecordReader(AvroFormatPlugin.java:73) > at > org.apache.drill.exec.store.dfs.easy.EasyFormatPlugin.getReaderBatch(EasyFormatPlugin.java:172) > at > org.apache.drill.exec.store.dfs.easy.EasyReaderBatchCreator.getBatch(EasyReaderBatchCreator.java:35) > at > org.apache.drill.exec.store.dfs.easy.EasyReaderBatchCreator.getBatch(EasyReaderBatchCreator.java:28) > at > org.apache.drill.exec.physical.impl.ImplCreator.getRecordBatch(ImplCreator.java:147) > at > org.apache.drill.exec.physical.impl.ImplCreator.getChildren(ImplCreator.java:170) > at > org.apache.drill.exec.physical.impl.ImplCreator.getRecordBatch(ImplCreator.java:127) > at > org.apache.drill.exec.physical.impl.ImplCreator.getChildren(ImplCreator.java:170) > at > org.apache.drill.exec.physical.impl.ImplCreator.getRecordBatch(ImplCreator.java:127) > at > org.apache.drill.exec.physical.impl.ImplCreator.getChildren(ImplCreator.java:170) > at > org.apache.drill.exec.physical.impl.ImplCreator.getRootExec(ImplCreator.java:101) > at > org.apache.drill.exec.physical.impl.ImplCreator.getExec(ImplCreator.java:79) > at > org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:230) > at > org.apache.drill.common.SelfCleaningRunnable.run(SelfCleaningRunnable.java:38) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > We have been using the Avro reader for a while and this looks like a > regression. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (DRILL-4339) Avro Reader can not read records - Regression
[ https://issues.apache.org/jira/browse/DRILL-4339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15128835#comment-15128835 ] Jinfeng Ni commented on DRILL-4339: --- Jason's explanation makes sense. the setColumns method changes definition in 1.5.0. The error message seems to indicate a wrong version is loaded. > Avro Reader can not read records - Regression > - > > Key: DRILL-4339 > URL: https://issues.apache.org/jira/browse/DRILL-4339 > Project: Apache Drill > Issue Type: Bug > Components: Storage - Other >Affects Versions: 1.5.0 >Reporter: Stefán Baxter >Priority: Blocker > Fix For: 1.5.0 > > > Simple reading of Avro records no longer works > 0: jdbc:drill:zk=local> select * from dfs.asa.`/`; > Exception in thread "drill-executor-2" java.lang.NoSuchMethodError: > org.apache.drill.exec.store.avro.AvroRecordReader.setColumns(Ljava/util/Collection;)V > at > org.apache.drill.exec.store.avro.AvroRecordReader.(AvroRecordReader.java:99) > at > org.apache.drill.exec.store.avro.AvroFormatPlugin.getRecordReader(AvroFormatPlugin.java:73) > at > org.apache.drill.exec.store.dfs.easy.EasyFormatPlugin.getReaderBatch(EasyFormatPlugin.java:172) > at > org.apache.drill.exec.store.dfs.easy.EasyReaderBatchCreator.getBatch(EasyReaderBatchCreator.java:35) > at > org.apache.drill.exec.store.dfs.easy.EasyReaderBatchCreator.getBatch(EasyReaderBatchCreator.java:28) > at > org.apache.drill.exec.physical.impl.ImplCreator.getRecordBatch(ImplCreator.java:147) > at > org.apache.drill.exec.physical.impl.ImplCreator.getChildren(ImplCreator.java:170) > at > org.apache.drill.exec.physical.impl.ImplCreator.getRecordBatch(ImplCreator.java:127) > at > org.apache.drill.exec.physical.impl.ImplCreator.getChildren(ImplCreator.java:170) > at > org.apache.drill.exec.physical.impl.ImplCreator.getRecordBatch(ImplCreator.java:127) > at > org.apache.drill.exec.physical.impl.ImplCreator.getChildren(ImplCreator.java:170) > at > org.apache.drill.exec.physical.impl.ImplCreator.getRootExec(ImplCreator.java:101) > at > org.apache.drill.exec.physical.impl.ImplCreator.getExec(ImplCreator.java:79) > at > org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:230) > at > org.apache.drill.common.SelfCleaningRunnable.run(SelfCleaningRunnable.java:38) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > We have been using the Avro reader for a while and this looks like a > regression. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (DRILL-4339) Avro Reader can not read records - Regression
[ https://issues.apache.org/jira/browse/DRILL-4339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15128818#comment-15128818 ] Stefán Baxter commented on DRILL-4339: -- Hi, As a part of answering this request I cloned the project again and built it from scratch. I did this because I had local, Lucene related, work that I thought could not possibly affect Avro (strictly contained to the Lucene reader). Long story short: this ticket can be closed as invalid and I apologize for the inconvenience. > Avro Reader can not read records - Regression > - > > Key: DRILL-4339 > URL: https://issues.apache.org/jira/browse/DRILL-4339 > Project: Apache Drill > Issue Type: Bug > Components: Storage - Other >Affects Versions: 1.5.0 >Reporter: Stefán Baxter >Priority: Blocker > Fix For: 1.5.0 > > > Simple reading of Avro records no longer works > 0: jdbc:drill:zk=local> select * from dfs.asa.`/`; > Exception in thread "drill-executor-2" java.lang.NoSuchMethodError: > org.apache.drill.exec.store.avro.AvroRecordReader.setColumns(Ljava/util/Collection;)V > at > org.apache.drill.exec.store.avro.AvroRecordReader.(AvroRecordReader.java:99) > at > org.apache.drill.exec.store.avro.AvroFormatPlugin.getRecordReader(AvroFormatPlugin.java:73) > at > org.apache.drill.exec.store.dfs.easy.EasyFormatPlugin.getReaderBatch(EasyFormatPlugin.java:172) > at > org.apache.drill.exec.store.dfs.easy.EasyReaderBatchCreator.getBatch(EasyReaderBatchCreator.java:35) > at > org.apache.drill.exec.store.dfs.easy.EasyReaderBatchCreator.getBatch(EasyReaderBatchCreator.java:28) > at > org.apache.drill.exec.physical.impl.ImplCreator.getRecordBatch(ImplCreator.java:147) > at > org.apache.drill.exec.physical.impl.ImplCreator.getChildren(ImplCreator.java:170) > at > org.apache.drill.exec.physical.impl.ImplCreator.getRecordBatch(ImplCreator.java:127) > at > org.apache.drill.exec.physical.impl.ImplCreator.getChildren(ImplCreator.java:170) > at > org.apache.drill.exec.physical.impl.ImplCreator.getRecordBatch(ImplCreator.java:127) > at > org.apache.drill.exec.physical.impl.ImplCreator.getChildren(ImplCreator.java:170) > at > org.apache.drill.exec.physical.impl.ImplCreator.getRootExec(ImplCreator.java:101) > at > org.apache.drill.exec.physical.impl.ImplCreator.getExec(ImplCreator.java:79) > at > org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:230) > at > org.apache.drill.common.SelfCleaningRunnable.run(SelfCleaningRunnable.java:38) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > We have been using the Avro reader for a while and this looks like a > regression. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (DRILL-4339) Avro Reader can not read records - Regression
[ https://issues.apache.org/jira/browse/DRILL-4339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15128584#comment-15128584 ] Jason Altekruse commented on DRILL-4339: The signature on this method changed in a recent commit (the setColumns method used to take a Collection of column paths, it now takes a List). Is there a chance you have 1.4 JARs on your classpath that may be causing the wrong version to be loaded? [~adeneche] He mentioned on the list that it was running in 1.4. > Avro Reader can not read records - Regression > - > > Key: DRILL-4339 > URL: https://issues.apache.org/jira/browse/DRILL-4339 > Project: Apache Drill > Issue Type: Bug > Components: Storage - Other >Affects Versions: 1.5.0 >Reporter: Stefán Baxter >Priority: Blocker > Fix For: 1.5.0 > > > Simple reading of Avro records no longer works > 0: jdbc:drill:zk=local> select * from dfs.asa.`/`; > Exception in thread "drill-executor-2" java.lang.NoSuchMethodError: > org.apache.drill.exec.store.avro.AvroRecordReader.setColumns(Ljava/util/Collection;)V > at > org.apache.drill.exec.store.avro.AvroRecordReader.(AvroRecordReader.java:99) > at > org.apache.drill.exec.store.avro.AvroFormatPlugin.getRecordReader(AvroFormatPlugin.java:73) > at > org.apache.drill.exec.store.dfs.easy.EasyFormatPlugin.getReaderBatch(EasyFormatPlugin.java:172) > at > org.apache.drill.exec.store.dfs.easy.EasyReaderBatchCreator.getBatch(EasyReaderBatchCreator.java:35) > at > org.apache.drill.exec.store.dfs.easy.EasyReaderBatchCreator.getBatch(EasyReaderBatchCreator.java:28) > at > org.apache.drill.exec.physical.impl.ImplCreator.getRecordBatch(ImplCreator.java:147) > at > org.apache.drill.exec.physical.impl.ImplCreator.getChildren(ImplCreator.java:170) > at > org.apache.drill.exec.physical.impl.ImplCreator.getRecordBatch(ImplCreator.java:127) > at > org.apache.drill.exec.physical.impl.ImplCreator.getChildren(ImplCreator.java:170) > at > org.apache.drill.exec.physical.impl.ImplCreator.getRecordBatch(ImplCreator.java:127) > at > org.apache.drill.exec.physical.impl.ImplCreator.getChildren(ImplCreator.java:170) > at > org.apache.drill.exec.physical.impl.ImplCreator.getRootExec(ImplCreator.java:101) > at > org.apache.drill.exec.physical.impl.ImplCreator.getExec(ImplCreator.java:79) > at > org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:230) > at > org.apache.drill.common.SelfCleaningRunnable.run(SelfCleaningRunnable.java:38) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > We have been using the Avro reader for a while and this looks like a > regression. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (DRILL-4339) Avro Reader can not read records - Regression
[ https://issues.apache.org/jira/browse/DRILL-4339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15128576#comment-15128576 ] Deneche A. Hakim commented on DRILL-4339: - [~acmeguy] you confirmed the same query was running fine on 1.4.0, right ? > Avro Reader can not read records - Regression > - > > Key: DRILL-4339 > URL: https://issues.apache.org/jira/browse/DRILL-4339 > Project: Apache Drill > Issue Type: Bug > Components: Storage - Other >Affects Versions: 1.5.0 >Reporter: Stefán Baxter >Priority: Blocker > Fix For: 1.5.0 > > > Simple reading of Avro records no longer works > 0: jdbc:drill:zk=local> select * from dfs.asa.`/`; > Exception in thread "drill-executor-2" java.lang.NoSuchMethodError: > org.apache.drill.exec.store.avro.AvroRecordReader.setColumns(Ljava/util/Collection;)V > at > org.apache.drill.exec.store.avro.AvroRecordReader.(AvroRecordReader.java:99) > at > org.apache.drill.exec.store.avro.AvroFormatPlugin.getRecordReader(AvroFormatPlugin.java:73) > at > org.apache.drill.exec.store.dfs.easy.EasyFormatPlugin.getReaderBatch(EasyFormatPlugin.java:172) > at > org.apache.drill.exec.store.dfs.easy.EasyReaderBatchCreator.getBatch(EasyReaderBatchCreator.java:35) > at > org.apache.drill.exec.store.dfs.easy.EasyReaderBatchCreator.getBatch(EasyReaderBatchCreator.java:28) > at > org.apache.drill.exec.physical.impl.ImplCreator.getRecordBatch(ImplCreator.java:147) > at > org.apache.drill.exec.physical.impl.ImplCreator.getChildren(ImplCreator.java:170) > at > org.apache.drill.exec.physical.impl.ImplCreator.getRecordBatch(ImplCreator.java:127) > at > org.apache.drill.exec.physical.impl.ImplCreator.getChildren(ImplCreator.java:170) > at > org.apache.drill.exec.physical.impl.ImplCreator.getRecordBatch(ImplCreator.java:127) > at > org.apache.drill.exec.physical.impl.ImplCreator.getChildren(ImplCreator.java:170) > at > org.apache.drill.exec.physical.impl.ImplCreator.getRootExec(ImplCreator.java:101) > at > org.apache.drill.exec.physical.impl.ImplCreator.getExec(ImplCreator.java:79) > at > org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:230) > at > org.apache.drill.common.SelfCleaningRunnable.run(SelfCleaningRunnable.java:38) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > We have been using the Avro reader for a while and this looks like a > regression. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
