[jira] [Created] (DRILL-6281) Refactor TimedRunnable

[Vlad Rozov (JIRA)]

Vlad Rozov created DRILL-6281:
-

 Summary: Refactor TimedRunnable
 Key: DRILL-6281
 URL: https://issues.apache.org/jira/browse/DRILL-6281
 Project: Apache Drill
  Issue Type: Sub-task
Reporter: Vlad Rozov
Assignee: Vlad Rozov






--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Created] (DRILL-6280) Cleanup execution of BuildTimeScan during maven build

[Vlad Rozov (JIRA)]

Vlad Rozov created DRILL-6280:
-

 Summary: Cleanup execution of BuildTimeScan during maven build
 Key: DRILL-6280
 URL: https://issues.apache.org/jira/browse/DRILL-6280
 Project: Apache Drill
  Issue Type: Improvement
Reporter: Vlad Rozov
Assignee: Vlad Rozov


{{exec:java}} requires {{test}} scope due to dependency on {{logback-classic}}.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Re: Drill Hangout tomorrow at 10 am PST

[Boaz Ben-Zvi]

  Here are the links to the slides presented in the Drill Hangouts today:

Hash Join Spilling Design: 
https://docs.google.com/presentation/d/1uwmq_wwZXGgzXPjYoW-oN5SpJTzkQp9SZRMd_zPtghw/edit#slide=id.p3

Hash Join Memory Calculations: 
https://docs.google.com/presentation/d/1I2W7wL0N2qddrlFXYGNhOnYQqOzMfFKjY9S9AsH6B3s/edit?ts=5ab14eaf#slide=id.p

  Thank you,

   Boaz

On 3/19/18, 1:16 PM, "Boaz Ben-Zvi"  wrote:

 We will have our bi-weekly hangout tomorrow March 20th at 10 am PST.

Please reply to this post with proposed topics to discuss.



If these proposed topics won’t take much time, then the remainder would be 
used to present the design of the Hash-Join Spill; I will describe the basic 
changes, and Tim will talk briefly about the memory calculator used in deciding 
“when to spill”. 

These basic changes to the Hash-Join for spilling are described in the 
design document: 

   
https://urldefense.proofpoint.com/v2/url?u=https-3A__docs.google.com_document_d_1-2Dc-5FoGQY4E5d58qJYv-5Fzc7ka834hSaB3wDQwqKcMoSAI_edit-23heading-3Dh.6wkihnd871vj=DwIGaQ=cskdkSMqhcnjZxdQVpwTXg=EqulKDxxEDCX6zbp1AZAa1-iAPQGgCioAqgDp7DE2BU=OGzUcUS9n9pZ7zMbkeUXfCL9fqX_DFDuwZG_9OXA_B8=zuCTx3B9i23dHLsTca2nzR0pmQD49yrrxiyBWsHZ63A=





   The Hangout link: 

 

   
https://urldefense.proofpoint.com/v2/url?u=https-3A__plus.google.com_hangouts_-5F_event_ci4rdiju8bv04a64efj5fedd0lc=DwIGaQ=cskdkSMqhcnjZxdQVpwTXg=EqulKDxxEDCX6zbp1AZAa1-iAPQGgCioAqgDp7DE2BU=OGzUcUS9n9pZ7zMbkeUXfCL9fqX_DFDuwZG_9OXA_B8=MutN0ei7uja5VbpK0eu8gtITT6iHiwYWbaXgKLZucL8=



   Thank you,



   Boaz

Build failed in Jenkins: drill-scm #948

[Apache Jenkins Server]

See 

Changes:

[vitalii.diravka] DRILL-6241: Saffron properties config has the excessive 
permissions

[vitalii.diravka] DRILL-6250: Sqlline start command with password appears in the

[vitalii.diravka] DRILL-6275: Fixed direct memory reporting in sys.memory.

[vitalii.diravka] DRILL-6199: Add support for filter push down and partition 
pruning with

[vitalii.diravka] DRILL-6145: Implement Hive MapR-DB JSON handler

--
[...truncated 140.51 KB...]
 Downloading: 
http://repository.mapr.com/maven/net/sourceforge/fmpp/fmpp/0.9.14/fmpp-0.9.14.pom
 Downloading: 
http://repo.dremio.com/release/net/sourceforge/fmpp/fmpp/0.9.14/fmpp-0.9.14.pom
 Downloading: 
http://repository.mapr.com/nexus/content/repositories/drill/net/sourceforge/fmpp/fmpp/0.9.14/fmpp-0.9.14.pom
 Downloading: 
https://repo.maven.apache.org/maven2/net/sourceforge/fmpp/fmpp/0.9.14/fmpp-0.9.14.pom
3/3 KB   3/3 KBDownloaded: 
https://repo.maven.apache.org/maven2/net/sourceforge/fmpp/fmpp/0.9.14/fmpp-0.9.14.pom
 (3 KB at 135.3 KB/sec)
Downloading: http://repo.dremio.com/release/oro/oro/maven-metadata.xml
Downloading: http://conjars.org/repo/oro/oro/maven-metadata.xml
Downloading: http://repository.mapr.com/maven/oro/oro/maven-metadata.xml
Downloading: 
http://repository.mapr.com/nexus/content/repositories/drill-optiq/oro/oro/maven-metadata.xml
 Downloading: 
http://repository.mapr.com/nexus/content/repositories/drill/oro/oro/maven-metadata.xml
   Downloading: 
http://repository.apache.org/snapshots/oro/oro/maven-metadata.xml
Downloading: 
https://oss.sonatype.org/content/repositories/snapshots/oro/oro/maven-metadata.xml
Downloading: https://repo.maven.apache.org/maven2/oro/oro/maven-metadata.xml
260/260 B   Downloaded: 
https://repo.maven.apache.org/maven2/oro/oro/maven-metadata.xml (260 B at 13.4 
KB/sec)
Downloading: 
http://conjars.org/repo/org/beanshell/bsh/maven-metadata.xml
Downloading: http://repo.dremio.com/release/org/beanshell/bsh/maven-metadata.xml
Downloading: 
http://repository.mapr.com/maven/org/beanshell/bsh/maven-metadata.xml
Downloading: 
http://repository.mapr.com/nexus/content/repositories/drill-optiq/org/beanshell/bsh/maven-metadata.xml
Downloading: 
http://repository.mapr.com/nexus/content/repositories/drill/org/beanshell/bsh/maven-metadata.xml
Downloading: 
https://oss.sonatype.org/content/repositories/snapshots/org/beanshell/bsh/maven-metadata.xml
Downloading: 
http://repository.apache.org/snapshots/org/beanshell/bsh/maven-metadata.xml
Downloading: 
https://repo.maven.apache.org/maven2/org/beanshell/bsh/maven-metadata.xml
323/323 B   Downloaded: 
https://repo.maven.apache.org/maven2/org/beanshell/bsh/maven-metadata.xml (323 
B at 16.6 KB/sec)
Downloading: 
http://conjars.org/repo/org/beanshell/bsh/2.0b5/bsh-2.0b5.pom
Downloading: 
http://repository.mapr.com/maven/org/beanshell/bsh/2.0b5/bsh-2.0b5.pom
Downloading: 
http://repo.dremio.com/release/org/beanshell/bsh/2.0b5/bsh-2.0b5.pom
Downloading: 
http://repository.mapr.com/nexus/content/repositories/drill/org/beanshell/bsh/2.0b5/bsh-2.0b5.pom
Downloading: 
https://repo.maven.apache.org/maven2/org/beanshell/bsh/2.0b5/bsh-2.0b5.pom
2/2 KB   Downloaded: 
https://repo.maven.apache.org/maven2/org/beanshell/bsh/2.0b5/bsh-2.0b5.pom (2 
KB at 57.5 KB/sec)
Downloading: 
http://conjars.org/repo/xml-resolver/xml-resolver/maven-metadata.xml
Downloading: 
http://repository.mapr.com/nexus/content/repositories/drill-optiq/xml-resolver/xml-resolver/maven-metadata.xml
Downloading: 
http://repository.mapr.com/maven/xml-resolver/xml-resolver/maven-metadata.xml
Downloading: 
http://repo.dremio.com/release/xml-resolver/xml-resolver/maven-metadata.xml
 Downloading: 
http://repository.mapr.com/nexus/content/repositories/drill/xml-resolver/xml-resolver/maven-metadata.xml
   Downloading: 
https://oss.sonatype.org/content/repositories/snapshots/xml-resolver/xml-resolver/maven-metadata.xml
Downloading: 
http://repository.apache.org/snapshots/xml-resolver/xml-resolver/maven-metadata.xml
Downloading: 
https://repo.maven.apache.org/maven2/xml-resolver/xml-resolver/maven-metadata.xml
375/375 B   Downloaded: 
https://repo.maven.apache.org/maven2/xml-resolver/xml-resolver/maven-metadata.xml
 (375 B at 20.3 KB/sec)
Downloading: 
http://conjars.org/repo/org/apache/maven/maven-core/3.3.3/maven-core-3.3.3.jar
Downloading: 
http://conjars.org/repo/org/apache/maven/maven-settings/3.3.3/maven-settings-3.3.3.jar
Downloading: 
http://conjars.org/repo/org/apache/maven/maven-settings-builder/3.3.3/maven-settings-builder-3.3.3.jar
Downloading: 

[GitHub] drill pull request #1174: DRILL-6250: Sqlline start command with password ap...

[asfgit]

Github user asfgit closed the pull request at:

https://github.com/apache/drill/pull/1174


---

[GitHub] drill pull request #1167: DRILL-6241: Saffron properties config has the exce...

[asfgit]

Github user asfgit closed the pull request at:

https://github.com/apache/drill/pull/1167


---

[GitHub] drill pull request #1152: DRILL-6199: Add support for filter push down and p...

[asfgit]

Github user asfgit closed the pull request at:

https://github.com/apache/drill/pull/1152


---

[GitHub] drill pull request #1158: DRILL-6145: Implement Hive MapR-DB JSON handler

[asfgit]

Github user asfgit closed the pull request at:

https://github.com/apache/drill/pull/1158


---

[GitHub] drill pull request #1176: DRILL-6275: Fixed direct memory reporting in sys.m...

[asfgit]

Github user asfgit closed the pull request at:

https://github.com/apache/drill/pull/1176


---

Issue with order by clause for custom StoragePlugin

[Ryan Shanks]

Hi!

I am trying to learn how to write a custom StoragePlugin. My 
StoragePlugin currently takes 3 parameters: the type name, a file name 
and if its enabled. The file contains a schema describing my data 
source, which currently is just an xml file with test values while I 
learn more. Currently I have my plugin able to execute basic queries, 
but it fails when I try an "ORDER BY" clause. I was hoping someone might 
be able to provide some insight into why this might be or maybe point me 
in the right direction. I am not sure what information is helpful for 
determining the issue so please let me know what I can provide if the 
below is not enough.


This works:

SELECT loginName FROM test1.`Users`;

But this does not work:

SELECT loginName FROM test1.`Users` ORDER BY loginName;


Below is the error I obtain with the order by query:

org.apache.drill.common.exceptions.UserException: SYSTEM ERROR: 
ExpressionParsingException: Expression has syntax error! line 1:0:no 
viable alternative at input '{'


Fragment 3:0

[Error Id: eba80b35-d8b8-483c-ab03-726c135cc7f2 on ubuntu:31010]
    at 
org.apache.drill.common.exceptions.UserException$Builder.build(UserException.java:586) 
~[drill-common-1.12.0.jar:1.12.0]
    at 
org.apache.drill.exec.work.fragment.FragmentExecutor.sendFinalState(FragmentExecutor.java:301) 
[drill-java-exec-1.12.0.jar:1.12.0]
    at 
org.apache.drill.exec.work.fragment.FragmentExecutor.cleanup(FragmentExecutor.java:160) 
[drill-java-exec-1.12.0.jar:1.12.0]
    at 
org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:267) 
[drill-java-exec-1.12.0.jar:1.12.0]
    at 
org.apache.drill.common.SelfCleaningRunnable.run(SelfCleaningRunnable.java:38) 
[drill-common-1.12.0.jar:1.12.0]
    at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) 
[na:1.8.0_161]
    at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) 
[na:1.8.0_161]

    at java.lang.Thread.run(Thread.java:748) [na:1.8.0_161]
Caused by: com.fasterxml.jackson.databind.JsonMappingException: 
Expression has syntax error! line 1:0:no viable alternative at input '{' 
(through reference chain: 
org.apache.drill.exec.physical.config.SingleSender["child"]->org.apache.drill.exec.physical.config.Project["child"]->org.apache.drill.rest.storage.plugin.RestSubScan["columns"]->java.util.ArrayList[0])
    at 
com.fasterxml.jackson.databind.JsonMappingException.wrapWithPath(JsonMappingException.java:379) 
~[jackson-databind-2.7.9.1.jar:2.7.9.1]
    at 
com.fasterxml.jackson.databind.JsonMappingException.wrapWithPath(JsonMappingException.java:351) 
~[jackson-databind-2.7.9.1.jar:2.7.9.1]
    at 
com.fasterxml.jackson.databind.deser.std.CollectionDeserializer.deserialize(CollectionDeserializer.java:308) 
~[jackson-databind-2.7.9.1.jar:2.7.9.1]
    at 
com.fasterxml.jackson.databind.deser.std.CollectionDeserializer.deserialize(CollectionDeserializer.java:259) 
~[jackson-databind-2.7.9.1.jar:2.7.9.1]
    at 
com.fasterxml.jackson.databind.deser.std.CollectionDeserializer.deserialize(CollectionDeserializer.java:26) 
~[jackson-databind-2.7.9.1.jar:2.7.9.1]
    at 
com.fasterxml.jackson.databind.deser.SettableBeanProperty.deserialize(SettableBeanProperty.java:495) 
~[jackson-databind-2.7.9.1.jar:2.7.9.1]
    at 
com.fasterxml.jackson.databind.deser.BeanDeserializer._deserializeWithErrorWrapping(BeanDeserializer.java:465) 
~[jackson-databind-2.7.9.1.jar:2.7.9.1]
    at 
com.fasterxml.jackson.databind.deser.BeanDeserializer._deserializeUsingPropertyBased(BeanDeserializer.java:384) 
~[jackson-databind-2.7.9.1.jar:2.7.9.1]
    at 
com.fasterxml.jackson.databind.deser.BeanDeserializerBase.deserializeFromObjectUsingNonDefault(BeanDeserializerBase.java:1127) 
~[jackson-databind-2.7.9.1.jar:2.7.9.1]
    at 
com.fasterxml.jackson.databind.deser.BeanDeserializer.deserializeFromObject(BeanDeserializer.java:298) 
~[jackson-databind-2.7.9.1.jar:2.7.9.1]
    at 
com.fasterxml.jackson.databind.deser.BeanDeserializerBase.deserializeWithObjectId(BeanDeserializerBase.java:1098) 
~[jackson-databind-2.7.9.1.jar:2.7.9.1]
    at 
com.fasterxml.jackson.databind.deser.BeanDeserializer._deserializeOther(BeanDeserializer.java:166) 
~[jackson-databind-2.7.9.1.jar:2.7.9.1]
    at 
com.fasterxml.jackson.databind.deser.BeanDeserializer.deserialize(BeanDeserializer.java:135) 
~[jackson-databind-2.7.9.1.jar:2.7.9.1]
    at 
com.fasterxml.jackson.databind.jsontype.impl.AsPropertyTypeDeserializer._deserializeTypedForId(AsPropertyTypeDeserializer.java:120) 
~[jackson-databind-2.7.9.1.jar:2.7.9.1]
    at 
com.fasterxml.jackson.databind.jsontype.impl.AsPropertyTypeDeserializer.deserializeTypedFromObject(AsPropertyTypeDeserializer.java:91) 
~[jackson-databind-2.7.9.1.jar:2.7.9.1]
    at 
com.fasterxml.jackson.databind.deser.AbstractDeserializer.deserializeWithType(AbstractDeserializer.java:142) 
~[jackson-databind-2.7.9.1.jar:2.7.9.1]
    at 

[GitHub] drill issue #1152: DRILL-6199: Add support for filter push down and partitio...

[vdiravka]

Github user vdiravka commented on the issue:

https://github.com/apache/drill/pull/1152
  
+1


---

[jira] [Created] (DRILL-6279) Web UI should indicate when operators have spilled in-memory data to disk

[Kunal Khatua (JIRA)]

Kunal Khatua created DRILL-6279:
---

 Summary: Web UI should indicate when operators have spilled 
in-memory data to disk
 Key: DRILL-6279
 URL: https://issues.apache.org/jira/browse/DRILL-6279
 Project: Apache Drill
  Issue Type: Improvement
Affects Versions: 1.13.0
Reporter: Kunal Khatua
Assignee: Kunal Khatua
 Fix For: 1.14.0


Currently, there is no indication of when an operator is spilling to disk, 
which would help explain a slow running query. 
Suggestions are welcome, but the current proposal is to simply update the 
Operators Overview section to show average and max spill cycles, preferrably, 
with a color code (or formatting).  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Created] (DRILL-6278) DRILL-5993 Made Debugging Generated Code Harder

[Timothy Farkas (JIRA)]

Timothy Farkas created DRILL-6278:
-

 Summary: DRILL-5993 Made Debugging Generated Code Harder
 Key: DRILL-6278
 URL: https://issues.apache.org/jira/browse/DRILL-6278
 Project: Apache Drill
  Issue Type: Bug
Reporter: Timothy Farkas
Assignee: Timothy Farkas


DRILL-5993 made debugging generated code more difficult since it stored 
generated code in unique directories in target. This required adding possibly 
many tmp directories as source folders in order to be able to set break points 
in generated code for different tests. This change should be reverted to store 
generated code in the original default /tmp/drill/codegen directory.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Created] (DRILL-6277) Query fails with DATA_READ ERROR when correlated subquery has "always false" filter

[Volodymyr Vysotskyi (JIRA)]

Volodymyr Vysotskyi created DRILL-6277:
--

 Summary: Query fails with DATA_READ ERROR when correlated subquery 
has "always false" filter
 Key: DRILL-6277
 URL: https://issues.apache.org/jira/browse/DRILL-6277
 Project: Apache Drill
  Issue Type: Bug
Affects Versions: 1.13.0
Reporter: Volodymyr Vysotskyi
Assignee: Volodymyr Vysotskyi
 Fix For: 1.14.0


Query with correlated subquery which contains "always false" filter fails:
{noformat}
select * from cp.`employee.json` t where exists(select employee_id from 
cp.`employee.json` where t.employee_id = 3 and 1 = 5);
Error: DATA_READ ERROR: The top level of your document must either be a single 
array of maps or a set of white space delimited maps.

Line  -1
Column  0
Field  
Fragment 0:0

[Error Id: 66b38c7e-7d12-4f38-93e4-f97f08f55e93 on user515050-pc:31013] 
(state=,code=0)
{noformat}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Drill and orc file support

[Андрей Смирнов]

Hello!

Please, help me

Does drill can read from orc format files ( orc.apache.org ) ?

Re: [ANNOUNCE] Apache Drill release 1.13.0

[sebb]

What is the project about? Why should I be interested in it?
[rhetorical questions]

The Announce emails are sent to people not on the developer or user lists.
Most will have no idea what the project is about.

So the e-mails should contain at least brief details of what the
product does, and some info on why the new release might be of
interest to them.

Readers should not have to click the link to find out the basic information
(although of course it is useful to have such links for further detail).

Please can you add that information to future announce mails?

Thanks.


On 20 March 2018 at 05:22, Parth Chandra  wrote:
> On behalf of the Apache Drill community, I am happy to announce the release
> of Apache Drill 1.13.0.
>
> For information about Apache Drill, and to get involved, visit the project
> website [1].
>
> This release of Drill provides the following new features and improvements:
>
> - YARN support for Drill [DRILL-1170]
>
> - Support HTTP Kerberos auth using SPNEGO [DRILL-5425]
>
> - Support SQL syntax highlighting of queries [DRILL-5868]
>
> - Drill should support user/distribution specific configuration checks
> during startup [DRILL-6068]
>
> - Upgrade DRILL to Calcite 1.15.0 [DRILL-5966]
>
> - Batch Sizing improvements to reduce memory footprint of operators
>
> - [DRILL-6071] - Limit batch size for flatten operator
>
> - [DRILL-6126] - Allocate memory for value vectors upfront in
> flatten operator
>
> - [DRILL-6123] - Limit batch size for Merge Join based on
> memory.
>
> - [DRILL-6177] - Merge Join - Allocate memory for outgoing value
> vectors based on sizes of incoming batches.
>
>
> For the full list please see release notes [2].
>
> The binary and source artifacts are available here [3].
>
> Thanks to everyone in the community who contributed to this release!
>
> 1. https://drill.apache.org/
> 2. https://drill.apache.org/docs/apache-drill-1-13-0-release-notes/
> 3. https://drill.apache.org/download/
>
>

Re: [Drill 1.13.0] : org.apache.thrift.TApplicationException: Invalid method name: 'get_table_req'

[Anup Tiwari]

Note :  Using Show databases, i can see hive schemas.  





On Tue, Mar 20, 2018 2:36 PM, Anup Tiwari anup.tiw...@games24x7.com  wrote:
Hi,
I am not able to read my hive tables in drill 1.13.0 and with same plugin conf
it was working in Drill 1.12.0 and 1.10.0. Please look into it asap and let me
know if i have missed anything.
Hive Plugin :-
{  "type": "hive",  "enabled": true,  "configProps": {"hive.metastore.uris":
"thrift://prod-hadoop-1xx.com:9083","hive.metastore.sasl.enabled": "false",
"fs.default.name": "hdfs://prod-hadoop-1xx.com:9000"  }}
Query :-
select id from hive.cad where log_date = '2018-03-18' limit 3
Error :-
2018-03-20 14:25:27,351 [254f337f-9ac3-b66f-ed17-1de459da3283:foreman] INFO
o.a.drill.exec.work.foreman.Foreman - Query text for query id
254f337f-9ac3-b66f-ed17-1de459da3283: select id from hive.cad where log_date =
'2018-03-18' limit 32018-03-20 14:25:27,354
[254f337f-9ac3-b66f-ed17-1de459da3283:foreman] WARN
o.a.d.e.s.h.DrillHiveMetaStoreClient - Failure while attempting to get hive
table. Retries once.org.apache.thrift.TApplicationException: Invalid method
name: 'get_table_req' at
org.apache.thrift.TApplicationException.read(TApplicationException.java:111)
~[drill-hive-exec-shaded-1.13.0.jar:1.13.0] at
org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:79)
~[drill-hive-exec-shaded-1.13.0.jar:1.13.0] at
org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.recv_get_table_req(ThriftHiveMetastore.java:1563)
~[drill-hive-exec-shaded-1.13.0.jar:1.13.0] at
org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.get_table_req(ThriftHiveMetastore.java:1550)
~[drill-hive-exec-shaded-1.13.0.jar:1.13.0] at
org.apache.hadoop.hive.metastore.HiveMetaStoreClient.getTable(HiveMetaStoreClient.java:1344)
~[drill-hive-exec-shaded-1.13.0.jar:1.13.0] at
org.apache.drill.exec.store.hive.DrillHiveMetaStoreClient.getHiveReadEntryHelper(DrillHiveMetaStoreClient.java:285)
~[drill-storage-hive-core-1.13.0.jar:1.13.0] at
org.apache.drill.exec.store.hive.DrillHiveMetaStoreClient$TableLoader.load(DrillHiveMetaStoreClient.java:535)
[drill-storage-hive-core-1.13.0.jar:1.13.0] at
org.apache.drill.exec.store.hive.DrillHiveMetaStoreClient$TableLoader.load(DrillHiveMetaStoreClient.java:531)
[drill-storage-hive-core-1.13.0.jar:1.13.0] at
com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3527)
[guava-18.0.jar:na] at
com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2319)
[guava-18.0.jar:na] at
com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2282)
[guava-18.0.jar:na] at
com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2197)
[guava-18.0.jar:na] at
com.google.common.cache.LocalCache.get(LocalCache.java:3937) [guava-18.0.jar:na]
 at com.google.common.cache.LocalCache.getOrLoad(LocalCache.java:3941)
[guava-18.0.jar:na] at
com.google.common.cache.LocalCache$LocalLoadingCache.get(LocalCache.java:4824)
[guava-18.0.jar:na] at
org.apache.drill.exec.store.hive.DrillHiveMetaStoreClient$HiveClientWithCaching.getHiveReadEntry(DrillHiveMetaStoreClient.java:495)
[drill-storage-hive-core-1.13.0.jar:1.13.0] at
org.apache.drill.exec.store.hive.schema.HiveSchemaFactory$HiveSchema.getSelectionBaseOnName(HiveSchemaFactory.java:233)
[drill-storage-hive-core-1.13.0.jar:1.13.0] at
org.apache.drill.exec.store.hive.schema.HiveSchemaFactory$HiveSchema.getDrillTable(HiveSchemaFactory.java:213)
[drill-storage-hive-core-1.13.0.jar:1.13.0] at
org.apache.drill.exec.store.hive.schema.HiveDatabaseSchema.getTable(HiveDatabaseSchema.java:62)
[drill-storage-hive-core-1.13.0.jar:1.13.0] at
org.apache.drill.exec.store.hive.schema.HiveSchemaFactory$HiveSchema.getTable(HiveSchemaFactory.java:201)
[drill-storage-hive-core-1.13.0.jar:1.13.0] at
org.apache.calcite.jdbc.SimpleCalciteSchema.getImplicitTable(SimpleCalciteSchema.java:82)
[calcite-core-1.15.0-drill-r0.jar:1.15.0-drill-r0] at
org.apache.calcite.jdbc.CalciteSchema.getTable(CalciteSchema.java:257)
[calcite-core-1.15.0-drill-r0.jar:1.15.0-drill-r0] at
org.apache.calcite.sql.validate.SqlValidatorUtil.getTableEntryFrom(SqlValidatorUtil.java:1003)
[calcite-core-1.15.0-drill-r0.jar:1.15.0-drill-r0] at
org.apache.calcite.sql.validate.SqlValidatorUtil.getTableEntry(SqlValidatorUtil.java:960)
[calcite-core-1.15.0-drill-r0.jar:1.15.0-drill-r0] at
org.apache.calcite.prepare.CalciteCatalogReader.getTable(CalciteCatalogReader.java:117)
[calcite-core-1.15.0-drill-r0.jar:1.15.0-drill-r0] at
org.apache.drill.exec.planner.sql.SqlConverter$DrillCalciteCatalogReader.getTable(SqlConverter.java:633)
[drill-java-exec-1.13.0.jar:1.13.0] at
org.apache.drill.exec.planner.sql.SqlConverter$DrillValidator.validateFrom(SqlConverter.java:261)
[drill-java-exec-1.13.0.jar:1.13.0] at
org.apache.calcite.sql.validate.SqlValidatorImpl.validateSelect(SqlValidatorImpl.java:3216)
[calcite-core-1.15.0-drill-r0.jar:1.15.0-drill-r0] at

[Drill 1.13.0] : org.apache.thrift.TApplicationException: Invalid method name: 'get_table_req'

[Anup Tiwari]

Hi,
I am not able to read my hive tables in drill 1.13.0 and with same plugin conf
it was working in Drill 1.12.0 and 1.10.0. Please look into it asap and let me
know if i have missed anything.
Hive Plugin :-
{  "type": "hive",  "enabled": true,  "configProps": {"hive.metastore.uris":
"thrift://prod-hadoop-1xx.com:9083","hive.metastore.sasl.enabled": "false",
"fs.default.name": "hdfs://prod-hadoop-1xx.com:9000"  }}
Query :-
select id from hive.cad where log_date = '2018-03-18' limit 3
Error :-
2018-03-20 14:25:27,351 [254f337f-9ac3-b66f-ed17-1de459da3283:foreman] INFO
o.a.drill.exec.work.foreman.Foreman - Query text for query id
254f337f-9ac3-b66f-ed17-1de459da3283: select id from hive.cad where log_date =
'2018-03-18' limit 32018-03-20 14:25:27,354
[254f337f-9ac3-b66f-ed17-1de459da3283:foreman] WARN
o.a.d.e.s.h.DrillHiveMetaStoreClient - Failure while attempting to get hive
table. Retries once.org.apache.thrift.TApplicationException: Invalid method
name: 'get_table_req' at
org.apache.thrift.TApplicationException.read(TApplicationException.java:111)
~[drill-hive-exec-shaded-1.13.0.jar:1.13.0] at
org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:79)
~[drill-hive-exec-shaded-1.13.0.jar:1.13.0] at
org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.recv_get_table_req(ThriftHiveMetastore.java:1563)
~[drill-hive-exec-shaded-1.13.0.jar:1.13.0] at
org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.get_table_req(ThriftHiveMetastore.java:1550)
~[drill-hive-exec-shaded-1.13.0.jar:1.13.0] at
org.apache.hadoop.hive.metastore.HiveMetaStoreClient.getTable(HiveMetaStoreClient.java:1344)
~[drill-hive-exec-shaded-1.13.0.jar:1.13.0] at
org.apache.drill.exec.store.hive.DrillHiveMetaStoreClient.getHiveReadEntryHelper(DrillHiveMetaStoreClient.java:285)
~[drill-storage-hive-core-1.13.0.jar:1.13.0] at
org.apache.drill.exec.store.hive.DrillHiveMetaStoreClient$TableLoader.load(DrillHiveMetaStoreClient.java:535)
[drill-storage-hive-core-1.13.0.jar:1.13.0] at
org.apache.drill.exec.store.hive.DrillHiveMetaStoreClient$TableLoader.load(DrillHiveMetaStoreClient.java:531)
[drill-storage-hive-core-1.13.0.jar:1.13.0] at
com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3527)
[guava-18.0.jar:na] at
com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2319)
[guava-18.0.jar:na] at
com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2282)
[guava-18.0.jar:na] at
com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2197)
[guava-18.0.jar:na] at
com.google.common.cache.LocalCache.get(LocalCache.java:3937) [guava-18.0.jar:na]
 at com.google.common.cache.LocalCache.getOrLoad(LocalCache.java:3941)
[guava-18.0.jar:na] at
com.google.common.cache.LocalCache$LocalLoadingCache.get(LocalCache.java:4824)
[guava-18.0.jar:na] at
org.apache.drill.exec.store.hive.DrillHiveMetaStoreClient$HiveClientWithCaching.getHiveReadEntry(DrillHiveMetaStoreClient.java:495)
[drill-storage-hive-core-1.13.0.jar:1.13.0] at
org.apache.drill.exec.store.hive.schema.HiveSchemaFactory$HiveSchema.getSelectionBaseOnName(HiveSchemaFactory.java:233)
[drill-storage-hive-core-1.13.0.jar:1.13.0] at
org.apache.drill.exec.store.hive.schema.HiveSchemaFactory$HiveSchema.getDrillTable(HiveSchemaFactory.java:213)
[drill-storage-hive-core-1.13.0.jar:1.13.0] at
org.apache.drill.exec.store.hive.schema.HiveDatabaseSchema.getTable(HiveDatabaseSchema.java:62)
[drill-storage-hive-core-1.13.0.jar:1.13.0] at
org.apache.drill.exec.store.hive.schema.HiveSchemaFactory$HiveSchema.getTable(HiveSchemaFactory.java:201)
[drill-storage-hive-core-1.13.0.jar:1.13.0] at
org.apache.calcite.jdbc.SimpleCalciteSchema.getImplicitTable(SimpleCalciteSchema.java:82)
[calcite-core-1.15.0-drill-r0.jar:1.15.0-drill-r0] at
org.apache.calcite.jdbc.CalciteSchema.getTable(CalciteSchema.java:257)
[calcite-core-1.15.0-drill-r0.jar:1.15.0-drill-r0] at
org.apache.calcite.sql.validate.SqlValidatorUtil.getTableEntryFrom(SqlValidatorUtil.java:1003)
[calcite-core-1.15.0-drill-r0.jar:1.15.0-drill-r0] at
org.apache.calcite.sql.validate.SqlValidatorUtil.getTableEntry(SqlValidatorUtil.java:960)
[calcite-core-1.15.0-drill-r0.jar:1.15.0-drill-r0] at
org.apache.calcite.prepare.CalciteCatalogReader.getTable(CalciteCatalogReader.java:117)
[calcite-core-1.15.0-drill-r0.jar:1.15.0-drill-r0] at
org.apache.drill.exec.planner.sql.SqlConverter$DrillCalciteCatalogReader.getTable(SqlConverter.java:633)
[drill-java-exec-1.13.0.jar:1.13.0] at
org.apache.drill.exec.planner.sql.SqlConverter$DrillValidator.validateFrom(SqlConverter.java:261)
[drill-java-exec-1.13.0.jar:1.13.0] at
org.apache.calcite.sql.validate.SqlValidatorImpl.validateSelect(SqlValidatorImpl.java:3216)
[calcite-core-1.15.0-drill-r0.jar:1.15.0-drill-r0] at
org.apache.calcite.sql.validate.SelectNamespace.validateImpl(SelectNamespace.java:60)
[calcite-core-1.15.0-drill-r0.jar:1.15.0-drill-r0] at

[GitHub] drill issue #1158: DRILL-6145: Implement Hive MapR-DB JSON handler

[arina-ielchiieva]

Github user arina-ielchiieva commented on the issue:

https://github.com/apache/drill/pull/1158
  
+1


---