RE: Parquet Predicate Push down not working

2020-04-29 Thread Jaimes, Rafael - 0993 - MITLL
Hi Navin, I don’t think inline screenshots work on the mailing list so they are not showing up for me. I don’t think you have to do anything in Drill 1.17 to enable predicate pushdown for Parquet. 1 GB total dataset is really small. If that’s spread across multiple parquet files the row

RE: java version for Drill JDBC driver

2020-04-12 Thread Jaimes, Rafael - 0993 - MITLL
JIRA will do and tag me in it. -- C > On Apr 9, 2020, at 4:07 PM, Jaimes, Rafael - 0993 - MITLL > wrote: > > One of my coworkers looked at the pom.xml in /exec/jdbc and noticed there was > a version of javax.validation being called in about 7 years old (1.1.0.Final) > Re

RE: java version for Drill JDBC driver

2020-04-09 Thread Jaimes, Rafael - 0993 - MITLL
t of JDBC dependencies is somehow conflicting with those in Presto? Thanks, - Paul On Thursday, April 9, 2020, 8:55:37 AM PDT, Bob Rudis wrote: I use the JDBC driver via an RJDBC wrapper I wrote and the rJava it runs in is built with JDK 11, so it definitely is working in 11 for me

RE: Drill embedded mode on Linux

2020-04-09 Thread Jaimes, Rafael - 0993 - MITLL
ck reply. > >> Below is Java version screenshot. As per documentation this is correct. > >> [image: image.png] > >> > >> Below is screenshot of java path. this is also correct. But still > >> same error > >> [image: image.png] > >> >

java version for Drill JDBC driver

2020-04-09 Thread Jaimes, Rafael - 0993 - MITLL
On the topic of java versions, I am trying to load the Drill JDBC driver in a docker container running Presto and Java 11, I'm getting the following error: ERROR main io.prestosql.server.PrestoServer 'java.lang.String javax.validation.BootstrapConfiguration.getClockProviderClassName()' java.lan

RE: Drill embedded mode on Linux

2020-04-09 Thread Jaimes, Rafael - 0993 - MITLL
The error tells you that it's not finding a Java 1.8 JDK. You can use OpenJDK 1.8 for the job. I would check: 1) your java version (both version # and whether it is a JDK, not a JRE) 2) your java path env vars -Original Message- From: Prabhakar Bhosaale Sent: Thursday, April 9, 2020 9:29

RE: REST data source?

2020-04-02 Thread Jaimes, Rafael - 0993 - MITLL
een, in Let me know if you have any questions or if additional testing would help. Thanks, Rafael -Original Message----- From: Jaimes, Rafael - 0993 - MITLL Sent: Wednesday, April 1, 2020 12:43 PM To: user@drill.apache.org Subject: RE: REST data source? Yes that's correct. I saw the work

query Presto via Drill

2020-04-01 Thread Jaimes, Rafael - 0993 - MITLL
As a proof of concept, I thought it might be interesting to see if Drill could query Presto as if it were a RDBMS. In theory, I thought it would work because it uses a JDBC driver. I plopped it into 3rdparty and setup the config (see bottom) and it saves without error. However it doesn't show up i

RE: REST data source?

2020-04-01 Thread Jaimes, Rafael - 0993 - MITLL
r the feedback. My original idea was to pull the proxy from the environment vars in HTTP_PROXY/HtTTPS_PROXY and ALL_PROXY but that part isn't quite done yet. Did you set the proxy info via the plugin config? -- C > On Apr 1, 2020, at 10:22 AM, Jaimes, Rafael - 0993 - MITLL wrote: >

RE: REST data source?

2020-04-01 Thread Jaimes, Rafael - 0993 - MITLL
Hi all, I built Charles' latest branch including the proxy setup. It appears to be working quite well going through the proxy. I'll continue to test and report back if I find any issues. Note: Beyond Paul's repo recommendations, I had to skip checkstyle to get the maven build to complete. You'

RE: REST data source?

2020-03-31 Thread Jaimes, Rafael - 0993 - MITLL
he one you got. Still, worth a try. Thanks, - Paul [1] https://github.com/paul-rogers/drill/wiki/Build-Drill-in-a-Corporate-Environment On Tuesday, March 31, 2020, 12:21:42 PM PDT, Jaimes, Rafael - 0993 - MITLL wrote: Hi Paul, I tried that (even tried a vanilla build before on its

RE: REST data source?

2020-03-31 Thread Jaimes, Rafael - 0993 - MITLL
nt to the PR for the plugin (https://github.com/apache/drill/pull/1892 <https://github.com/apache/drill/pull/1892>) with some explanation of what you need? Thanks, -- C > On Mar 31, 2020, at 3:21 PM, Jaimes, Rafael - 0993 - MITLL > wrote: > > Hi Paul, > > I tried that (

RE: REST data source?

2020-03-31 Thread Jaimes, Rafael - 0993 - MITLL
gin included. There are other ways that also work; the above may be the simplest. Thanks, - Paul On Tuesday, March 31, 2020, 10:51:18 AM PDT, Jaimes, Rafael - 0993 - MITLL wrote: Hi Charles, (1./2.) I have not been able to build Drill, from either a full clone of your tagged h

RE: REST data source?

2020-03-31 Thread Jaimes, Rafael - 0993 - MITLL
ry that is not in the contrib/ folder. Removing this dependency is being discussed. -- C > On Mar 31, 2020, at 1:51 PM, Jaimes, Rafael - 0993 - MITLL > wrote: > > Hi Charles, > > (1./2.) > I have not been able to build Drill, from either a full clone of your tagged &g

RE: REST data source?

2020-03-31 Thread Jaimes, Rafael - 0993 - MITLL
use that. -- C > On Mar 31, 2020, at 12:57 PM, Jaimes, Rafael - 0993 - MITLL > wrote: > > Hi Charles, > > I am trying to use the http-storage plugin from your branch. I put the > storage plug-in files in a jar and tried to keep the jar directory structure > the same a

Re: REST data source?

2020-03-31 Thread Jaimes, Rafael - 0993 - MITLL
Hi Charles, I am trying to use the http-storage plugin from your branch. I put the storage plug-in files in a jar and tried to keep the jar directory structure the same as other plug-ins. Upon starting drill-embedded I'm getting the error below. I am using your drill-module.conf and bootstrap-

RE: REST data source?

2020-03-24 Thread Jaimes, Rafael - 0993 - MITLL
Thank you so much. I apologize, looks like someone asked a similar question right after I checked the archives yesterday. This looks great. - Rafael From: Charles Givre Sent: Tuesday, March 24, 2020 10:14 AM To: user@drill.apache.org Cc: Jaimes, Rafael - 0993 - MITLL Subject: Re

scaling drill in an openshift (K8s) cluster

2020-03-24 Thread Jaimes, Rafael - 0993 - MITLL
I'm seeing a problem with scaling the number of pod instances in the replication controller because they aren't reporting their hostnames properly. This was a common problem that got fixed in scalable architectures like ZooKeeper and Kafka (see reference at bottom I think this was related). In

REST data source?

2020-03-24 Thread Jaimes, Rafael - 0993 - MITLL
I know you can use REST API to query against Drill, but can Drill make REST queries itself? It might seem unnecessary but if the idea is one stop shop for all querying, I don't see how it's different than using SQL against Drill which then queries against a RDBMS using SQL. Thanks in advanc

drill 1.16 to 1.17 error with ODBC

2020-02-05 Thread Jaimes, Rafael - 0993 - MITLL
I had Drill 1.16 running in embedded mode and it was running without error. After just switching to the 1.17 tarball and running in embedded mode, I seem to get these warnings after running queries using ODBC and Python (always 4 of them, exact same message): [libprotobuf ERROR google/protobu