simple join failing for SQL server.

2016-03-31 Thread Devender Yadav
Hi All, I tried a simple join in two tables in SQL server for testing purpose. Two tables test01 & test02 with same data (just 4 records). Join query: *select t1.num_tiny, t2.num_small from mssql.dbo.`test01` t1 join mssql.dbo.`test02` t2 on t1.num_int = t2.num_int;* *Error: SYSTEM ERROR: Ill

Re: simple join failing for SQL server.

2016-03-31 Thread Devender Yadav
Forgot to add details about Drill. Drill Version - 1.4 OS -Ubuntu 14.0.4 Mode- Embedded Memory -DRILL_MAX_DIRECT_MEMORY="4G" DRILL_HEAP="2G" Regards, Devender On Thu, Mar 31, 2016 at 12:34 PM, Devender Yadav wrote:

Re: simple join failing for SQL server.

2016-03-31 Thread Abdel Hakim Deneche
Hi Devender, Whenever you see such errors, it's Drill's internal memory accounting reporting a memory leak. This is "always" a bug, but you did fix so many of them(*) since 1.4 and we even improved the memory allocator in 1.5. Do you want to try again on the latest version and see if you still see

Re: simple join failing for SQL server.

2016-03-31 Thread Abdel Hakim Deneche
"we" did fix so many of them. =P On Thu, Mar 31, 2016 at 8:12 AM, Abdel Hakim Deneche wrote: > Hi Devender, > > Whenever you see such errors, it's Drill's internal memory accounting > reporting a memory leak. This is "always" a bug, but you did fix so many of > them(*) since 1.4 and we even impr

Re: simple join failing for SQL server.

2016-03-31 Thread Devender Yadav
Yes Abdel. I will try with 1.6 & let you know. Regards, Devender On Thu, Mar 31, 2016 at 12:43 PM, Abdel Hakim Deneche wrote: > "we" did fix so many of them. =P > > On Thu, Mar 31, 2016 at 8:12 AM, Abdel Hakim Deneche < > adene...@maprtech.com> > wrote: > > > Hi Devender, > > > > Whenever you s

Re: simple join failing for SQL server.

2016-03-31 Thread Devender Yadav
Tested same query with Drill 1.5 and 1.6 with no success. Error: SYSTEM ERROR: IllegalStateException: Memory was leaked by query. Memory leaked: (73728) Allocator(op:0:0:3:JdbcSubScan) 100/73728/569344/100 (res/actual/peak/limit) Regards, Devender On Thu, Mar 31, 2016 at 12:45 PM,

Re: simple join failing for SQL server.

2016-03-31 Thread Devender Yadav
I want to add one more observation. If I create a different plugin with same configuration Say my SQL Server plugin name is mssql. I created mssql1 with same configuration and modified query with mssql1 plugin name on 2nd table. *select t1.num_tiny, t2.num_small from mssql.dbo.`test01` t1 join m

Re: simple join failing for SQL server.

2016-03-31 Thread Abdel Hakim Deneche
This is an interesting observation. Can you add it as a comment to DRILL-4398, it may help fix the issue. Thanks On Thu, Mar 31, 2016 at 10:25 AM, Devender Yadav wrote: > I want to add one more observation. > > If I create a different plugin with same configuration > > Say my SQL Server plugin

Re: simple join failing for SQL server.

2016-03-31 Thread Abdel Hakim Deneche
This is a known issue: https://issues.apache.org/jira/browse/DRILL-4398 On Thu, Mar 31, 2016 at 9:33 AM, Devender Yadav wrote: > Tested same query with Drill 1.5 and 1.6 with no success. > > > Error: SYSTEM ERROR: IllegalStateException: Memory was leaked by query. > Memory leaked: (73728) > A

Re: simple join failing for SQL server.

2016-03-31 Thread Devender Yadav
Thanks Abdel. I added comment there. On Thu, Mar 31, 2016 at 3:30 PM, Abdel Hakim Deneche wrote: > This is a known issue: > > https://issues.apache.org/jira/browse/DRILL-4398 > > > > On Thu, Mar 31, 2016 at 9:33 AM, Devender Yadav wrote: > > > Tested same query with Drill 1.5 and 1.6 with no s

RE: How to modify connection timeout delay ?

2016-03-31 Thread COUERON Damien (i-BP - MICROPOLE)
Hi Jason, Thanks for your help. I have set this parameter to 0 on every drillbit and it works like a charm now. Regarding your questions, there was no particular query that triggered this issue. Every query longer than 30 seconds was impacted. Please find below the log messages I received : 20

bootstrap-storage-plugins.json - Missing documentation?

2016-03-31 Thread Peder Jakobsen | gmail
Hi, the documentation mentions that you can load storage plugin configurations at startup. This is good, because every time I reboot, I currently have to manually cut and paste my configuration into the web interface. But, while the documentation references an example of bootstrap-storage-plugins

Re: Understanding the concept of Drill fragment

2016-03-31 Thread Steven Phillips
I am not familiar with the Spark terminology, but I think you more or less have it correct. You example query does not necessarily involve a hash-exchange (roughly the equivalent to a shuffle), because it's possible to run the entire execution in a single fragment. In this case, it would probably

Re: bootstrap-storage-plugins.json - Missing documentation?

2016-03-31 Thread Lee Butts
Hi Peder, The format of bootstrap-storage-plugins.json is slightly different to the json you put in via the web UI. In the example referenced it's setting up the hive storage plugin. The format is { "storage":{ : { type:"", enabled: false, config : } } } However, I