[GitHub] drill pull request:

Github user StevenMPhillips commented on the pull request: https://github.com/apache/drill/commit/728d6e6b12eec11d52e9f106deecaf311ebd7958#commitcomment-13556275 I think this will create problems with impersonation. I will need to rethink this. --- If your project is set up for it,

[GitHub] drill pull request: Parquet meta

GitHub user StevenMPhillips opened a pull request: https://github.com/apache/drill/pull/186 Parquet meta You can merge this pull request into a Git repository by running: $ git pull https://github.com/StevenMPhillips/drill parquet_meta Alternatively you can review and apply t

[GitHub] drill pull request: DRILL-1065: Support for ALTER ... RESET statem...

Github user asfgit closed the pull request at: https://github.com/apache/drill/pull/159 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[GitHub] drill pull request: DRILL-3874: flattening large JSON objects uses...

Github user cwestin commented on the pull request: https://github.com/apache/drill/pull/181#issuecomment-144898125 Parth: Re ObjectVector: I don't know what that's for. I just followed the pattern: getBufferSize() already throws that exception. Re OUTPUT_MEMORY_LIMIT: what do y

Re: Timing for 1.2 release, ideas around things to include

DRILL-1065 is ready to be merged, I'm running the final unit tests right now. How about we set the cutoff to tomorrow 5pm pacific time ? any patch that isn't in master by then won't be part of 1.2 ? On Thu, Oct 1, 2015 at 6:35 PM, Jacques Nadeau wrote: > We went through the list. I propose that

Re: Timing for 1.2 release, ideas around things to include

DRILL-3874: Flattening large JSON objects uses too much direct memory. (This one is nearly ready to merge) On Thu, Oct 1, 2015 at 6:35 PM, Jacques Nadeau wrote: > We went through the list. I propose that we include only the following > issues in 1.2 and move the rest to 1.3 > > DRILL-1065 Prov

[GitHub] drill pull request: DRILL-3874: flattening large JSON objects uses...

Github user parthchandra commented on the pull request: https://github.com/apache/drill/pull/181#issuecomment-144897173 Looks good. +1. Some minor comments in line --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If yo

Re: Timing for 1.2 release, ideas around things to include

We went through the list. I propose that we include only the following issues in 1.2 and move the rest to 1.3 DRILL-1065 Provide a reset command to reset an option to its default value DRILL-3884 Hive native scan has lower parallelization leading to performance degradation DRILL-2879 Add Remaining

[jira] [Created] (DRILL-3887) Parquet metadata cache not being used

Steven Phillips created DRILL-3887: -- Summary: Parquet metadata cache not being used Key: DRILL-3887 URL: https://issues.apache.org/jira/browse/DRILL-3887 Project: Apache Drill Issue Type: Bu

[GitHub] drill pull request: DRILL-3874: flattening large JSON objects uses...

Github user cwestin commented on a diff in the pull request: https://github.com/apache/drill/pull/181#discussion_r40985372 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/vector/complex/BaseRepeatedValueVector.java --- @@ -123,6 +123,15 @@ public int getBufferSize() {

[jira] [Created] (DRILL-3886) Range query over HBase table from Drill returns no results

Khurram Faraaz created DRILL-3886: - Summary: Range query over HBase table from Drill returns no results Key: DRILL-3886 URL: https://issues.apache.org/jira/browse/DRILL-3886 Project: Apache Drill

Re: Timing for 1.2 release, ideas around things to include

I'm on: https://plus.google.com/hangouts/_/event/ci4rdiju8bv04a64efj5fedd0lc -- Jacques Nadeau CTO and Co-Founder, Dremio On Thu, Oct 1, 2015 at 5:45 PM, Jacques Nadeau wrote: > How about now? > > > > -- > Jacques Nadeau > CTO and Co-Founder, Dremio > > On Thu, Oct 1, 2015 at 5:38 PM, Parth Ch

Re: Timing for 1.2 release, ideas around things to include

How about now? -- Jacques Nadeau CTO and Co-Founder, Dremio On Thu, Oct 1, 2015 at 5:38 PM, Parth Chandra wrote: > What time do you want the hangout? I'm in favour of bumping if we cannot > get decided by tomorrow. > > > > On Thu, Oct 1, 2015 at 2:05 PM, Jacques Nadeau wrote: > > > On Thu, O

Re: Timing for 1.2 release, ideas around things to include

What time do you want the hangout? I'm in favour of bumping if we cannot get decided by tomorrow. On Thu, Oct 1, 2015 at 2:05 PM, Jacques Nadeau wrote: > On Thu, Oct 1, 2015 at 11:17 AM, Abdel Hakim Deneche < > adene...@maprtech.com> > wrote: > > > I can manage the release. > > > > Great! I u

[GitHub] drill pull request: DRILL-3884: Fix lower parallelization issues w...

Github user amansinha100 commented on the pull request: https://github.com/apache/drill/pull/185#issuecomment-144884113 +1 LGTM. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] drill pull request: DRILL-3884: Fix lower parallelization issues w...

Github user vkorukanti commented on a diff in the pull request: https://github.com/apache/drill/pull/185#discussion_r40982402 --- Diff: contrib/storage-hive/core/src/main/java/org/apache/drill/exec/store/hive/HiveScan.java --- @@ -319,16 +319,12 @@ public ScanStats getScanStats()

[GitHub] drill pull request: DRILL-3884: Fix lower parallelization issues w...

Github user amansinha100 commented on a diff in the pull request: https://github.com/apache/drill/pull/185#discussion_r40981727 --- Diff: contrib/storage-hive/core/src/main/java/org/apache/drill/exec/store/hive/HiveScan.java --- @@ -319,16 +319,12 @@ public ScanStats getScanStats(

[jira] [Created] (DRILL-3885) Column alias "`f.c`" rejected if number of regions is > 1 in HBase unit tests

Daniel Barclay (Drill) created DRILL-3885: - Summary: Column alias "`f.c`" rejected if number of regions is > 1 in HBase unit tests Key: DRILL-3885 URL: https://issues.apache.org/jira/browse/DRILL-3885

[GitHub] drill pull request: DRILL-3884: Fix lower parallelization issues w...

GitHub user vkorukanti opened a pull request: https://github.com/apache/drill/pull/185 DRILL-3884: Fix lower parallelization issues with Hive's native scan. @amansinha100 Could you please review the patch? You can merge this pull request into a Git repository by running: $ git

[jira] [Resolved] (DRILL-3565) Add support for Avro UNION type

[ https://issues.apache.org/jira/browse/DRILL-3565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew resolved DRILL-3565. --- Resolution: Fixed > Add support for Avro UNION type > --- > > Key:

[jira] [Created] (DRILL-3884) Hive native scan has lower parallelization leading to performance degradation

Venki Korukanti created DRILL-3884: -- Summary: Hive native scan has lower parallelization leading to performance degradation Key: DRILL-3884 URL: https://issues.apache.org/jira/browse/DRILL-3884 Proje

[GitHub] drill pull request: [DRILL-3723] Remove unused RemoteServiceSet me...

GitHub user aleph-zero opened a pull request: https://github.com/apache/drill/pull/184 [DRILL-3723] Remove unused RemoteServiceSet method RemoteServiceSet.getServiceSetWithFullCache() was not using any of the arguments passed to it. It was identical to getLocalServiceSet(). You

[GitHub] drill pull request: [DRILL-3300] Bug fix: Unused method parameter

GitHub user aleph-zero opened a pull request: https://github.com/apache/drill/pull/183 [DRILL-3300] Bug fix: Unused method parameter Fixed a bug whereby HBaseGroupScan.setFilterPushedDown(boolean) was not using the value passed to it to set an internal flag. Instead the method w

Re: Review Request 32248: DRILL-2139: Star is not expanded correctly in "select distinct" query

> On Oct. 1, 2015, 2:11 a.m., Jacques Nadeau wrote: > > exec/java-exec/src/main/java/org/apache/drill/exec/physical/impl/aggregate/AggregateUtils.java, > > line 32 > > > > > > Can you add a Javadoc here? Done > On

[jira] [Created] (DRILL-3883) Trailing characters are ignored when casting from string to date

Victoria Markman created DRILL-3883: --- Summary: Trailing characters are ignored when casting from string to date Key: DRILL-3883 URL: https://issues.apache.org/jira/browse/DRILL-3883 Project: Apache

[jira] [Resolved] (DRILL-3819) Remove redundant filter for files start with "."

[ https://issues.apache.org/jira/browse/DRILL-3819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aman Sinha resolved DRILL-3819. --- Resolution: Fixed Fixed in edd10df4026ebe3e4b0f4ec314760453cecfe756 > Remove redundant filter for fil

[jira] [Resolved] (DRILL-3817) Refresh metadata does not work when used with sub schema

[ https://issues.apache.org/jira/browse/DRILL-3817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aman Sinha resolved DRILL-3817. --- Resolution: Fixed Fixed in f9cefd5e7b2de52812ac6a0813237479d9a6a167. > Refresh metadata does not work

RE: Channel closed exception

Uploaded the entire log. Thanks, Sudip -Original Message- From: Sudheesh Katkam [mailto:skat...@maprtech.com] Sent: 02 October 2015 AM 02:40 To: dev@drill.apache.org Subject: Re: Channel closed exception Could you share the entire log file? - Sudheesh > On Oct 1, 2015, at 1:57 PM, Sud

[GitHub] drill pull request: Refresh metadata bugs 1

Github user asfgit closed the pull request at: https://github.com/apache/drill/pull/179 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[GitHub] drill pull request: Fix for DRILL-3869

Github user asfgit closed the pull request at: https://github.com/apache/drill/pull/178 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

Partial aggregation in Drill-on-Phoenix

Phoenix is able to perform quite a few relational operations on the region server: scan, filter, project, aggregate, sort (optionally with limit). However, the sort and aggregate are necessarily "local". They can only deal with data on that region server, and there needs to be a further operation t

Re: Channel closed exception

Could you share the entire log file? - Sudheesh > On Oct 1, 2015, at 1:57 PM, Sudip Mukherjee wrote: > > Ohh..Sorry about that, > Could you please try again? Or I'll put it in github > https://drive.google.com/drive/folders/0ByRlB6iLvhRvSm9UQWJ4b2ZjVDQ > > Thanks, > Sudip > > -Original Me

Re: Timing for 1.2 release, ideas around things to include

On Thu, Oct 1, 2015 at 11:17 AM, Abdel Hakim Deneche wrote: > I can manage the release. > Great! I use a manual variation of these steps [1] typically. Julian Hyde made a much nicer set of steps (for Incubator) here: [2] if you want to use those. On Thu, Oct 1, 2015 at 2:32 PM, Parth Chandra

[GitHub] drill pull request: DRILL-3874: flattening large JSON objects uses...

Github user jaltekruse commented on the pull request: https://github.com/apache/drill/pull/181#issuecomment-144846430 Overall, the changes look solid. I am thinking it may be worth trying to remove the bodies of the existing getBufferSize() methods and replace them with calls

RE: Channel closed exception

Ohh..Sorry about that, Could you please try again? Or I'll put it in github https://drive.google.com/drive/folders/0ByRlB6iLvhRvSm9UQWJ4b2ZjVDQ Thanks, Sudip -Original Message- From: Sudheesh Katkam [mailto:skat...@maprtech.com] Sent: 02 October 2015 AM 02:04 To: dev@drill.apache.org Sub

[jira] [Created] (DRILL-3882) Time and Timestamp vectors should not return timezone-based data

Andrew created DRILL-3882: - Summary: Time and Timestamp vectors should not return timezone-based data Key: DRILL-3882 URL: https://issues.apache.org/jira/browse/DRILL-3882 Project: Apache Drill Issu

[GitHub] drill pull request: DRILL-3874: flattening large JSON objects uses...

Github user jaltekruse commented on a diff in the pull request: https://github.com/apache/drill/pull/181#discussion_r40963410 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/vector/complex/BaseRepeatedValueVector.java --- @@ -123,6 +123,15 @@ public int getBufferSize(

Re: Channel closed exception

I cannot open the shared documents (“Whoops! There was a problem previewing this document.”) nor can I download them ("We're sorry, but you do not have access to this page.”). The folder link in this thread is also broken (“The open folder can no longer be viewed”). - Sudheesh > On Oct 1, 2015

[GitHub] drill pull request: [DRILL-3791] JDBC Storage Plugin Testing

GitHub user aleph-zero opened a pull request: https://github.com/apache/drill/pull/182 [DRILL-3791] JDBC Storage Plugin Testing Improves testing for the JDBC storage plugin. - Adds tests for MySQL - Simplifies testing by having maven start/stop Derby and MySQL servers

Apache_Drill_Exception - Invitation to view

I've shared an item with you: Apache_Drill_Exception https://drive.google.com/folderview?id=0ByRlB6iLvhRvSm9UQWJ4b2ZjVDQ&usp=sharing&invite=CPOnotUP&ts=560d87a6 It's not an attachment -- it's stored online. To open this item, just click the link above. Apache drill exception while getting da

[GitHub] drill pull request: Issues/drill 3791

Github user aleph-zero commented on a diff in the pull request: https://github.com/apache/drill/pull/177#discussion_r40960820 --- Diff: contrib/storage-jdbc/src/main/java/org/apache/drill/exec/store/jdbc/JdbcRecordReader.java --- @@ -364,13 +368,15 @@ void copy(int index) throws S

[GitHub] drill pull request: Issues/drill 3791

Github user aleph-zero commented on a diff in the pull request: https://github.com/apache/drill/pull/177#discussion_r40960796 --- Diff: contrib/storage-jdbc/src/main/java/org/apache/drill/exec/store/jdbc/JdbcRecordReader.java --- @@ -364,13 +368,15 @@ void copy(int index) throws S

[GitHub] drill pull request: Issues/drill 3791

Github user aleph-zero commented on a diff in the pull request: https://github.com/apache/drill/pull/177#discussion_r40960694 --- Diff: contrib/storage-jdbc/pom.xml --- @@ -15,62 +15,241 @@ See the License for the specific language governing permissions and limitations u

[GitHub] drill pull request: Issues/drill 3791

Github user aleph-zero commented on a diff in the pull request: https://github.com/apache/drill/pull/177#discussion_r40960677 --- Diff: contrib/storage-jdbc/pom.xml --- @@ -15,62 +15,241 @@ See the License for the specific language governing permissions and limitations u

Re: Timing for 1.2 release, ideas around things to include

Please let me know the tickets for 1.2 weeded out and I'll generate the release notes. Kristine Hahn Sr. Technical Writer 415-497-8107 @krishahn skype:krishahn On Thu, Oct 1, 2015 at 8:17 AM, Abdel Hakim Deneche wrote: > I can manage the release. > > On Wed, Sep 30, 2015 at 6:10 PM, Aman Sinha

RE: Channel closed exception

I uploaded to google drive. Should it be okay? https://drive.google.com/drive/folders/0ByRlB6iLvhRvSm9UQWJ4b2ZjVDQ Thanks, Sudip -Original Message- From: Sudheesh Katkam [mailto:skat...@maprtech.com] Sent: 01 October 2015 AM 10:01 To: dev@drill.apache.org Subject: Re: Channel closed exc

[GitHub] drill pull request: Fix for DRILL-3869

Github user jaltekruse commented on the pull request: https://github.com/apache/drill/pull/178#issuecomment-144823271 I just saw that the conversation fragmented on JIRA, Jacques point makes sense to me +1 --- If your project is set up for it, you can reply to this email and have you

[GitHub] drill pull request: Fix for DRILL-3869

Github user jaltekruse commented on the pull request: https://github.com/apache/drill/pull/178#issuecomment-144819302 The change looks good, but thinking about this a little more it might make sense to fix this a little higher up the chain. If we fix this where queries are actually ac

[GitHub] drill pull request: Fix for DRILL-3869

Github user aleph-zero commented on the pull request: https://github.com/apache/drill/pull/178#issuecomment-144817688 Addressed above comments by trimming whitespace from the query string prior to trimming any trailing ';' character. --- If your project is set up for it, you can repl

Re: Timing for 1.2 release, ideas around things to include

+1 on the release. I'm all for starting the process ASAP. On Thu, Oct 1, 2015 at 8:17 AM, Abdel Hakim Deneche wrote: > I can manage the release. > > On Wed, Sep 30, 2015 at 6:10 PM, Aman Sinha wrote: > > > +1 for starting the process of finalizing the 1.2 release and 'bounce > > everything no

[jira] [Created] (DRILL-3881) Rowkey filter does not get pushed into Scan

Khurram Faraaz created DRILL-3881: - Summary: Rowkey filter does not get pushed into Scan Key: DRILL-3881 URL: https://issues.apache.org/jira/browse/DRILL-3881 Project: Apache Drill Issue Type

New Slack setup for Devs and Users

Hey Guys, We've been using Slack a lot internally and have found it very useful. I setup a new slack for Drill developers and users. I've set it to automatically accept new users from @apache.org as well as @mapr.com, @ maprtech.com and @dremio.com. I'm more than happy to whitelist other domains (

RE: Custom SerDes in Drill

Interesting, I'll give it a go and reply to the mail list to see how I get on. Thanks, Mike -Original Message- From: Jacques Nadeau [mailto:jacq...@dremio.com] Sent: 01 October 2015 14:35 To: dev@drill.apache.org Subject: Re: Custom SerDes in Drill As long as the custom serde dependenci

[jira] [Created] (DRILL-3880) sqlline does not allow for a password prompt - security issue

John Omernik created DRILL-3880: --- Summary: sqlline does not allow for a password prompt - security issue Key: DRILL-3880 URL: https://issues.apache.org/jira/browse/DRILL-3880 Project: Apache Drill

[jira] [Created] (DRILL-3879) sqlline user authentication provides poor feedback on authentication

John Omernik created DRILL-3879: --- Summary: sqlline user authentication provides poor feedback on authentication Key: DRILL-3879 URL: https://issues.apache.org/jira/browse/DRILL-3879 Project: Apache Dril

Re: Timing for 1.2 release, ideas around things to include

I can manage the release. On Wed, Sep 30, 2015 at 6:10 PM, Aman Sinha wrote: > +1 for starting the process of finalizing the 1.2 release and 'bounce > everything not critical (and not in-progress or reviewable) off of this > release'. > > Aman > > On Wed, Sep 30, 2015 at 5:36 PM, Jacques Nadeau

Re: Review Request 32248: DRILL-2139: Star is not expanded correctly in "select distinct" query

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/32248/ --- (Updated Oct. 1, 2015, 3:18 p.m.) Review request for drill, Aman Sinha, Jacques

[jira] [Created] (DRILL-3878) Support XML Querying (selects/projections, no writing)

Edmon Begoli created DRILL-3878: --- Summary: Support XML Querying (selects/projections, no writing) Key: DRILL-3878 URL: https://issues.apache.org/jira/browse/DRILL-3878 Project: Apache Drill Iss

[GitHub] drill pull request: DRILL-3874: flattening large JSON objects uses...

Github user cwestin commented on the pull request: https://github.com/apache/drill/pull/181#issuecomment-144729913 Passes the unit tests, and the regression suite, except for one query in the functional suite that Rahul claimed (in email) is a known problem and that he has a fix for.

[GitHub] drill pull request: DRILL-3874: flattening large JSON objects uses...

GitHub user cwestin opened a pull request: https://github.com/apache/drill/pull/181 DRILL-3874: flattening large JSON objects uses too much direct memory - add getBufferSizeFor() to ValueVector interface - add implememtations of getBufferSizeFor() for all ValueVector derivatives

Re: XML support in Drill 1.x or 2.0

I will open JIRA and attach a Google Doc to record design thoughts there. On Thu, Oct 1, 2015 at 9:33 AM, Jacques Nadeau wrote: > Sounds good. The biggest question to me is how to map XML to our json data > model. I suggest the discussion start there. > On Oct 1, 2015 6:01 AM, "Tugdual Grall" w

Re: Custom SerDes in Drill

As long as the custom serde dependencies are also on the Drill classpath, this should work fine. On Oct 1, 2015 5:59 AM, wrote: > Hi, > > Is it possible to use custom SerDe in Drill? From what I can see it is > not, but there are some proprietary data types that I am interested in > querying that

Re: XML support in Drill 1.x or 2.0

Sounds good. The biggest question to me is how to map XML to our json data model. I suggest the discussion start there. On Oct 1, 2015 6:01 AM, "Tugdual Grall" wrote: > +1 > to start the discussion as I see more and more questions about XML in the > context > > Tug > > On Thu, Oct 1, 2015 at 12:5

Re: XML support in Drill 1.x or 2.0

+1 to start the discussion as I see more and more questions about XML in the context Tug On Thu, Oct 1, 2015 at 12:51 PM, Edmon Begoli wrote: > What do you guys think about opening up a JIRA and a design discussion for > supporting XML in Drill in some of the upcoming releases? > > I think it w

Custom SerDes in Drill

Hi, Is it possible to use custom SerDe in Drill? From what I can see it is not, but there are some proprietary data types that I am interested in querying that need a SerDe. I am guessing a Drill query over a Hive table (set up to use a custom SerDe) will not work? Thanks, Mike This e-mail (

[jira] [Resolved] (DRILL-3877) drill version 1.0.0 is shown in drill shell for 1.1.0 during start up

[ https://issues.apache.org/jira/browse/DRILL-3877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deneche A. Hakim resolved DRILL-3877. - Resolution: Duplicate > drill version 1.0.0 is shown in drill shell for 1.1.0 during star

Re: Improving S3 query performance with cache capabilities

Hi Jocelyn, I have used Tachyon as a caching layer for accessing S3 from Drill. It has limitations but the latest release of Tachyon solves many of them (I have not yet tested this). I'm quite interested in what you are doing and it's relevant for my project as well. Please let me know if there

Improving S3 query performance with cache capabilities

Hi all, I am an architect of a PAAS BI solution and gave apache drill a test during a week. On our current solution, we store our customer data on S3 column files and perform in memory computation on a home made nosql engine. We have TB of data on S3, but since it's a multi tenant solution, w

Re: Apache MetaModel - an interesting future integration target

Hi Jacques, I think we can best answer that together. I didn't yet dive into all the details of Drill, but from a high level it seems that we could maybe provide connectivity to a wide set of databases and file formats, which you could leverage. The query syntax for all MetaModel connectors is exa

XML support in Drill 1.x or 2.0

What do you guys think about opening up a JIRA and a design discussion for supporting XML in Drill in some of the upcoming releases? I think it will have to be done, sooner or later, in order to cover the whole spectrum. I've started doing a little bit of research in what could be the options, po

[GitHub] drill pull request: DRILL-3229: Implement Union type vector

GitHub user StevenMPhillips opened a pull request: https://github.com/apache/drill/pull/180 DRILL-3229: Implement Union type vector You can merge this pull request into a Git repository by running: $ git pull https://github.com/StevenMPhillips/drill drill-3229 Alternatively y

[jira] [Created] (DRILL-3877) drill version 1.0.0 is shown in drill shell for 1.1.0 during start up

Devender Yadav created DRILL-3877: -- Summary: drill version 1.0.0 is shown in drill shell for 1.1.0 during start up Key: DRILL-3877 URL: https://issues.apache.org/jira/browse/DRILL-3877 Project: Ap