[GitHub] drill pull request: DRILL-2288: Fix ScanBatch violation of IterOut...

Github user dsbos commented on the pull request: https://github.com/apache/drill/pull/228#issuecomment-154281600 Addressed problems revealed by today's rebasing. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pro

[jira] [Created] (DRILL-4045) FLATTEN case in testNestedFlatten yields no rows (test didn't detect)

Daniel Barclay (Drill) created DRILL-4045: - Summary: FLATTEN case in testNestedFlatten yields no rows (test didn't detect) Key: DRILL-4045 URL: https://issues.apache.org/jira/browse/DRILL-4045

DRILL-3480 surfaces more frequently

Drillers, On our functional test runs using the extended tests , DRILL-3480 used to cause 1 or 2 tests to fail on random runs. With the recent commits (last week or so) we started seeing it more often.

Re: Temporary branches

There’s no other thread, since David Nalley’s email was sent to a Bcc: list, but I’ve sent him an email and copied you (Jacques) on it. > On Nov 5, 2015, at 1:50 PM, Jacques Nadeau wrote: > > I think the temporary- concept seems like a simple solution. You want to > propose on that other thread

Re: select from table with options

> On Nov 5, 2015, at 5:00 PM, Julien Le Dem wrote: > > TL;DR: TableMacro works for me; I need help with a bug in Calcite when > there's more than 1 function with the same name. Yes; see below. > FYI: I have a prototype of TableMacro working in Drill. For now just being > able to specify the

[jira] [Created] (DRILL-4044) NPE in partition pruning test on (JDK8 + Drill 1.3)

Khurram Faraaz created DRILL-4044: - Summary: NPE in partition pruning test on (JDK8 + Drill 1.3) Key: DRILL-4044 URL: https://issues.apache.org/jira/browse/DRILL-4044 Project: Apache Drill Is

Re: select from table with options

TL;DR: TableMacro works for me; I need help with a bug in Calcite when there's more than 1 function with the same name. FYI: I have a prototype of TableMacro working in Drill. For now just being able to specify the delimiter for csv files. So it seem the answer to my question 1) is that TableMacro

[jira] [Created] (DRILL-4043) FindLimit0Visitor should be applied after Calcite logical transformation

Sudheesh Katkam created DRILL-4043: -- Summary: FindLimit0Visitor should be applied after Calcite logical transformation Key: DRILL-4043 URL: https://issues.apache.org/jira/browse/DRILL-4043 Project: A

[GitHub] drill pull request: DRILL-3994: make classpath scanning work on wi...

Github user julienledem commented on the pull request: https://github.com/apache/drill/pull/226#issuecomment-154238567 merged in https://github.com/apache/drill/commit/8d56962bb8084724df9c89f007f0b1f1b99f8f95 --- If your project is set up for it, you can reply to this email and have

[GitHub] drill pull request: DRILL-3994: make classpath scanning work on wi...

Github user julienledem closed the pull request at: https://github.com/apache/drill/pull/226 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

Re: [VOTE] Release Apache Drill 1.3.0 (rc0)

Ran into another one - DRILL-4042 . On Thu, Nov 5, 2015 at 1:48 PM, Jacques Nadeau wrote: > Yeah, I think that sinks it. Weird how Rat complains only on windows... > > Let's take the rest of the business day to test the current candidate to > mak

[jira] [Created] (DRILL-4042) Unable to run sqlline in embedded mode on Windows

Aditya Kishore created DRILL-4042: - Summary: Unable to run sqlline in embedded mode on Windows Key: DRILL-4042 URL: https://issues.apache.org/jira/browse/DRILL-4042 Project: Apache Drill Issu

[jira] [Created] (DRILL-4041) Parquet library update causing random "Buffer has negative reference count"

Rahul Challapalli created DRILL-4041: Summary: Parquet library update causing random "Buffer has negative reference count" Key: DRILL-4041 URL: https://issues.apache.org/jira/browse/DRILL-4041 Pro

Re: [DISCUSS] Ideas to improve metadata cache read performance

I'm collecting some data on what is a reasonable matrix. I think you're right that there may be a set of cases where Steven's parallelization approach makes more sense and some where it might be more expensive. I'll post something with information about the use cases in the next few days. On Wed,

Re: [VOTE] Release Apache Drill 1.3.0 (rc0)

Yeah. Windows... -- Jacques Nadeau CTO and Co-Founder, Dremio On Thu, Nov 5, 2015 at 1:53 PM, Aditya wrote: > For some reason, the RAT plugin, correctly, detects sequence files as > "binary" on non-Windows platform. > > ALsrc/test/resources/logback.xml >> B src/test/resources/seque

Re: [DISCUSS] Improving Fast Schema

I think we have to resolve these issues. Otherwise, we'll always behave inconsistently (and confuse the user). I'm sure we won't find 100% immediately but we can probably get to 99.9% reasonably quick and then manage the last 0.1% as we learn about them. My guess is the aggregation outputs (which

Re: [DISCUSS] Improving Fast Schema

DRILL-3623 is originally to get schema in planning time for Hive table. Once parquet becomes schema-ed, it could be applied to parquet table. However, there are issues in terms of type resolution. The following is the comments I put in the PR for DRILL-3623. " The original approach (skipping the

[jira] [Resolved] (DRILL-4040) Build failure on master

[ https://issues.apache.org/jira/browse/DRILL-4040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aditya Kishore resolved DRILL-4040. --- Resolution: Fixed Fix Version/s: 1.3.0 Fixed by [511e54|https://fisheye6.atlassian.com

[GitHub] drill pull request: DRILL-4040: Build failure on master

Github user asfgit closed the pull request at: https://github.com/apache/drill/pull/244 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

Re: [DISCUSS] Improving Fast Schema

I agree. That makes total sense from a conceptual standpoint. What's needed to do this? Is the framework in place for Drill to do this? -- Zelaine On Thu, Nov 5, 2015 at 1:51 PM, Parth Chandra wrote: > I like the idea of making Parquet/Hive schema'd and returning the schema at > planning tim

Re: [VOTE] Release Apache Drill 1.3.0 (rc0)

For some reason, the RAT plugin, correctly, detects sequence files as "binary" on non-Windows platform. ALsrc/test/resources/logback.xml > B src/test/resources/sequencefiles/simple.seq > ALsrc/main/java/io/netty/buffer/PooledByteBufAllocatorL.java > Bug in RAT plugin I guess. O

Re: [DISCUSS] Improving Fast Schema

I like the idea of making Parquet/Hive schema'd and returning the schema at planning time. Front end tools assume that the backend can do a Prepare and then Execute and this fits that model much better. On Thu, Nov 5, 2015 at 1:16 PM, Jacques Nadeau wrote: > The only way we get to a few millis

Re: Temporary branches

I think the temporary- concept seems like a simple solution. You want to propose on that other thread so I can +1? -- Jacques Nadeau CTO and Co-Founder, Dremio On Thu, Nov 5, 2015 at 1:28 PM, Julian Hyde wrote: > > > On Nov 5, 2015, at 1:12 PM, Jacques Nadeau wrote: > > > > I'm not sure what t

Re: [VOTE] Release Apache Drill 1.3.0 (rc0)

Yeah, I think that sinks it. Weird how Rat complains only on windows... Let's take the rest of the business day to test the current candidate to make sure that we don't spin extra builds unnecessarily. thanks, Jacques -- Jacques Nadeau CTO and Co-Founder, Dremio On Thu, Nov 5, 2015 at 1:24 PM,

[GitHub] drill pull request: DRILL-4040: Build failure on master

Github user parthchandra commented on the pull request: https://github.com/apache/drill/pull/244#issuecomment-154203068 +1. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabl

Re: Temporary branches

We definitely need some sort of solution and using an obvious pattern for staging branch could be one of them. However, I see David mentioning that it is an interim solution and they might already be evaluating options. On Tue, Nov 3, 2015 at 12:40 PM, David Nalley wrote: > > So today, we're tak

Temporary branches

> On Nov 5, 2015, at 1:12 PM, Jacques Nadeau wrote: > > I'm not sure what to do here. INFRA just changed the Git behavior so it is > no longer possible to delete branches. I generally don't like to have > failed branches in a release history (otherwise you get a release branch > with all these m

Re: [VOTE] Release Apache Drill 1.3.0 (rc0)

Oh, I thought only master/trunk branch was protected, but now I see the mail from David Nalley. In such case, I propose that the release manager could push the branch to his/her private fork and put the URL/hash in the vote starter thread. The reason I was looking to the commit history to determi

Re: [DISCUSS] Improving Fast Schema

The only way we get to a few milliseconds is by doing this stuff at planning. Let's start by making Parquet schema'd and fixing our implicit cast rules. Once completed, we can return schema just through planning and completely skip over execution code (as in every other database). I'd guess that t

Re: [VOTE] Release Apache Drill 1.3.0 (rc0)

I'm not sure what to do here. INFRA just changed the Git behavior so it is no longer possible to delete branches. I generally don't like to have failed branches in a release history (otherwise you get a release branch with all these maven forward/backwards commits). As such, I would overwrite candi

Re: [VOTE] Release Apache Drill 1.3.0 (rc0)

I am having trouble determining the git commit this release is based on as I could not find the id (4822068a006aeb251b686d2b51871573c4337e60) captured in the git.properties bundled in the tarballs in the Drill Git repository. Most likely the last commit is only in your local branch and since git.p

[GitHub] drill pull request: DRILL-4040: Build failure on master

GitHub user adityakishore opened a pull request: https://github.com/apache/drill/pull/244 DRILL-4040: Build failure on master Added *.seq files to RAT's exclusion list. You can merge this pull request into a Git repository by running: $ git pull https://github.com/adityakishore

[jira] [Created] (DRILL-4040) Build failure on master

Aditya Kishore created DRILL-4040: - Summary: Build failure on master Key: DRILL-4040 URL: https://issues.apache.org/jira/browse/DRILL-4040 Project: Apache Drill Issue Type: Bug Re

Re: [DISCUSS] Improving Fast Schema

For (3), are you referring to the operators with extend AbstractSingleRecordBatch? We basically only call the buildSchema() method on blocking operators. If the operators are not blocking, we simply process the first batch, the idea being that it should be fast enough. Are there situation where thi

[GitHub] drill pull request: DRILL-2489 and DRILL-2769: JDBC exceptions (& ...

Github user dsbos commented on the pull request: https://github.com/apache/drill/pull/171#issuecomment-154157257 Rebased on current master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have th

[GitHub] drill pull request: DRILL-3845: Partition sender shouldn't send th...

Github user adeneche closed the pull request at: https://github.com/apache/drill/pull/173 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[DISCUSS] Improving Fast Schema

Hey y’all, @Jacques and @Steven, I am looking at improving the fast schema path (for LIMIT 0 queries). It seems to me that on the first call to next (the buildSchema call), in any operator, only two tasks need to be done: 1) call next exactly once on each of the incoming batches, and 2) setup t

[jira] [Created] (DRILL-4039) Query fails when non-ascii characters are used in string literals

Sergio Lob created DRILL-4039: - Summary: Query fails when non-ascii characters are used in string literals Key: DRILL-4039 URL: https://issues.apache.org/jira/browse/DRILL-4039 Project: Apache Drill

[jira] [Created] (DRILL-4038) [MongoDB] Exception on bson mixin

W. created DRILL-4038: - Summary: [MongoDB] Exception on bson mixin Key: DRILL-4038 URL: https://issues.apache.org/jira/browse/DRILL-4038 Project: Apache Drill Issue Type: Bug Components: Storag

[jira] [Created] (DRILL-4037) No schemas available using MongoDB 3.0.6 with authentication + wired Tiger

W. created DRILL-4037: - Summary: No schemas available using MongoDB 3.0.6 with authentication + wired Tiger Key: DRILL-4037 URL: https://issues.apache.org/jira/browse/DRILL-4037 Project: Apache Drill Is