Re: Maven build failing on checkstyle

2015-09-10 Thread Edmon Begoli
ip > > them out automagically. This leads to format changes that make reviews > > (very slightly) more difficult. > > > > I would be willing to fix the checkstyle profile to be less draconian if > > you would be willing to file the JIRA. > > > > > > &g

Re: Maven build failing on checkstyle

2015-09-10 Thread Edmon Begoli
Long story short (sorry :-|) - does it make sense to have a build stopping check for \s+$ in a javadoc and not check and stop the build for missing or improper javadoc? On Thursday, September 10, 2015, Edmon Begoli wrote: > My observation on this, as a newcomer, is that it is a paradoxical

Re: Maven build failing on checkstyle

2015-09-10 Thread Edmon Begoli
styling practices including javadoc on all public methods and classes. On Thursday, September 10, 2015, Edmon Begoli wrote: > Long story short (sorry :-|) - does it make sense to have a build > stopping check for \s+$ in a javadoc and not check and stop the build for > missing or imprope

Re: Maven build failing on checkstyle

2015-09-10 Thread Edmon Begoli
railing > whitespace check does provide great use in code so I'd prefer to keep it. > > What do you think? > > -- > Jacques Nadeau > CTO and Co-Founder, Dremio > > On Thu, Sep 10, 2015 at 4:39 AM, Edmon Begoli > wrote: > > > My proposal: > > >

Can this be merged in - DRILL-3724?

2015-09-10 Thread Edmon Begoli
It is an easy fix for javadoc, and it has been approved by Jacques: https://github.com/apache/drill/pull/139 Thank you, Edmon

Re: Maven build failing on checkstyle

2015-09-10 Thread Edmon Begoli
I will open an issue and work on this proposed javadoc. I am a "first principles" type of person, and I do not see myself being able to effectively do stuff until I understand the Drill API inside-out myself. A result of the learning process should be contributed back to the project. I'll start w

Gradle?

2015-09-12 Thread Edmon Begoli
Hey guys - has there been any consideration given to using Gradle in the future instead of Maven?

Gradle?

2015-09-13 Thread Edmon Begoli
ng bog standard. > > What benefit would you foresee with gradle? > > > > > On Sat, Sep 12, 2015 at 9:02 PM, Edmon Begoli > wrote: > > > Hey guys - has there been any consideration given to using Gradle in the > > future instead of Maven? > > >

Update on EDI support for Drill - repo and design collaboratory

2015-09-13 Thread Edmon Begoli
add you to the repo, so you can edit Wiki.* Let me know please. Edmon On Sun, Sep 6, 2015 at 7:16 AM, Edmon Begoli wrote: > Matt - that is fantastic. Having good, liberally licensed format > converters probably takes care of the 50% of the problem. The other 50% > will be in figurin

Re: Update on EDI support for Drill - repo and design collaboratory

2015-09-13 Thread Edmon Begoli
ing, I would be happy to contribute via pull requests. > > So I don't need to be on the repo as a contributor. > > On Sun, Sep 13, 2015 at 1:42 PM, Edmon Begoli > wrote: > > > Ted, Matt, et al., > > > > I have created temporary repository for design and develop

Design and Implementation Question - related to DRILL-3738

2015-09-14 Thread Edmon Begoli
I want to implement a support for Excel files, both .xls and .xlsx, through Apache POI which will give me access to Java objects including column names, column values and it will expose the set of types supports. (I recorded this issue here: https://issues.apache.org/jira/browse/DRILL-3738) In ot

Re: Design and Implementation Question - related to DRILL-3738

2015-09-14 Thread Edmon Begoli
e can also discuss tomorrow in a Hangout. Thank you, Edmon On Mon, Sep 14, 2015 at 10:11 AM, Edmon Begoli wrote: > I want to implement a support for Excel files, both .xls and .xlsx, > through Apache POI > which will give me access to Java objects including column names, column > val

The meaning/intent of the following methods - JSON storage format - part 1

2015-09-16 Thread Edmon Begoli
I am studying the JSON Storage plugin. Can someone please answer what is the meaning (or intent) of the following methods: # Question 1: # This is from inside the getter for RecordWriter. What is major/minor fragment id? String fragmentId = String.format("%d_%d", handle.getMajorFragmentId(), hand

Re: The meaning/intent of the following methods - JSON storage format - part 1

2015-09-17 Thread Edmon Begoli
Hello all, Could some please with answering my questions 2-5 below? Thank you, Edmon On Wednesday, September 16, 2015, Edmon Begoli wrote: > I am studying the JSON Storage plugin. > > Can someone please answer what is the meaning (or intent) of the following > methods: >

Re: Who is coming to Strata NYC?

2015-09-17 Thread Edmon Begoli
le > want to join and we can figure it out. > > Thanks, > Tomer > > On Fri, Sep 4, 2015 at 12:57 PM, Edmon Begoli > wrote: > > > I am planning on going. > > > > Maybe we can have a little gathering. > > > > > > -- > Tomer Shiran > CEO and Co-Founder, Dremio >

Re: Potential resource for large scale testing

2015-09-17 Thread Edmon Begoli
the PI for the resource, and could give access to whomever we want to designate from the Drill project side. Just let me know. I should have project approved within few days. Edmon On Saturday, September 5, 2015, Edmon Begoli wrote: > Ted, > > It is actually very easy and painless to

Re: Potential resource for large scale testing

2015-09-18 Thread Edmon Begoli
ing to contribute (performance testing?) > > > [1] https://github.com/mapr/drill-test-framework > > - Rahul > > On Thu, Sep 17, 2015 at 8:49 PM, Edmon Begoli > wrote: > > > I discussed this idea of bringing large compute resource yesterday with > my > > team

Re: The meaning/intent of the following methods - JSON storage format - part 1

2015-09-18 Thread Edmon Begoli
; questions. > > Thanks > > On Thu, Sep 17, 2015 at 8:14 PM, Edmon Begoli wrote: > > > Hello all, > > > > Could some please with answering my questions 2-5 below? > > > > Thank you, > > Edmon > > > > On Wednesday, September 16, 2015

Apache MetaModel - an interesting future integration target

2015-09-18 Thread Edmon Begoli
I was researching today some options for non-traditional, broader MDM approach, and I ran into recently incubated Apache project called MetaModel: http://metamodel.apache.org/ Is anyone familiar with it? It looks to me, architecturally, that there could be a possible Drill 2.0+ intersecting scen

Re: Potential resource for large scale testing

2015-09-18 Thread Edmon Begoli
t; > > > You expressed interest in making these tests available on an Amazon > > cluster > > > so that users need not have physical hardware required to run these > > tests. > > > Do you have any specific thoughts on how to leverage the resources that > > &g

Re: Apache MetaModel - an interesting future integration target

2015-09-18 Thread Edmon Begoli
Yeah, that was a bit of my concern. It looks also like a do-it-all solution. I'll keep it on eye. On Friday, September 18, 2015, Ted Dunning wrote: > Could be useful. It doesn't look like a very active project. 9 issues > resolved in 30 days. > > > > On Fri, Se

Re: Improved JIRA process

2015-09-22 Thread Edmon Begoli
Sounds good to me. I would only comment that we should probably relax item 3 to tie the commitment to the release schedule. There might be issues that cannot be worked on within few weeks, but are good to keep planned for the future few releases ahead. On Tue, Sep 22, 2015 at 9:05 PM, Jacques Nad

Re: Improved JIRA process

2015-09-22 Thread Edmon Begoli
ter, they should > chime in to help out. > > -- > Jacques Nadeau > CTO and Co-Founder, Dremio > > On Tue, Sep 22, 2015 at 6:15 PM, Edmon Begoli wrote: > > > Sounds good to me. > > > > I would only comment that we should probably relax item 3 to tie the > &g

Re: Potential resource for large scale testing

2015-09-23 Thread Edmon Begoli
. They will need to apply and get RSA tokens. Then we can talk how to make this resource a part of the regular testing and benchmarking process. Thank you, Edmon On Fri, Sep 18, 2015 at 8:00 PM, Edmon Begoli wrote: > I requested 5000 hours a year on Beacon for Apache Drill for high > perfo

Re: Ideas around making UDFs simpler: better import support

2015-09-24 Thread Edmon Begoli
First, this idea is something that makes not only total sense but it is also highly needed if Drill is to see broader contribution. Second, I think this "reform" is needed in other aspects of the architecture as much if not even more than for UDFs. At this point it is really hard to get your head

Re: Potential resource for large scale testing

2015-09-25 Thread Edmon Begoli
tart taking advantage of this awesome resource! > > -- > Jacques Nadeau > CTO and Co-Founder, Dremio > > On Wed, Sep 23, 2015 at 5:34 PM, Edmon Begoli wrote: > > > This request has been approved. I will get more details tomorrow. > > > > I could add to the

Zookeeper (semi-)automated cluster setup

2015-09-26 Thread Edmon Begoli
Hey folks, I am exploring a setup for large cluster deployment for Drill. Is anyone aware of any ZooKeeper utility for simplified and (semi-)automated setup, and, ideally, configured for Drill? Thank you, Edmon

Re: Zookeeper (semi-)automated cluster setup

2015-09-27 Thread Edmon Begoli
for cluster of certain size3. When you say "configured for drill" - > what do you mean by that? > From: Edmon Begoli > To: [email protected]; [email protected] > Sent: Saturday, September 26, 2015 3:54 PM > Subject: Zookeeper (semi-)automated cluster setup &

XML support in Drill 1.x or 2.0

2015-10-01 Thread Edmon Begoli
What do you guys think about opening up a JIRA and a design discussion for supporting XML in Drill in some of the upcoming releases? I think it will have to be done, sooner or later, in order to cover the whole spectrum. I've started doing a little bit of research in what could be the options, po

Re: XML support in Drill 1.x or 2.0

2015-10-01 Thread Edmon Begoli
;Tugdual Grall" wrote: > > > +1 > > to start the discussion as I see more and more questions about XML in the > > context > > > > Tug > > > > On Thu, Oct 1, 2015 at 12:51 PM, Edmon Begoli wrote: > > > > > What do you guys think about

Re: [VOTE] Release Apache Drill 1.2.0 (rc0)

2015-10-06 Thread Edmon Begoli
Humbly, +1. On Tue, Oct 6, 2015 at 12:32 PM, Abdel Hakim Deneche wrote: > verified the artifacts checksums and that they are signed by my gpg key. > Built Drill from source in MacOS and CentOS and both builds were successful > and all unit tests passed. Run some window functions queries and ever

Place to fix this issue DRILL-3712

2015-10-08 Thread Edmon Begoli
Hi folks, We have urgent need to fix this problem. Right now we need to uncompress, re-code and re-compress every file in order to deal with an encoding problem. I originally documented this as JIRA: https://issues.apache.org/jira/browse/DRILL-3712 Can someone please comment on JIRA or reply to

Re: [VOTE] Release Apache Drill 1.2.0 RC3

2015-10-14 Thread Edmon Begoli
Someone tell me the best way to test this release beside running my own Drill code, and I will do it tonight and report results and vote. On Wed, Oct 14, 2015 at 6:35 PM, Neeraja Rentachintala < [email protected]> wrote: > +1 (non-binding) > Downloaded the tar and exercised the yelp tut

Re: [DISCUSS] Design Documents

2015-10-16 Thread Edmon Begoli
Absolutely - yes. I already started following this practice, per Jacques' recommendation. See and embedded Google Doc in comments: https://issues.apache.org/jira/browse/DRILL-3738 Maybe we should use Github wiki or some Google Docs repository to record these design docs centrally. On Fri, Oct 1

Feedback on the usefulness of Drill

2015-10-23 Thread Edmon Begoli
I asked my team to give me a feedback, and a priority, of what they would like for me or Drill community to address in order to make Drill a truly useful tool for their application. This was collected after using Drill for about four months, daily, on a substantial project that integrates healthca

Issue 3149

2015-10-28 Thread Edmon Begoli
May I please escalate this issue for 1.3 or 1.4: https://issues.apache.org/jira/browse/DRILL-3149 I understand that Jim's fixed was lost. Can the fix be recovered and slipped into 1.3? It is causing us to re-format very large volume of files to check and remove these line terminators. Thank yo

Re: Issue 3149

2015-10-29 Thread Edmon Begoli
ing at this soon, I agree that this would be great. > Can someone raise their hand? > > -- > Jacques Nadeau > CTO and Co-Founder, Dremio > > On Wed, Oct 28, 2015 at 6:10 PM, Edmon Begoli wrote: > > > May I please escalate this issue for 1.3 or 1.4: > > &

The praises for Drill

2016-02-25 Thread Edmon Begoli
Hello fellow Driilers, I have been inactive on the development side of the project, as we got busy being heavy/power users of the Drill in the last few months. I just want to share some great experiences with the latest versions of Drill. Just tonight, as we were scrambling to meet the deadline,

Re: Time for the 1.6 Release

2016-03-01 Thread Edmon Begoli
May I please ask to give this issue the attention for 1.6: https://issues.apache.org/jira/plugins/servlet/mobile#issue/DRILL-3149 I will try to suggest a patch. Given my time constraints I might not be able to submit a complete, unit tested code but at least I will try to submit a snippet that wil

Hi everyone

2015-08-19 Thread Edmon Begoli
Hello everyone, This is Edmon Begoli from Knoxville, TN. I am looking forward to join this group of the fine technologists and developers, and to contribute in whatever capacity I can. I am experienced Java developer, a recent Drill adoptee and a huge fan, and I am looking forward to help

Re: Hi everyone

2015-08-20 Thread Edmon Begoli
t sure if this is helpful but thought I'd share just in > case :) > > Regards, > Matt > > From: Ted Dunning > Reply-To: > Date: Thursday, August 20, 2015 at 12:21 AM > To: "[email protected]" > Subject: Re: Hi everyone > > On Wed, Au

Wrong git repo url on the web site?

2015-08-20 Thread Edmon Begoli
Web site instructions have this git instruction: git clone https://git-wip-us.apache.org/repos/asf/drill.git (not also a git not https clone) and the Github repo itself is (https): https://github.com/apache/drill.git and ssh: [email protected]:apache/drill.git With web site provide instructions I h

Re: Wrong git repo url on the web site?

2015-08-20 Thread Edmon Begoli
; > my understanding is that the apache.org repository is the official Drill > repo and we have a mirror on github.com > > On Thu, Aug 20, 2015 at 3:36 PM, Edmon Begoli wrote: > > > Web site instructions have this git instruction: > > git clone https://git-wip-us.apache.org/re

New JIRA Python tool

2015-08-22 Thread Edmon Begoli
What is the suitable replacement for the JIRA Python tool (jira-python) still specified on the contribution web site? https://drill.apache.org/docs/drill-patch-review-tool/ For me, easy_install is not finding jira-python library. It looks like this is the right tool: http://pythonhosted.org/jira/

Re: New JIRA Python tool

2015-08-22 Thread Edmon Begoli
iews/submitting > patches, you could send pull request on github. That might be the most > common way people are using now. > > For the documentation, I think update the correct information is good idea > too. > > On Sat, Aug 22, 2015 at 10:50 AM, Edmon Begoli > wrote: > > &g

Hangouts, etc.

2015-08-23 Thread Edmon Begoli
Drill developers, Would it be possible that we start staging some kind of weekly, bi-weekly or monthly Hangout or whatever form of interaction, even if it is an IRC. What do you think, does this make sense? Edmon

Potential resource for large scale testing

2015-08-25 Thread Edmon Begoli
Hey folks, As we discussed today on a hangout, this is a machine that we have at JICS/NICS where I have Drill installed and where I could set up a test cluster over few nodes. https://www.nics.tennessee.edu/computing-resources/beacon/configuration Note that each node is: - 2x8-core Intel® Xeon®

How to get started with a new format conversion and representation

2015-08-27 Thread Edmon Begoli
This might be more of a question for Parquet folks here than Drill-ers, but nevertheless: I would like to be able to convert EDI HL7 v.2 messages into Parquet representation, and make them amenable to Drill querying. (Here is a sample claim message 837p in HL7 representation (page 8): http://www.v

Re: How to get started with a new format conversion and representation

2015-08-28 Thread Edmon Begoli
t; use Drill to query directly. You can also use Drill to do the ETL. This > would allow others to easily leverage your code. > > We have examples for JSON, Avro & Text. > > > > > > -- > Jacques Nadeau > CTO and Co-Founder, Dremio > > On Thu, Aug 27, 2015 at

The meaning of the methods in StoragePlugin and EasyFormatPlugin

2015-08-29 Thread Edmon Begoli
On *StoragePlugin*: question: -- I assume this means that sources of this storage format kind can be read from the original sources, correct? public boolean supportsRead(); question: -- Is this writing to the original source or does this mean creation of the table for this format? public boole

Re: Developers' Cookbook

2015-08-30 Thread Edmon Begoli
ood plan. > > Where would you like to start? > > > > On Sat, Aug 29, 2015 at 4:16 PM, Edmon Begoli > wrote: > > > Hey folks, > > > > I think that Drill project could benefit from a developers cookbook-like > > material. > > > > I am saying t

Re: The meaning of the methods in StoragePlugin and EasyFormatPlugin

2015-08-30 Thread Edmon Begoli
bject that extends > StoragePluginConfig. What is input when configuring in the web ui. > > > > -- > Jacques Nadeau > CTO and Co-Founder, Dremio > > On Sat, Aug 29, 2015 at 7:01 PM, Edmon Begoli > wrote: > > > On *StoragePlugin*: > > > > question:

Fixing the test process

2015-08-30 Thread Edmon Begoli
This might be already in motion, but let me discuss it with you nevertheless: - could we break up the testing configuration so that small, atomic unit tests can be always ran by default - create larger configurations for complex unit and integration testing so we can run them independently, if ne

Re: Fixing the test process

2015-08-30 Thread Edmon Begoli
on breaking up the tests. Hopefully he'll have > something to report soon. > > On the build problem, please share more details. > > -- > Jacques Nadeau > CTO and Co-Founder, Dremio > > On Sun, Aug 30, 2015 at 11:59 AM, Ted Dunning > wrote: > > > On Sun,

Re: Fixing the test process

2015-08-30 Thread Edmon Begoli
g about. Can you expound? > > > > > > > > -- > > Jacques Nadeau > > CTO and Co-Founder, Dremio > > > > On Sun, Aug 30, 2015 at 2:32 PM, Edmon Begoli wrote: > > > > > My build without tests is doing fine. No problems there. > > > &g

Re: Fixing the test process

2015-08-30 Thread Edmon Begoli
I am testing fresh clone of Drill 1.1 master, no patches. On Sun, Aug 30, 2015 at 9:04 PM, Edmon Begoli wrote: > Here is a fresh result from* mvn clean install*: > > export JAVA_HOME=/Library/Java/JavaVirtualMachines/jdk1.7 > .0_79.jdk/Contents/Home/ > > mvn clean install >

Re: Fixing the test process

2015-08-30 Thread Edmon Begoli
sn't a long term fix, just a > diagnostic. > > > > On Sun, Aug 30, 2015 at 6:26 PM, Abdel Hakim Deneche < > [email protected]> > wrote: > > > can you try adding your machine hostname to /etc/hosts as 127.0.0.1 > > > > thanks > > > >

Re: Announcing new committer: Abdel Hakim Deneche

2015-08-31 Thread Edmon Begoli
Congrats Hakim! Hoping to follow your path. This is a brilliant idea and a project to be working on. On Mon, Aug 31, 2015 at 12:54 AM, Mehant Baid wrote: > Congrats Hakim. > > > On 8/30/15 9:29 PM, Hsuan Yi Chu wrote: > >> Congrats! >> >> On Sun, Aug 30, 2015 at 9:20 PM, Abhishek Girish < >> abh

Is this known issue?

2015-08-31 Thread Edmon Begoli
We might have seen an issue with Drill, so I want to see if this is already reported. I don't think that this one addresses it: https://issues.apache.org/jira/browse/DRILL-1428 When we query the last attribute of a text file, we get missing characters. Looking at the row through Drill, a \r is i

Re: The meaning of the methods in StoragePlugin and EasyFormatPlugin

2015-08-31 Thread Edmon Begoli
Thanks, Daniel. Definitely helpful. On Mon, Aug 31, 2015 at 3:00 PM, Daniel Barclay wrote: > Edmon, > > I see you're working on adding documentation about creating storage > plug-ins. > > I was looking into that myself a little while ago, but wasn't able to > continue. > > Below are some notes o

Dev tool

2015-08-31 Thread Edmon Begoli
What are you all programming Drill with? IDEA, eclipse, vim, emacs, sublime, atom, ...? I started with Sublime with vim bindings, but I am switching to IDEA 14.1. Easier to catch errors before running manual compiles ...

What components need to be fixed for this

2015-09-01 Thread Edmon Begoli
I would like to look into solution for these two issues: https://issues.apache.org/jira/browse/DRILL-3726 https://issues.apache.org/jira/browse/DRILL-3712 Can someone advise, to the best of your knowledge, what components might be the source of the issue. Thank you, Edmon

Re: The meaning of the methods in StoragePlugin and EasyFormatPlugin

2015-09-04 Thread Edmon Begoli
Thanks, Daniel. I'll ask questions here and expand these, put them into a Markdown and run them by you all for review. On Thursday, September 3, 2015, Daniel Barclay wrote: > I wrote: > > ... Below are some notes on the detailed requirements I had extracted from > the code. ... > > I found a

Re: The meaning of the methods in StoragePlugin and EasyFormatPlugin

2015-09-04 Thread Edmon Begoli
Which gives me an idea - storage plug in for Excel using POI or something like that - a r/w for Excel spreadsheets. Not sexy, but when it comes to data, covers the most widely used tabular data format. On Thursday, September 3, 2015, Daniel Barclay wrote: > I wrote: > > ... Below are some notes

Re: The meaning of the methods in StoragePlugin and EasyFormatPlugin

2015-09-04 Thread Edmon Begoli
I.e. - we would add support for .xls, .xlsx for Drill. Who can mentor me to do this? I think it would be a great new feature for Drill to add this support. What do you think? On Friday, September 4, 2015, Edmon Begoli wrote: > Which gives me an idea - storage plug in for Excel using POI

Who is coming to Strata NYC?

2015-09-04 Thread Edmon Begoli
I am planning on going. Maybe we can have a little gathering.

Re: Potential resource for large scale testing

2015-09-04 Thread Edmon Begoli
the test suite. Rahul, et al are working on > this > > and I would suggest watching out for Rahul's posts on the topic. > > > > Parth > > > > On Tue, Aug 25, 2015 at 9:55 PM, Edmon Begoli > wrote: > > > > > Hey folks, > > > > > >

Data representation and conversation - translating nested hierarchies into a tabular/queriable format

2015-09-05 Thread Edmon Begoli
This relates to the number of formats that I would like to bring under Drill. In business, documents frequently represent hierarchical transactions - orders, claims, patient visits, inventory lookups. These have hierarchical structures that, at least have header data, line items and, sometimes, f

Re: Data representation and conversation - translating nested hierarchies into a tabular/queriable format

2015-09-05 Thread Edmon Begoli
ation please let me know. On Saturday, September 5, 2015, Ted Dunning wrote: > On Sat, Sep 5, 2015 at 8:57 AM, Edmon Begoli > wrote: > > > *My question - has this been handled already in Drill and storage > formats?* > > > > If so, where? > > > > If no

Re: Data representation and conversation - translating nested hierarchies into a tabular/queriable format

2015-09-05 Thread Edmon Begoli
Anyone else from the Drill team wholeheartedly invited. Edmon On Sat, Sep 5, 2015 at 7:04 PM, Edmon Begoli wrote: > Let's do it, Ted. I think it would add tremendous value to Drill as a > solution. > > I will start a Google doc and share with you so we can share ideas, > h

Re: Data representation and conversation - translating nested hierarchies into a tabular/queriable format

2015-09-05 Thread Edmon Begoli
ls for parsing such files. > > Regards, > Matt > > Sent from my iPhone > > > On Sep 5, 2015, at 7:44 PM, Edmon Begoli wrote: > > > > Anyone else from the Drill team wholeheartedly invited. > > > > Edmon > > > >> On Sat, Sep 5, 2015

Re: Potential resource for large scale testing

2015-09-05 Thread Edmon Begoli
duals can contribute to open source projects. It shouldn't be > too hard since there are quite a number of NSF funded people who do > contribute. > > > > > > On Fri, Sep 4, 2015 at 9:39 PM, Edmon Begoli > wrote: > > > I can work with my institution and the NS

Re: Data representation and conversation - translating nested hierarchies into a tabular/queriable format

2015-09-06 Thread Edmon Begoli
bular data sources), I'm also looking into a > Gremlin <http://tinkerpop.incubator.apache.org/> plugin, which could > connect Graph Databases with Drill. Again, the problem is representing > non-tabular data in a SQL environment as you mentioned. > > Regards, > Matt >

Use of FreeMarker

2015-09-06 Thread Edmon Begoli
I noticed that some of the components (e.g. StringOutputRecordWriter) are implemented using FreeMarker. Is this a design principle that we should follow, and if so why and how?

A quick question on the intent for some of the methods in AbstractRecordReader

2015-09-06 Thread Edmon Begoli
In AbstractRecordReader: What is the intent of the following methods (my comments or questions follow #. I will try to add the answers as javadoc) # is this a collection of columns specified in the query projection (select columns[1],...[n]? protected final void setColumns(Collection projected

Re: Hangout happening now!

2015-09-08 Thread Edmon Begoli
Sorry guys I missed this. I was in a meeting with a customer. I wanted to talk about integration test resources. I will join next Tuesday. On Tue, Sep 8, 2015 at 1:01 PM, Parth Chandra wrote: > Come join the Drill community as we discuss what has been happening lately > and what is in the pipeli

Maven build failing on checkstyle

2015-09-08 Thread Edmon Begoli
I am running build on my fork, and Maven build is failing on the checkstyle: excerpt ... [INFO] --- maven-checkstyle-plugin:2.12.1:check (checkstyle-validation) @ drill-java-exec --- [INFO] Starting audit... /Users/ebegoli/drill/exec/java-exec/src/main/java/org/apache/drill/exec/store/AbstractS

Re: Maven build failing on checkstyle

2015-09-09 Thread Edmon Begoli
Tue, Sep 8, 2015 at 11:48 PM, Edmon Begoli wrote: > I am running build on my fork, and Maven build is failing on the > checkstyle: > > excerpt ... > > [INFO] --- maven-checkstyle-plugin:2.12.1:check (checkstyle-validation) @ > drill-java-exec --- > > [INFO] Starting

Re: Maven build failing on checkstyle

2015-09-09 Thread Edmon Begoli
le to be less draconian if > > you would be willing to file the JIRA. > > > > > > > > On Wed, Sep 9, 2015 at 5:14 AM, Edmon Begoli wrote: > > > > > and I am sorry to bug you with this but to me, this was a prefectly > > > formatted javadoc an

Re: Maven build failing on checkstyle

2015-09-09 Thread Edmon Begoli
Ted et al., I created an issue as a "wish" for possible loosening up of the checkstyle. https://issues.apache.org/jira/browse/DRILL-3756 On Wed, Sep 9, 2015 at 2:42 PM, Edmon Begoli wrote: > I will do whatever your suggest. I stripped spaces and re-comitted and > merged i

IDEA settings jar file is missing on the website - does anyone have one to share?

2015-09-09 Thread Edmon Begoli
Colleagues, Does anyone have a general IntelliJ IDEA settings jar file to share. The one listed on the contributors website is broken: https://drill.apache.org/docs/apache-drill-contribution-guidelines/ I entered issue on JIRA: https://issues.apache.org/jira/browse/DRILL-3757 Thank you, Edmon

Re: [jira] [Created] (DRILL-4638) Netflix support

2016-04-23 Thread Edmon Begoli
How in the world did this sneak into the JIRA? Are we going to get next an email from alleged Nigerian prince about the massive inheritance? On Sat, Apr 23, 2016 at 1:01 PM, Admas lewis (JIRA) wrote: > Admas lewis created DRILL-4638: > -- > > Summary

Probabilistic data structures in Drill

2016-04-30 Thread Edmon Begoli
Is Drill using any of the probabilistic data structures [1], and if so - which ones and how? Thank you, Edmon 1. Probabilistic Data Structures - https://en.m.wikipedia.org/wiki/Category:Probabilistic_data_structures

Re: Probabilistic data structures in Drill

2016-05-01 Thread Edmon Begoli
to go through a single function which > > definitely limits scalability. This was several months ago, though, so > > things may have improved by now. > > > > Perhaps somebody can comment on whether multi-level user-defined > > aggregators are possible? > > > &g

[jira] [Created] (DRILL-3792) Improve documentation of the JSON plugin.

2015-09-16 Thread Edmon Begoli (JIRA)
Edmon Begoli created DRILL-3792: --- Summary: Improve documentation of the JSON plugin. Key: DRILL-3792 URL: https://issues.apache.org/jira/browse/DRILL-3792 Project: Apache Drill Issue Type

[jira] [Created] (DRILL-3878) Support XML Querying (selects/projections, no writing)

2015-10-01 Thread Edmon Begoli (JIRA)
Edmon Begoli created DRILL-3878: --- Summary: Support XML Querying (selects/projections, no writing) Key: DRILL-3878 URL: https://issues.apache.org/jira/browse/DRILL-3878 Project: Apache Drill

[jira] [Created] (DRILL-3674) RuntimeException - Unknown variable or type "logger"

2015-08-19 Thread Edmon Begoli (JIRA)
Edmon Begoli created DRILL-3674: --- Summary: RuntimeException - Unknown variable or type "logger" Key: DRILL-3674 URL: https://issues.apache.org/jira/browse/DRILL-3674 Project: Ap

[jira] [Created] (DRILL-3682) Inaccurate documentation for contributors

2015-08-20 Thread Edmon Begoli (JIRA)
Edmon Begoli created DRILL-3682: --- Summary: Inaccurate documentation for contributors Key: DRILL-3682 URL: https://issues.apache.org/jira/browse/DRILL-3682 Project: Apache Drill Issue Type: Bug

[jira] [Created] (DRILL-3712) Drill does not recognize UTF-16-LE encoding

2015-08-25 Thread Edmon Begoli (JIRA)
Edmon Begoli created DRILL-3712: --- Summary: Drill does not recognize UTF-16-LE encoding Key: DRILL-3712 URL: https://issues.apache.org/jira/browse/DRILL-3712 Project: Apache Drill Issue Type

[jira] [Created] (DRILL-3724) Improve javadoc/documentation of the fundamental interfaces and abstract classes.

2015-08-29 Thread Edmon Begoli (JIRA)
Edmon Begoli created DRILL-3724: --- Summary: Improve javadoc/documentation of the fundamental interfaces and abstract classes. Key: DRILL-3724 URL: https://issues.apache.org/jira/browse/DRILL-3724

[jira] [Created] (DRILL-3726) Drill is not properly interpreting CRLF (0d0a). CR gets read as content.

2015-08-31 Thread Edmon Begoli (JIRA)
Edmon Begoli created DRILL-3726: --- Summary: Drill is not properly interpreting CRLF (0d0a). CR gets read as content. Key: DRILL-3726 URL: https://issues.apache.org/jira/browse/DRILL-3726 Project: Apache

[jira] [Created] (DRILL-3736) Documentation for partition is misleading/wrong syntax

2015-09-02 Thread Edmon Begoli (JIRA)
Edmon Begoli created DRILL-3736: --- Summary: Documentation for partition is misleading/wrong syntax Key: DRILL-3736 URL: https://issues.apache.org/jira/browse/DRILL-3736 Project: Apache Drill

[jira] [Created] (DRILL-3738) Create StoragePlugin for Excel files (.xlsx or .possibly xls)

2015-09-04 Thread Edmon Begoli (JIRA)
Edmon Begoli created DRILL-3738: --- Summary: Create StoragePlugin for Excel files (.xlsx or .possibly xls) Key: DRILL-3738 URL: https://issues.apache.org/jira/browse/DRILL-3738 Project: Apache Drill

[jira] [Created] (DRILL-3747) UDF for "fuzzy" string and similarity matching

2015-09-08 Thread Edmon Begoli (JIRA)
Edmon Begoli created DRILL-3747: --- Summary: UDF for "fuzzy" string and similarity matching Key: DRILL-3747 URL: https://issues.apache.org/jira/browse/DRILL-3747 Project: Apache Drill

[jira] [Created] (DRILL-3752) Developer documentation not accurate.

2015-09-08 Thread Edmon Begoli (JIRA)
Edmon Begoli created DRILL-3752: --- Summary: Developer documentation not accurate. Key: DRILL-3752 URL: https://issues.apache.org/jira/browse/DRILL-3752 Project: Apache Drill Issue Type: Bug

[jira] [Created] (DRILL-3756) Consider loosening up the Maven checkstyle audit

2015-09-09 Thread Edmon Begoli (JIRA)
Edmon Begoli created DRILL-3756: --- Summary: Consider loosening up the Maven checkstyle audit Key: DRILL-3756 URL: https://issues.apache.org/jira/browse/DRILL-3756 Project: Apache Drill Issue

[jira] [Created] (DRILL-3757) Link to IntelliJ IDEA settings jar on the contributors guidelines page is broken.

2015-09-09 Thread Edmon Begoli (JIRA)
Edmon Begoli created DRILL-3757: --- Summary: Link to IntelliJ IDEA settings jar on the contributors guidelines page is broken. Key: DRILL-3757 URL: https://issues.apache.org/jira/browse/DRILL-3757