[GitHub] drill pull request #1027: DRILL-4779 : Kafka storage plugin

2017-11-10 Thread akumarb2010
Github user akumarb2010 commented on a diff in the pull request: https://github.com/apache/drill/pull/1027#discussion_r150376586 --- Diff: contrib/storage-kafka/src/test/java/org/apache/drill/exec/store/kafka/cluster/EmbeddedZKQuorum.java --- @@ -0,0 +1,83 @@ +/** --- End

[GitHub] drill pull request #1027: DRILL-4779 : Kafka storage plugin

2017-11-10 Thread akumarb2010
Github user akumarb2010 commented on a diff in the pull request: https://github.com/apache/drill/pull/1027#discussion_r150376174 --- Diff: contrib/storage-kafka/README.md --- @@ -0,0 +1,230 @@ +# Drill Kafka Plugin + +Drill kafka storage plugin allows you to perform inte

[GitHub] drill issue #984: DRILL-5783 Made a unit test for generated Priority Queue. ...

2017-11-10 Thread ilooner
Github user ilooner commented on the issue: https://github.com/apache/drill/pull/984 After squashing the commits and rebasing I noticed the windows functional tests were failing. The issue was caused by replacing the '/' constant in FileUtils (now renamed to DrillFileUtils) in **Class

[GitHub] drill issue #1026: DRILL-5919: Add non-numeric support for JSON processing

2017-11-10 Thread paul-rogers
Github user paul-rogers commented on the issue: https://github.com/apache/drill/pull/1026 Further, is the extra option to `convertFromJSON` really needed? Can't we just accept `NaN` and `Infinity` by default? Consider. If the option is off by default, users without `NaN` or `

[GitHub] drill issue #1030: DRILL-5941: Skip header / footer improvements for Hive st...

2017-11-10 Thread ppadma
Github user ppadma commented on the issue: https://github.com/apache/drill/pull/1030 @arina-ielchiieva I have a question. If the splits for a file are spread across multiple fragments, does this logic work ? ---

[GitHub] drill issue #1023: DRILL-5922 Fixed Child Allocator Leak. DRILL-5926 Stabali...

2017-11-10 Thread paul-rogers
Github user paul-rogers commented on the issue: https://github.com/apache/drill/pull/1023 For commit, let's do this: * With luck, Arina will commit two PRs this week that may conflict: PR #970, and PR #978. * Tim should rebase this PR on top of those changes once they are

[GitHub] drill pull request #1033: DRILL-5952: Implement "CREATE TABLE IF NOT EXISTS"

2017-11-10 Thread prasadns14
Github user prasadns14 commented on a diff in the pull request: https://github.com/apache/drill/pull/1033#discussion_r150364771 --- Diff: exec/java-exec/src/main/codegen/includes/parserImpls.ftl --- @@ -215,11 +215,12 @@ SqlNode SqlDropView() : /** * Parses a CTAS o

[GitHub] drill pull request #1033: DRILL-5952: Implement "CREATE TABLE IF NOT EXISTS"

2017-11-10 Thread Agirish
Github user Agirish commented on a diff in the pull request: https://github.com/apache/drill/pull/1033#discussion_r150364581 --- Diff: exec/java-exec/src/main/codegen/includes/parserImpls.ftl --- @@ -215,11 +215,12 @@ SqlNode SqlDropView() : /** * Parses a CTAS or C

[GitHub] drill pull request #1033: DRILL-5952: Implement "CREATE TABLE IF NOT EXISTS"

2017-11-10 Thread prasadns14
GitHub user prasadns14 opened a pull request: https://github.com/apache/drill/pull/1033 DRILL-5952: Implement "CREATE TABLE IF NOT EXISTS" 1) Addedsupport for CREATE TABLE 2) Added unit tests for the same @paul-rogers please review You can merge this pull request in

[jira] [Created] (DRILL-5952) Implement "CREATE TABLE IF NOT EXISTS"

2017-11-10 Thread Prasad Nagaraj Subramanya (JIRA)
Prasad Nagaraj Subramanya created DRILL-5952: Summary: Implement "CREATE TABLE IF NOT EXISTS" Key: DRILL-5952 URL: https://issues.apache.org/jira/browse/DRILL-5952 Project: Apache Drill

[GitHub] drill pull request #1026: DRILL-5919: Add non-numeric support for JSON proce...

2017-11-10 Thread paul-rogers
Github user paul-rogers commented on a diff in the pull request: https://github.com/apache/drill/pull/1026#discussion_r150359565 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/expr/fn/impl/conv/JsonConvertFrom.java --- @@ -91,4 +92,60 @@ public void eval(){

[GitHub] drill pull request #1026: DRILL-5919: Add non-numeric support for JSON proce...

2017-11-10 Thread paul-rogers
Github user paul-rogers commented on a diff in the pull request: https://github.com/apache/drill/pull/1026#discussion_r150361681 --- Diff: exec/java-exec/src/test/java/org/apache/drill/exec/vector/complex/writer/TestJsonNonNumerics.java --- @@ -0,0 +1,167 @@ +/* +* License

[GitHub] drill pull request #1026: DRILL-5919: Add non-numeric support for JSON proce...

2017-11-10 Thread paul-rogers
Github user paul-rogers commented on a diff in the pull request: https://github.com/apache/drill/pull/1026#discussion_r150359510 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/expr/fn/impl/conv/JsonConvertFrom.java --- @@ -91,4 +92,60 @@ public void eval(){

[GitHub] drill pull request #1026: DRILL-5919: Add non-numeric support for JSON proce...

2017-11-10 Thread paul-rogers
Github user paul-rogers commented on a diff in the pull request: https://github.com/apache/drill/pull/1026#discussion_r150360192 --- Diff: exec/java-exec/src/main/resources/drill-module.conf --- @@ -502,6 +502,8 @@ drill.exec.options: { store.format: "parquet", sto

[GitHub] drill pull request #1026: DRILL-5919: Add non-numeric support for JSON proce...

2017-11-10 Thread paul-rogers
Github user paul-rogers commented on a diff in the pull request: https://github.com/apache/drill/pull/1026#discussion_r150359992 --- Diff: contrib/storage-mongo/src/main/java/org/apache/drill/exec/store/mongo/MongoRecordReader.java --- @@ -73,6 +73,7 @@ private final MongoS

[GitHub] drill pull request #1026: DRILL-5919: Add non-numeric support for JSON proce...

2017-11-10 Thread paul-rogers
Github user paul-rogers commented on a diff in the pull request: https://github.com/apache/drill/pull/1026#discussion_r150359452 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/expr/fn/impl/conv/JsonConvertFrom.java --- @@ -76,7 +77,7 @@ public void eval(){ @

[GitHub] drill pull request #1026: DRILL-5919: Add non-numeric support for JSON proce...

2017-11-10 Thread paul-rogers
Github user paul-rogers commented on a diff in the pull request: https://github.com/apache/drill/pull/1026#discussion_r150360424 --- Diff: exec/java-exec/src/test/java/org/apache/drill/exec/vector/complex/writer/TestJsonNonNumerics.java --- @@ -0,0 +1,167 @@ +/* +* License

[GitHub] drill pull request #1026: DRILL-5919: Add non-numeric support for JSON proce...

2017-11-10 Thread paul-rogers
Github user paul-rogers commented on a diff in the pull request: https://github.com/apache/drill/pull/1026#discussion_r150359353 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/expr/fn/impl/conv/JsonConvertFrom.java --- @@ -50,7 +51,7 @@ private JsonConvertFrom(){}

[GitHub] drill pull request #1026: DRILL-5919: Add non-numeric support for JSON proce...

2017-11-10 Thread paul-rogers
Github user paul-rogers commented on a diff in the pull request: https://github.com/apache/drill/pull/1026#discussion_r150360309 --- Diff: exec/java-exec/src/main/resources/drill-module.conf --- @@ -502,6 +502,8 @@ drill.exec.options: { store.format: "parquet", sto

[GitHub] drill pull request #1026: DRILL-5919: Add non-numeric support for JSON proce...

2017-11-10 Thread paul-rogers
Github user paul-rogers commented on a diff in the pull request: https://github.com/apache/drill/pull/1026#discussion_r150360262 --- Diff: exec/java-exec/src/main/resources/drill-module.conf --- @@ -502,6 +502,8 @@ drill.exec.options: { store.format: "parquet", sto

[GitHub] drill pull request #1026: DRILL-5919: Add non-numeric support for JSON proce...

2017-11-10 Thread paul-rogers
Github user paul-rogers commented on a diff in the pull request: https://github.com/apache/drill/pull/1026#discussion_r150359625 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/expr/fn/impl/conv/JsonConvertTo.java --- @@ -90,7 +91,71 @@ public void eval(){

[GitHub] drill pull request #1026: DRILL-5919: Add non-numeric support for JSON proce...

2017-11-10 Thread paul-rogers
Github user paul-rogers commented on a diff in the pull request: https://github.com/apache/drill/pull/1026#discussion_r150360475 --- Diff: exec/java-exec/src/test/java/org/apache/drill/exec/vector/complex/writer/TestJsonNonNumerics.java --- @@ -0,0 +1,167 @@ +/* +* License

[GitHub] drill issue #1023: DRILL-5922 Fixed Child Allocator Leak. DRILL-5926 Stabali...

2017-11-10 Thread ilooner
Github user ilooner commented on the issue: https://github.com/apache/drill/pull/1023 *Note for batch committer:* Please do not squash the two commits in this PR. Please see the discussion on **pom.xml** for details. ---

[GitHub] drill pull request #1023: DRILL-5922 Fixed Child Allocator Leak. DRILL-5926 ...

2017-11-10 Thread vrozov
Github user vrozov commented on a diff in the pull request: https://github.com/apache/drill/pull/1023#discussion_r150348155 --- Diff: pom.xml --- @@ -442,7 +442,7 @@ -Dorg.apache.drill.exec.server.Drillbit.system_options="org.apache.drill.exec.compile.ClassTransf

[GitHub] drill pull request #1023: DRILL-5922 Fixed Child Allocator Leak. DRILL-5926 ...

2017-11-10 Thread paul-rogers
Github user paul-rogers commented on a diff in the pull request: https://github.com/apache/drill/pull/1023#discussion_r150345195 --- Diff: pom.xml --- @@ -442,7 +442,7 @@ -Dorg.apache.drill.exec.server.Drillbit.system_options="org.apache.drill.exec.compile.ClassT

[GitHub] drill issue #1014: DRILL-5771: Fix serDe errors for format plugins

2017-11-10 Thread ilooner
Github user ilooner commented on the issue: https://github.com/apache/drill/pull/1014 @paul-rogers Thanks for the explanation. Your explanation is in sync with Arina's descriptions in the ticket and with the code changes. The only point of confusion I have now is with regards to the C

[GitHub] drill pull request #1023: DRILL-5922 Fixed Child Allocator Leak. DRILL-5926 ...

2017-11-10 Thread ilooner
Github user ilooner commented on a diff in the pull request: https://github.com/apache/drill/pull/1023#discussion_r150339444 --- Diff: pom.xml --- @@ -442,7 +442,7 @@ -Dorg.apache.drill.exec.server.Drillbit.system_options="org.apache.drill.exec.compile.ClassTrans

[GitHub] drill pull request #1023: DRILL-5922 Fixed Child Allocator Leak. DRILL-5926 ...

2017-11-10 Thread paul-rogers
Github user paul-rogers commented on a diff in the pull request: https://github.com/apache/drill/pull/1023#discussion_r150336286 --- Diff: pom.xml --- @@ -442,7 +442,7 @@ -Dorg.apache.drill.exec.server.Drillbit.system_options="org.apache.drill.exec.compile.ClassT

[GitHub] drill pull request #1025: DRILL-5936: Refactor MergingRecordBatch based on c...

2017-11-10 Thread amansinha100
Github user amansinha100 commented on a diff in the pull request: https://github.com/apache/drill/pull/1025#discussion_r150335985 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/physical/impl/mergereceiver/MergingRecordBatch.java --- @@ -795,6 +788,8 @@ private void g

[GitHub] drill pull request #1025: DRILL-5936: Refactor MergingRecordBatch based on c...

2017-11-10 Thread vrozov
Github user vrozov commented on a diff in the pull request: https://github.com/apache/drill/pull/1025#discussion_r150331389 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/physical/impl/mergereceiver/MergingRecordBatch.java --- @@ -795,6 +788,8 @@ private void generat

[GitHub] drill pull request #1025: DRILL-5936: Refactor MergingRecordBatch based on c...

2017-11-10 Thread amansinha100
Github user amansinha100 commented on a diff in the pull request: https://github.com/apache/drill/pull/1025#discussion_r150329246 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/physical/impl/mergereceiver/MergingRecordBatch.java --- @@ -795,6 +788,8 @@ private void g

[GitHub] drill pull request #1023: DRILL-5922 Fixed Child Allocator Leak. DRILL-5926 ...

2017-11-10 Thread ilooner
Github user ilooner commented on a diff in the pull request: https://github.com/apache/drill/pull/1023#discussion_r150327067 --- Diff: pom.xml --- @@ -442,7 +442,7 @@ -Dorg.apache.drill.exec.server.Drillbit.system_options="org.apache.drill.exec.compile.ClassTrans

[GitHub] drill pull request #1025: DRILL-5936: Refactor MergingRecordBatch based on c...

2017-11-10 Thread vrozov
Github user vrozov commented on a diff in the pull request: https://github.com/apache/drill/pull/1025#discussion_r150326663 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/physical/impl/mergereceiver/MergingRecordBatch.java --- @@ -177,11 +177,11 @@ public IterOutcome

[GitHub] drill pull request #1023: DRILL-5922 Fixed Child Allocator Leak. DRILL-5926 ...

2017-11-10 Thread vrozov
Github user vrozov commented on a diff in the pull request: https://github.com/apache/drill/pull/1023#discussion_r150322554 --- Diff: pom.xml --- @@ -442,7 +442,7 @@ -Dorg.apache.drill.exec.server.Drillbit.system_options="org.apache.drill.exec.compile.ClassTransf

[GitHub] drill issue #1014: DRILL-5771: Fix serDe errors for format plugins

2017-11-10 Thread paul-rogers
Github user paul-rogers commented on the issue: https://github.com/apache/drill/pull/1014 @ilooner, there are two phases of issues. The problem is in the planner, but we've been talking about serialization out to the workers. Here, we can learn from the work Arina did with dyn

[GitHub] drill issue #1025: DRILL-5936: Refactor MergingRecordBatch based on code rev...

2017-11-10 Thread amansinha100
Github user amansinha100 commented on the issue: https://github.com/apache/drill/pull/1025 +1 with a minor comment. In the commit message and JIRA it would be better to say 'code inspection' instead of code review which may be interpreted to mean the normal code review process.

[GitHub] drill pull request #1025: DRILL-5936: Refactor MergingRecordBatch based on c...

2017-11-10 Thread amansinha100
Github user amansinha100 commented on a diff in the pull request: https://github.com/apache/drill/pull/1025#discussion_r150310556 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/physical/impl/mergereceiver/MergingRecordBatch.java --- @@ -177,11 +177,11 @@ public IterO

[GitHub] drill issue #1014: DRILL-5771: Fix serDe errors for format plugins

2017-11-10 Thread ilooner
Github user ilooner commented on the issue: https://github.com/apache/drill/pull/1014 @paul-rogers I follow your explanation except for the last paragraph. The Drill UI let's me update storage plugins and their formatters at runtime (at least on my laptop) by going to **Storag

[GitHub] drill pull request #1023: DRILL-5922 Fixed Child Allocator Leak. DRILL-5926 ...

2017-11-10 Thread ilooner
Github user ilooner commented on a diff in the pull request: https://github.com/apache/drill/pull/1023#discussion_r150302692 --- Diff: pom.xml --- @@ -442,7 +442,7 @@ -Dorg.apache.drill.exec.server.Drillbit.system_options="org.apache.drill.exec.compile.ClassTrans

[GitHub] drill pull request #914: DRILL-5657: Size-aware vector writer structure

2017-11-10 Thread parthchandra
Github user parthchandra commented on a diff in the pull request: https://github.com/apache/drill/pull/914#discussion_r149764036 --- Diff: exec/vector/src/main/java/org/apache/drill/exec/vector/accessor/writer/BaseScalarWriter.java --- @@ -0,0 +1,264 @@ +/* + * Licensed to

[GitHub] drill pull request #914: DRILL-5657: Size-aware vector writer structure

2017-11-10 Thread parthchandra
Github user parthchandra commented on a diff in the pull request: https://github.com/apache/drill/pull/914#discussion_r149765040 --- Diff: exec/vector/src/main/java/org/apache/drill/exec/record/MaterializedField.java --- @@ -168,6 +174,58 @@ public boolean equals(Object obj) {

[GitHub] drill pull request #914: DRILL-5657: Size-aware vector writer structure

2017-11-10 Thread parthchandra
Github user parthchandra commented on a diff in the pull request: https://github.com/apache/drill/pull/914#discussion_r149758695 --- Diff: exec/vector/src/main/codegen/templates/ColumnAccessors.java --- @@ -191,141 +180,268 @@ public void bind(RowIndex vectorIndex, ValueVector vect

[GitHub] drill pull request #914: DRILL-5657: Size-aware vector writer structure

2017-11-10 Thread parthchandra
Github user parthchandra commented on a diff in the pull request: https://github.com/apache/drill/pull/914#discussion_r149759147 --- Diff: exec/vector/src/main/codegen/templates/ColumnAccessors.java --- @@ -191,141 +180,268 @@ public void bind(RowIndex vectorIndex, ValueVector vect

[GitHub] drill pull request #914: DRILL-5657: Size-aware vector writer structure

2017-11-10 Thread parthchandra
Github user parthchandra commented on a diff in the pull request: https://github.com/apache/drill/pull/914#discussion_r149760234 --- Diff: exec/java-exec/src/test/java/org/apache/drill/test/rowSet/test/RowSetTest.java --- @@ -19,420 +19,648 @@ import static org.junit.As

[jira] [Created] (DRILL-5951) Transaction Support (CRUD) operations on HBase and MongoDB

2017-11-10 Thread Saurabh Mahapatra (JIRA)
Saurabh Mahapatra created DRILL-5951: Summary: Transaction Support (CRUD) operations on HBase and MongoDB Key: DRILL-5951 URL: https://issues.apache.org/jira/browse/DRILL-5951 Project: Apache Drill

[GitHub] drill pull request #1023: DRILL-5922 Fixed Child Allocator Leak. DRILL-5926 ...

2017-11-10 Thread vrozov
Github user vrozov commented on a diff in the pull request: https://github.com/apache/drill/pull/1023#discussion_r150259975 --- Diff: pom.xml --- @@ -442,7 +442,7 @@ -Dorg.apache.drill.exec.server.Drillbit.system_options="org.apache.drill.exec.compile.ClassTransf