[jira] [Created] (HIVE-4596) Fix serialization exceptions in VectorGroupByOperator

2013-05-23 Thread Remus Rusanu (JIRA)
Remus Rusanu created HIVE-4596:
--

 Summary: Fix serialization exceptions in VectorGroupByOperator
 Key: HIVE-4596
 URL: https://issues.apache.org/jira/browse/HIVE-4596
 Project: Hive
  Issue Type: Sub-task
  Components: Query Processor
Affects Versions: vectorization-branch
Reporter: Remus Rusanu
Assignee: Remus Rusanu
Priority: Minor




--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Created] (HIVE-4595) Support strings in GROUP BY keys

2013-05-23 Thread Remus Rusanu (JIRA)
Remus Rusanu created HIVE-4595:
--

 Summary: Support strings in GROUP BY keys
 Key: HIVE-4595
 URL: https://issues.apache.org/jira/browse/HIVE-4595
 Project: Hive
  Issue Type: Sub-task
  Components: Query Processor
Affects Versions: vectorization-branch
Reporter: Remus Rusanu
Assignee: Remus Rusanu




--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Created] (HIVE-4598) Incorrect results when using subquery in multi table insert

2013-05-23 Thread Sebastian (JIRA)
Sebastian created HIVE-4598:
---

 Summary: Incorrect results when using subquery in multi table 
insert
 Key: HIVE-4598
 URL: https://issues.apache.org/jira/browse/HIVE-4598
 Project: Hive
  Issue Type: Bug
  Components: Query Processor
Affects Versions: 0.11.0
Reporter: Sebastian


I'm using a multi table insert like this:
FROM x
INSERT INTO TABLE t PARTITION (type='x')
SELECT * WHERE type='x'
INSERT INTO TABLE t PARTITION (type='y')
SELECT * WHERE type='y';

Now when x is the name of a table, everything works as expected.
However if I use a subquery as x, the query runs but it inserts all results 
from the subquery into each partition, as if there were no WHERE clauses in 
the selects.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Commented] (HIVE-4581) HCat e2e tests broken by changes to Hive's describe table formatting

2013-05-23 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-4581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13664971#comment-13664971
 ] 

Hudson commented on HIVE-4581:
--

Integrated in Hive-trunk-h0.21 #2114 (See 
[https://builds.apache.org/job/Hive-trunk-h0.21/2114/])
HIVE-4581 HCat e2e tests broken by changes to Hive's describe table 
formatting (gates) (Revision 1485472)

 Result = FAILURE
gates : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1485472
Files : 
* /hive/trunk/hcatalog/src/test/e2e/hcatalog/tests/hcat.conf


 HCat e2e tests broken by changes to Hive's describe table formatting
 

 Key: HIVE-4581
 URL: https://issues.apache.org/jira/browse/HIVE-4581
 Project: Hive
  Issue Type: Bug
  Components: Tests
Affects Versions: 0.11.0
Reporter: Alan Gates
Assignee: Alan Gates
 Fix For: 0.12.0

 Attachments: HIVE-4581.patch


 In Hive 0.11 the default formatting for describe table changed.  A number of 
 the HCat e2e tests do describe table and apply regular expressions to the 
 output to make sure the table looks correct.  These formatting changes broke 
 those tests.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


Hive-trunk-h0.21 - Build # 2114 - Still Failing

2013-05-23 Thread Apache Jenkins Server
Changes for Build #2089
[cws] HIVE-3957. Add pseudo-BNF grammar for RCFile to Javadoc (Mark Grover via 
cws)

[cws] HIVE-4497. beeline module tests don't get run by default (Thejas Nair via 
cws)

[gangtimliu] HIVE-4474: Column access not tracked properly for partitioned 
tables. Samuel Yuan via Gang Tim Liu

[hashutosh] HIVE-4455 : HCatalog build directories get included in tar file 
produced by ant tar (Alan Gates via Ashutosh Chauhan)


Changes for Build #2090

Changes for Build #2091
[hashutosh] HIVE-4392 : Illogical InvalidObjectException throwed when use mulit 
aggregate functions with star columns  (Navis via Ashutosh Chauhan)

[hashutosh] HIVE-4421 : Improve memory usage by ORC dictionaries (Owen Omalley 
via Ashutosh Chauhan)

[mithun] HCATALOG-627 - Adding thread-safety to NotificationListener. (amalakar 
via mithun)


Changes for Build #2092
[hashutosh] HIVE-4466 : Fix continue.on.failure in unit tests to -well- 
continue on failure in unit tests (Gunther Hagleitner via Ashutosh Chauhan)

[hashutosh] HIVE-4471 : Build fails with hcatalog checkstyle error (Gunther 
Hagleitner via Ashutosh Chauhan)


Changes for Build #2093
[omalley] HIVE-4494 ORC map columns get class cast exception in some contexts 
(omalley)

[omalley] HIVE-4500 Ensure that HiveServer 2 closes log files. (Alan Gates via 
omalley)


Changes for Build #2094
[navis] HIVE-4209 Cache evaluation result of deterministic expression and reuse 
it (Navis via namit)


Changes for Build #2095

Changes for Build #2096

Changes for Build #2097
[cws] HIVE-4530. Enforce minmum ant version required in build script (Arup 
Malakar via cws)

[omalley] Preparing RELEASE_NOTES for Hive 0.11.0rc2.


Changes for Build #2098
[omalley] Update release notes for 0.11.0rc2

[omalley] HIVE-4527 Fix eclipse project template (Carl Steinbach via omalley)

[omalley] HIVE-4505 Hive can't load transforms with remote scripts. (Prasad 
Majumdar and Gunther Hagleitner
via omalley)

[omalley] HIVE-4498 TestBeeLineWithArgs.testPositiveScriptFile fails (Thejas 
Nair via omalley)


Changes for Build #2099

Changes for Build #2100

Changes for Build #2101

Changes for Build #2102

Changes for Build #2103
[daijy] PIG-2955: Fix bunch of Pig e2e tests on Windows


Changes for Build #2104
[daijy] PIG-3069: Native Windows Compatibility for Pig E2E Tests and Harness


Changes for Build #2105
[omalley] HIVE-4550 local_mapred_error_cache fails on some hadoop versions 
(Gunther 
Hagleitner via omalley)

[omalley] HIVE-4440 SMB Operator spills to disk like it's 1999 (Gunther 
Hagleitner via
omalley)


Changes for Build #2106

Changes for Build #2107
[omalley] HIVE-4486 FetchOperator slows down SMB map joins by 50% when there 
are many 
partitions (Gopal V via omalley)


Changes for Build #2108

Changes for Build #2109

Changes for Build #2110

Changes for Build #2111
[omalley] HIVE-4475 Switch RCFile default to LazyBinaryColumnarSerDe. (Guther 
Hagleitner
via omalley)

[omalley] HIVE-4521 Auto join conversion fails in certain cases (Gunther 
Hagleitner via
omalley)


Changes for Build #2112

Changes for Build #2113
[gates] HIVE-4578 Changes to Pig's test harness broke HCat e2e tests (gates)


Changes for Build #2114
[gates] HIVE-4581 HCat e2e tests broken by changes to Hive's describe table 
formatting (gates)




All tests passed

The Apache Jenkins build system has built Hive-trunk-h0.21 (build #2114)

Status: Still Failing

Check console output at https://builds.apache.org/job/Hive-trunk-h0.21/2114/ to 
view the results.

[jira] [Commented] (HIVE-4540) JOIN-GRP BY-DISTINCT fails with NPE when mapjoin.mapreduce=true

2013-05-23 Thread Navis (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-4540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13664994#comment-13664994
 ] 

Navis commented on HIVE-4540:
-

+1, will run test

 JOIN-GRP BY-DISTINCT fails with NPE when mapjoin.mapreduce=true
 ---

 Key: HIVE-4540
 URL: https://issues.apache.org/jira/browse/HIVE-4540
 Project: Hive
  Issue Type: Bug
Reporter: Gunther Hagleitner
Assignee: Gunther Hagleitner
 Attachments: HIVE-4540.1.patch


 If the mapjoin.mapreduce optimization kicks in on a query of this form:
 {noformat}
 select count(distinct a.v) 
 from a join b on (a.k = b.k)
 group by a.g
 {noformat}
 The planer will NPE in the metadataonly optimizer.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Commented] (HIVE-4526) auto_sortmerge_join_9.q throws NPE but test is succeeded

2013-05-23 Thread Navis (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-4526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13665009#comment-13665009
 ] 

Navis commented on HIVE-4526:
-

[~appodictic] I've rebased the patch and confirmed working good. Did you run it 
with empty partitions? If it is, I'll check that too.

 auto_sortmerge_join_9.q throws NPE but test is succeeded
 

 Key: HIVE-4526
 URL: https://issues.apache.org/jira/browse/HIVE-4526
 Project: Hive
  Issue Type: Test
  Components: Tests
Reporter: Navis
Assignee: Navis
 Attachments: HIVE-4526.D10725.1.patch


 auto_sortmerge_join_9.q
 {noformat}
 [junit] Running org.apache.hadoop.hive.cli.TestCliDriver
 [junit] Begin query: auto_sortmerge_join_9.q
 [junit] Deleted 
 file:/home/navis/apache/oss-hive/build/ql/test/data/warehouse/tbl1
 [junit] Deleted 
 file:/home/navis/apache/oss-hive/build/ql/test/data/warehouse/tbl2
 [junit] org.apache.hadoop.hive.ql.metadata.HiveException: Failed with 
 exception nulljava.lang.NullPointerException
 [junit]   at 
 org.apache.hadoop.hive.ql.exec.FetchOperator.getRowInspectorFromPartitionedTable(FetchOperator.java:252)
 [junit]   at 
 org.apache.hadoop.hive.ql.exec.FetchOperator.getOutputObjectInspector(FetchOperator.java:605)
 [junit]   at 
 org.apache.hadoop.hive.ql.exec.MapredLocalTask.initializeOperators(MapredLocalTask.java:393)
 [junit]   at 
 org.apache.hadoop.hive.ql.exec.MapredLocalTask.executeFromChildJVM(MapredLocalTask.java:277)
 [junit]   at 
 org.apache.hadoop.hive.ql.exec.ExecDriver.main(ExecDriver.java:676)
 [junit]   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
 [junit]   at 
 sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
 [junit]   at 
 sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
 [junit]   at java.lang.reflect.Method.invoke(Method.java:597)
 [junit]   at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
 [junit] 
 [junit]   at 
 org.apache.hadoop.hive.ql.exec.FetchOperator.getOutputObjectInspector(FetchOperator.java:631)
 [junit]   at 
 org.apache.hadoop.hive.ql.exec.MapredLocalTask.initializeOperators(MapredLocalTask.java:393)
 [junit]   at 
 org.apache.hadoop.hive.ql.exec.MapredLocalTask.executeFromChildJVM(MapredLocalTask.java:277)
 [junit]   at 
 org.apache.hadoop.hive.ql.exec.ExecDriver.main(ExecDriver.java:676)
 [junit]   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
 [junit]   at 
 sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
 [junit]   at 
 sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
 [junit]   at java.lang.reflect.Method.invoke(Method.java:597)
 [junit]   at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
 [junit] org.apache.hadoop.hive.ql.metadata.HiveException: Failed with 
 exception nulljava.lang.NullPointerException
 [junit]   at 
 org.apache.hadoop.hive.ql.exec.FetchOperator.getRowInspectorFromPartitionedTable(FetchOperator.java:252)
 [junit]   at 
 org.apache.hadoop.hive.ql.exec.FetchOperator.getOutputObjectInspector(FetchOperator.java:605)
 [junit]   at 
 org.apache.hadoop.hive.ql.exec.MapredLocalTask.initializeOperators(MapredLocalTask.java:393)
 [junit]   at 
 org.apache.hadoop.hive.ql.exec.MapredLocalTask.executeFromChildJVM(MapredLocalTask.java:277)
 [junit]   at 
 org.apache.hadoop.hive.ql.exec.ExecDriver.main(ExecDriver.java:676)
 [junit]   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
 [junit]   at 
 sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
 [junit]   at 
 sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
 [junit]   at java.lang.reflect.Method.invoke(Method.java:597)
 [junit]   at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
 [junit] 
 [junit]   at 
 org.apache.hadoop.hive.ql.exec.FetchOperator.getOutputObjectInspector(FetchOperator.java:631)
 [junit]   at 
 org.apache.hadoop.hive.ql.exec.MapredLocalTask.initializeOperators(MapredLocalTask.java:393)
 [junit]   at 
 org.apache.hadoop.hive.ql.exec.MapredLocalTask.executeFromChildJVM(MapredLocalTask.java:277)
 [junit]   at 
 org.apache.hadoop.hive.ql.exec.ExecDriver.main(ExecDriver.java:676)
 [junit]   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
 [junit]   at 
 sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
 [junit]   at 
 sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
 [junit]   at java.lang.reflect.Method.invoke(Method.java:597)
 [junit]   at 

[jira] [Commented] (HIVE-3534) Add left Lateral view syntax

2013-05-23 Thread Navis (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-3534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13665011#comment-13665011
 ] 

Navis commented on HIVE-3534:
-

[~appodictic] Interesting. How about make a grammar something like OUTER 
LATERAL VIEW, which could be used more generic with all other UDTFs?

 Add left Lateral view syntax
 

 Key: HIVE-3534
 URL: https://issues.apache.org/jira/browse/HIVE-3534
 Project: Hive
  Issue Type: New Feature
Reporter: Edward Capriolo
Assignee: Edward Capriolo
 Attachments: hive-3534.diff.txt


 A lateral view is like a join and if the function in question (like 
 explode()) produces zero rows then you lose the row
 whereas conceivably you could keep the row and just fill all entry with nulls.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Updated] (HIVE-1402) Add parallel ORDER BY to Hive

2013-05-23 Thread Navis (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-1402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Navis updated HIVE-1402:


Status: Open  (was: Patch Available)

 Add parallel ORDER BY to Hive
 -

 Key: HIVE-1402
 URL: https://issues.apache.org/jira/browse/HIVE-1402
 Project: Hive
  Issue Type: New Feature
  Components: Query Processor
Reporter: Jeff Hammerbacher
Assignee: Navis
  Labels: optimization
 Attachments: HIVE-1402.D8895.1.patch




--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Commented] (HIVE-4581) HCat e2e tests broken by changes to Hive's describe table formatting

2013-05-23 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-4581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13665068#comment-13665068
 ] 

Hudson commented on HIVE-4581:
--

Integrated in Hive-trunk-hadoop2 #207 (See 
[https://builds.apache.org/job/Hive-trunk-hadoop2/207/])
HIVE-4581 HCat e2e tests broken by changes to Hive's describe table 
formatting (gates) (Revision 1485472)

 Result = FAILURE
gates : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1485472
Files : 
* /hive/trunk/hcatalog/src/test/e2e/hcatalog/tests/hcat.conf


 HCat e2e tests broken by changes to Hive's describe table formatting
 

 Key: HIVE-4581
 URL: https://issues.apache.org/jira/browse/HIVE-4581
 Project: Hive
  Issue Type: Bug
  Components: Tests
Affects Versions: 0.11.0
Reporter: Alan Gates
Assignee: Alan Gates
 Fix For: 0.12.0

 Attachments: HIVE-4581.patch


 In Hive 0.11 the default formatting for describe table changed.  A number of 
 the HCat e2e tests do describe table and apply regular expressions to the 
 output to make sure the table looks correct.  These formatting changes broke 
 those tests.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Work started] (HIVE-4595) Support strings in GROUP BY keys

2013-05-23 Thread Remus Rusanu (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-4595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Work on HIVE-4595 started by Remus Rusanu.

 Support strings in GROUP BY keys
 

 Key: HIVE-4595
 URL: https://issues.apache.org/jira/browse/HIVE-4595
 Project: Hive
  Issue Type: Sub-task
  Components: Query Processor
Affects Versions: vectorization-branch
Reporter: Remus Rusanu
Assignee: Remus Rusanu



--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


Review Request: HIVE-4160 Add support for string type keys in vectorized GROUP BY

2013-05-23 Thread Remus Rusanu

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/11345/
---

Review request for hive, Jitendra Pandey, Eric Hanson, and Sarvesh Sakalanaga.


Description
---

Extend the VectorHashKeyWrapper and VectorHashKeyWrapperBatch to support 
ByteColumnVector (ie. string) keys. The addition falls into the existing 
VectorKeyHashWrapper behavior: the string keys support is 'compiled' once per 
query into a VectorHashKeyWrapperBatch instance. The VectorHashKeyWrapper is 
extended to support byte[] key. It stores the key values just like the 
ByteColumnVector class, by using a byte[][], a start int[] and a lenght int[]. 
During batch processing ther eis no value copy, the keywrappers take a 
reference to the data from the batch (ie. they refer the same byte[p] and copy 
the start/length). This avoids potentially expensive size-of-key copy 
operations *before* the hash probe. The VectorHashKeyWrapper clonning that 
occurs when a probe reveleas a missing key in the hash will copy the key (it 
must) and this is the only time we copy the key values.


This addresses bug HIVE-4160.
https://issues.apache.org/jira/browse/HIVE-4160


Diffs
-

  ql/src/java/org/apache/hadoop/hive/ql/exec/VectorHashKeyWrapper.java 35712d0 
  ql/src/java/org/apache/hadoop/hive/ql/exec/VectorHashKeyWrapperBatch.java 
c23614c 
  ql/src/java/org/apache/hadoop/hive/ql/exec/vector/VectorizationContext.java 
1ef4955 
  
ql/src/test/org/apache/hadoop/hive/ql/exec/vector/FakeVectorRowBatchFromObjectIterables.java
 PRE-CREATION 
  
ql/src/test/org/apache/hadoop/hive/ql/exec/vector/TestVectorGroupByOperator.java
 b3b5cd2 
  
ql/src/test/org/apache/hadoop/hive/ql/exec/vector/util/FakeVectorRowBatchFromIterables.java
 cf3399d 
  
ql/src/test/org/apache/hadoop/hive/ql/exec/vector/util/FakeVectorRowBatchFromLongIterables.java
 PRE-CREATION 

Diff: https://reviews.apache.org/r/11345/diff/


Testing
---

Extended vectorized GROUP BY unit test to cover String keys for some cases.


Thanks,

Remus Rusanu



Re: Review Request: HIVE-4595 Add support for string type keys in vectorized GROUP BY

2013-05-23 Thread Remus Rusanu

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/11345/
---

(Updated May 23, 2013, 1:30 p.m.)


Review request for hive, Jitendra Pandey, Eric Hanson, and Sarvesh Sakalanaga.


Changes
---

4595 obviously, not 4160


Summary (updated)
-

HIVE-4595 Add support for string type keys in vectorized GROUP BY


Description
---

Extend the VectorHashKeyWrapper and VectorHashKeyWrapperBatch to support 
ByteColumnVector (ie. string) keys. The addition falls into the existing 
VectorKeyHashWrapper behavior: the string keys support is 'compiled' once per 
query into a VectorHashKeyWrapperBatch instance. The VectorHashKeyWrapper is 
extended to support byte[] key. It stores the key values just like the 
ByteColumnVector class, by using a byte[][], a start int[] and a lenght int[]. 
During batch processing ther eis no value copy, the keywrappers take a 
reference to the data from the batch (ie. they refer the same byte[p] and copy 
the start/length). This avoids potentially expensive size-of-key copy 
operations *before* the hash probe. The VectorHashKeyWrapper clonning that 
occurs when a probe reveleas a missing key in the hash will copy the key (it 
must) and this is the only time we copy the key values.


This addresses bug HIVE-4595.
https://issues.apache.org/jira/browse/HIVE-4595


Diffs
-

  ql/src/java/org/apache/hadoop/hive/ql/exec/VectorHashKeyWrapper.java 35712d0 
  ql/src/java/org/apache/hadoop/hive/ql/exec/VectorHashKeyWrapperBatch.java 
c23614c 
  ql/src/java/org/apache/hadoop/hive/ql/exec/vector/VectorizationContext.java 
1ef4955 
  
ql/src/test/org/apache/hadoop/hive/ql/exec/vector/FakeVectorRowBatchFromObjectIterables.java
 PRE-CREATION 
  
ql/src/test/org/apache/hadoop/hive/ql/exec/vector/TestVectorGroupByOperator.java
 b3b5cd2 
  
ql/src/test/org/apache/hadoop/hive/ql/exec/vector/util/FakeVectorRowBatchFromIterables.java
 cf3399d 
  
ql/src/test/org/apache/hadoop/hive/ql/exec/vector/util/FakeVectorRowBatchFromLongIterables.java
 PRE-CREATION 

Diff: https://reviews.apache.org/r/11345/diff/


Testing
---

Extended vectorized GROUP BY unit test to cover String keys for some cases.


Thanks,

Remus Rusanu



[jira] [Updated] (HIVE-4595) Support strings in GROUP BY keys

2013-05-23 Thread Remus Rusanu (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-4595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Remus Rusanu updated HIVE-4595:
---

Attachment: HIVE-4595.patch.txt

 Support strings in GROUP BY keys
 

 Key: HIVE-4595
 URL: https://issues.apache.org/jira/browse/HIVE-4595
 Project: Hive
  Issue Type: Sub-task
  Components: Query Processor
Affects Versions: vectorization-branch
Reporter: Remus Rusanu
Assignee: Remus Rusanu
 Fix For: vectorization-branch

 Attachments: HIVE-4595.patch.txt




--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Updated] (HIVE-4595) Support strings in GROUP BY keys

2013-05-23 Thread Remus Rusanu (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-4595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Remus Rusanu updated HIVE-4595:
---

Fix Version/s: vectorization-branch
   Status: Patch Available  (was: In Progress)

Available in reviewboard https://reviews.apache.org/r/11345/

 Support strings in GROUP BY keys
 

 Key: HIVE-4595
 URL: https://issues.apache.org/jira/browse/HIVE-4595
 Project: Hive
  Issue Type: Sub-task
  Components: Query Processor
Affects Versions: vectorization-branch
Reporter: Remus Rusanu
Assignee: Remus Rusanu
 Fix For: vectorization-branch

 Attachments: HIVE-4595.patch.txt




--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Commented] (HIVE-4598) Incorrect results when using subquery in multi table insert

2013-05-23 Thread Sebastian (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-4598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13665218#comment-13665218
 ] 

Sebastian commented on HIVE-4598:
-

The same problem exists when x is a view.

 Incorrect results when using subquery in multi table insert
 ---

 Key: HIVE-4598
 URL: https://issues.apache.org/jira/browse/HIVE-4598
 Project: Hive
  Issue Type: Bug
  Components: Query Processor
Affects Versions: 0.11.0
Reporter: Sebastian

 I'm using a multi table insert like this:
 FROM x
 INSERT INTO TABLE t PARTITION (type='x')
 SELECT * WHERE type='x'
 INSERT INTO TABLE t PARTITION (type='y')
 SELECT * WHERE type='y';
 Now when x is the name of a table, everything works as expected.
 However if I use a subquery as x, the query runs but it inserts all results 
 from the subquery into each partition, as if there were no WHERE clauses in 
 the selects.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Updated] (HIVE-4596) Fix serialization exceptions in VectorGroupByOperator

2013-05-23 Thread Remus Rusanu (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-4596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Remus Rusanu updated HIVE-4596:
---

Description: 
Going down the vectorization path
java.lang.InstantiationException: 
org.apache.hadoop.hive.serde2.objectinspector.StandardStructObjectInspector
Continuing ...
java.lang.RuntimeException: failed to evaluate: unbound=Class.new();
Continuing ...
java.lang.InstantiationException: 
org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator
Continuing ...
java.lang.Exception: XMLEncoder: discarding statement 
ArrayList.add(VectorGroupByOperator);
Continuing ...


 Fix serialization exceptions in VectorGroupByOperator
 -

 Key: HIVE-4596
 URL: https://issues.apache.org/jira/browse/HIVE-4596
 Project: Hive
  Issue Type: Sub-task
  Components: Query Processor
Affects Versions: vectorization-branch
Reporter: Remus Rusanu
Assignee: Remus Rusanu
Priority: Minor

 Going down the vectorization path
 java.lang.InstantiationException: 
 org.apache.hadoop.hive.serde2.objectinspector.StandardStructObjectInspector
 Continuing ...
 java.lang.RuntimeException: failed to evaluate: unbound=Class.new();
 Continuing ...
 java.lang.InstantiationException: 
 org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator
 Continuing ...
 java.lang.Exception: XMLEncoder: discarding statement 
 ArrayList.add(VectorGroupByOperator);
 Continuing ...

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Created] (HIVE-4599) VectorGroupByOperator steals the non-vectorized children and crashes query if vectorization fails

2013-05-23 Thread Remus Rusanu (JIRA)
Remus Rusanu created HIVE-4599:
--

 Summary: VectorGroupByOperator steals the non-vectorized children 
and crashes query if vectorization fails
 Key: HIVE-4599
 URL: https://issues.apache.org/jira/browse/HIVE-4599
 Project: Hive
  Issue Type: Sub-task
  Components: Query Processor
Affects Versions: vectorization-branch
Reporter: Remus Rusanu
Assignee: Remus Rusanu


Have the VGBy clone it's own row mode children or implement vector mode output 
(including VectorReduceSinkOperator)

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


Re: Review Request: HIVE-4588: Support session level hooks for HiveServer2

2013-05-23 Thread Brock Noland

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/11326/#review20940
---


Prasad, looks good to me! (non-binding)

- Brock Noland


On May 22, 2013, 6:41 a.m., Prasad Mujumdar wrote:
 
 ---
 This is an automatically generated e-mail. To reply, visit:
 https://reviews.apache.org/r/11326/
 ---
 
 (Updated May 22, 2013, 6:41 a.m.)
 
 
 Review request for hive.
 
 
 Description
 ---
 
 Support session level hooks for HiveServer2
   - New config parameter to define the hook
   - New hook context interface to pass the serssion user and config to the 
 hook implementation
   - Session manager executes the configured hooks when a new session starts
 
 
 This addresses bug HIVE-4588.
 https://issues.apache.org/jira/browse/HIVE-4588
 
 
 Diffs
 -
 
   common/src/java/org/apache/hadoop/hive/conf/HiveConf.java 335af45 
   service/src/java/org/apache/hive/service/cli/session/HiveSessionHook.java 
 PRE-CREATION 
   
 service/src/java/org/apache/hive/service/cli/session/HiveSessionHookContext.java
  PRE-CREATION 
   
 service/src/java/org/apache/hive/service/cli/session/HiveSessionHookContextImpl.java
  PRE-CREATION 
   service/src/java/org/apache/hive/service/cli/session/SessionManager.java 
 3bb6807 
   service/src/test/org/apache/hive/service/cli/session/TestSessionHooks.java 
 PRE-CREATION 
 
 Diff: https://reviews.apache.org/r/11326/diff/
 
 
 Testing
 ---
 
 Added new test for session hooks
 
 
 Thanks,
 
 Prasad Mujumdar
 




[jira] [Commented] (HIVE-3534) Add left Lateral view syntax

2013-05-23 Thread Edward Capriolo (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-3534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13665247#comment-13665247
 ] 

Edward Capriolo commented on HIVE-3534:
---

I did consider that. I have never actually added anything to hive grammar also 
not skilled on developing query parsers/planners. I would like to add this UDF 
and possibly do what you are suggesting as a follow up, but I could use someone 
to guide me through it.

 Add left Lateral view syntax
 

 Key: HIVE-3534
 URL: https://issues.apache.org/jira/browse/HIVE-3534
 Project: Hive
  Issue Type: New Feature
Reporter: Edward Capriolo
Assignee: Edward Capriolo
 Attachments: hive-3534.diff.txt


 A lateral view is like a join and if the function in question (like 
 explode()) produces zero rows then you lose the row
 whereas conceivably you could keep the row and just fill all entry with nulls.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Commented] (HIVE-4597) Remove test code from ql\src\java tree, place it itn ql\src\test tree

2013-05-23 Thread Tony Murphy (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-4597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13665328#comment-13665328
 ] 

Tony Murphy commented on HIVE-4597:
---

this is tricky since the test cases and vector expressions need to be generated 
in parallel, otherwise I don't have access to sufficient information to 
generate the tests. It would take major refactoring of CodeGen to make 
TestCodeGen independent.  

we could pull all the code generation(test and dev) up to hive_root\ql\src\gen

 Remove test code from ql\src\java tree, place it itn ql\src\test tree
 -

 Key: HIVE-4597
 URL: https://issues.apache.org/jira/browse/HIVE-4597
 Project: Hive
  Issue Type: Sub-task
  Components: Query Processor
Reporter: Remus Rusanu
Assignee: Tony Murphy
Priority: Minor

 The TestCodeGen and the generated files (probably the templates too) belong 
 in the ql\src\test tree, not in the ql\src\java tree

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Commented] (HIVE-4597) Remove test code from ql\src\java tree, place it itn ql\src\test tree

2013-05-23 Thread Tony Murphy (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-4597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13665340#comment-13665340
 ] 

Tony Murphy commented on HIVE-4597:
---

also, the generated test suites are generated under 
ql\src\test\org\...vector\expressions\gen, the only things in the src tree 
should be the generation logic and the templates.

 Remove test code from ql\src\java tree, place it itn ql\src\test tree
 -

 Key: HIVE-4597
 URL: https://issues.apache.org/jira/browse/HIVE-4597
 Project: Hive
  Issue Type: Sub-task
  Components: Query Processor
Reporter: Remus Rusanu
Assignee: Tony Murphy
Priority: Minor

 The TestCodeGen and the generated files (probably the templates too) belong 
 in the ql\src\test tree, not in the ql\src\java tree

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Updated] (HIVE-4579) Create a SARG interface for RecordReaders

2013-05-23 Thread Owen O'Malley (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-4579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Owen O'Malley updated HIVE-4579:


Attachment: h-4579.patch

A patch with the interface for the SARGs.

 Create a SARG interface for RecordReaders
 -

 Key: HIVE-4579
 URL: https://issues.apache.org/jira/browse/HIVE-4579
 Project: Hive
  Issue Type: Improvement
Reporter: Owen O'Malley
Assignee: Owen O'Malley
 Attachments: h-4579.patch, pushdown.pdf


 I think we should create a SARG (http://en.wikipedia.org/wiki/Sargable) 
 interface for RecordReaders. For a first pass, I'll create an API that uses 
 the value stored in hive.io.filter.expr.serialized.
 The desire is to define an simpler interface that the direct AST expression 
 that is provided by hive.io.filter.expr.serialized so that the code to 
 evaluate expressions can be generalized instead of put inside a particular 
 RecordReader.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Updated] (HIVE-4597) Remove test code from ql\src\java tree, place it itn ql\src\test tree

2013-05-23 Thread Tony Murphy (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-4597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Tony Murphy updated HIVE-4597:
--

Attachment: HIVE-4597.patch

 Remove test code from ql\src\java tree, place it itn ql\src\test tree
 -

 Key: HIVE-4597
 URL: https://issues.apache.org/jira/browse/HIVE-4597
 Project: Hive
  Issue Type: Sub-task
  Components: Query Processor
Reporter: Remus Rusanu
Assignee: Tony Murphy
Priority: Minor
 Attachments: HIVE-4597.patch


 The TestCodeGen and the generated files (probably the templates too) belong 
 in the ql\src\test tree, not in the ql\src\java tree

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


Review Request: HIVE-4597: Move Vector Expression and Vector Expression Evaluation Test Generation

2013-05-23 Thread tony murphy

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/11349/
---

Review request for hive, Jitendra Pandey, Eric Hanson, Sarvesh Sakalanaga, and 
Remus Rusanu.


Description
---

Move Vector Expression and Vector Expression Evaluation Test Generation to 
\ql\src\gen\vectorization and update CodeGen to place generated files correctly 
into source tree. See lines 218 to 249 for changes.


This addresses bug HIVE-4597.
https://issues.apache.org/jira/browse/HIVE-4597


Diffs
-

  
ql/src/gen/vectorization/org/apache/hadoop/hive/ql/exec/vector/expressions/gen/CodeGen.java
 PRE-CREATION 
  
ql/src/gen/vectorization/org/apache/hadoop/hive/ql/exec/vector/expressions/gen/ColumnArithmeticColumn.txt
 PRE-CREATION 
  
ql/src/gen/vectorization/org/apache/hadoop/hive/ql/exec/vector/expressions/gen/ColumnArithmeticScalar.txt
 PRE-CREATION 
  
ql/src/gen/vectorization/org/apache/hadoop/hive/ql/exec/vector/expressions/gen/ColumnCompareScalar.txt
 PRE-CREATION 
  
ql/src/gen/vectorization/org/apache/hadoop/hive/ql/exec/vector/expressions/gen/ColumnUnaryMinus.txt
 PRE-CREATION 
  
ql/src/gen/vectorization/org/apache/hadoop/hive/ql/exec/vector/expressions/gen/FilterColumnCompareColumn.txt
 PRE-CREATION 
  
ql/src/gen/vectorization/org/apache/hadoop/hive/ql/exec/vector/expressions/gen/FilterColumnCompareScalar.txt
 PRE-CREATION 
  
ql/src/gen/vectorization/org/apache/hadoop/hive/ql/exec/vector/expressions/gen/FilterStringColumnCompareColumn.txt
 PRE-CREATION 
  
ql/src/gen/vectorization/org/apache/hadoop/hive/ql/exec/vector/expressions/gen/FilterStringColumnCompareScalar.txt
 PRE-CREATION 
  
ql/src/gen/vectorization/org/apache/hadoop/hive/ql/exec/vector/expressions/gen/ScalarArithmeticColumn.txt
 PRE-CREATION 
  
ql/src/gen/vectorization/org/apache/hadoop/hive/ql/exec/vector/expressions/gen/TestClass.txt
 PRE-CREATION 
  
ql/src/gen/vectorization/org/apache/hadoop/hive/ql/exec/vector/expressions/gen/TestCodeGen.java
 PRE-CREATION 
  
ql/src/gen/vectorization/org/apache/hadoop/hive/ql/exec/vector/expressions/gen/TestColumnColumnFilterVectorExpressionEvaluation.txt
 PRE-CREATION 
  
ql/src/gen/vectorization/org/apache/hadoop/hive/ql/exec/vector/expressions/gen/TestColumnColumnOperationVectorExpressionEvaluation.txt
 PRE-CREATION 
  
ql/src/gen/vectorization/org/apache/hadoop/hive/ql/exec/vector/expressions/gen/TestColumnScalarFilterVectorExpressionEvaluation.txt
 PRE-CREATION 
  
ql/src/gen/vectorization/org/apache/hadoop/hive/ql/exec/vector/expressions/gen/TestColumnScalarOperationVectorExpressionEvaluation.txt
 PRE-CREATION 
  
ql/src/gen/vectorization/org/apache/hadoop/hive/ql/exec/vector/expressions/gen/VectorUDAFAvg.txt
 PRE-CREATION 
  
ql/src/gen/vectorization/org/apache/hadoop/hive/ql/exec/vector/expressions/gen/VectorUDAFCount.txt
 PRE-CREATION 
  
ql/src/gen/vectorization/org/apache/hadoop/hive/ql/exec/vector/expressions/gen/VectorUDAFMinMax.txt
 PRE-CREATION 
  
ql/src/gen/vectorization/org/apache/hadoop/hive/ql/exec/vector/expressions/gen/VectorUDAFSum.txt
 PRE-CREATION 
  
ql/src/gen/vectorization/org/apache/hadoop/hive/ql/exec/vector/expressions/gen/VectorUDAFVar.txt
 PRE-CREATION 
  
ql/src/java/org/apache/hadoop/hive/ql/exec/vector/expressions/templates/CodeGen.java
 3ef2aa8 
  
ql/src/java/org/apache/hadoop/hive/ql/exec/vector/expressions/templates/ColumnArithmeticColumn.txt
 0e56721 
  
ql/src/java/org/apache/hadoop/hive/ql/exec/vector/expressions/templates/ColumnArithmeticScalar.txt
 474a979 
  
ql/src/java/org/apache/hadoop/hive/ql/exec/vector/expressions/templates/ColumnCompareScalar.txt
 dcf87b0 
  
ql/src/java/org/apache/hadoop/hive/ql/exec/vector/expressions/templates/ColumnUnaryMinus.txt
 9d16bdd 
  
ql/src/java/org/apache/hadoop/hive/ql/exec/vector/expressions/templates/FilterColumnCompareColumn.txt
 8e3b717 
  
ql/src/java/org/apache/hadoop/hive/ql/exec/vector/expressions/templates/FilterColumnCompareScalar.txt
 04bc69c 
  
ql/src/java/org/apache/hadoop/hive/ql/exec/vector/expressions/templates/FilterStringColumnCompareColumn.txt
 9309326 
  
ql/src/java/org/apache/hadoop/hive/ql/exec/vector/expressions/templates/FilterStringColumnCompareScalar.txt
 30eddcf 
  
ql/src/java/org/apache/hadoop/hive/ql/exec/vector/expressions/templates/ScalarArithmeticColumn.txt
 9899e7e 
  
ql/src/java/org/apache/hadoop/hive/ql/exec/vector/expressions/templates/TestClass.txt
 c8de5de 
  
ql/src/java/org/apache/hadoop/hive/ql/exec/vector/expressions/templates/TestCodeGen.java
 34c093c 
  
ql/src/java/org/apache/hadoop/hive/ql/exec/vector/expressions/templates/TestColumnColumnFilterVectorExpressionEvaluation.txt
 2bb1aa3 
  
ql/src/java/org/apache/hadoop/hive/ql/exec/vector/expressions/templates/TestColumnColumnOperationVectorExpressionEvaluation.txt
 4ab3e76 
  

[jira] [Updated] (HIVE-4597) Remove test code from ql\src\java tree, place it itn ql\src\test tree

2013-05-23 Thread Tony Murphy (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-4597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Tony Murphy updated HIVE-4597:
--

Attachment: (was: HIVE-4597.patch)

 Remove test code from ql\src\java tree, place it itn ql\src\test tree
 -

 Key: HIVE-4597
 URL: https://issues.apache.org/jira/browse/HIVE-4597
 Project: Hive
  Issue Type: Sub-task
  Components: Query Processor
Reporter: Remus Rusanu
Assignee: Tony Murphy
Priority: Minor

 The TestCodeGen and the generated files (probably the templates too) belong 
 in the ql\src\test tree, not in the ql\src\java tree

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Updated] (HIVE-4597) Remove test code from ql\src\java tree, place it itn ql\src\test tree

2013-05-23 Thread Tony Murphy (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-4597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Tony Murphy updated HIVE-4597:
--

Attachment: HIVE-4597.patch

 Remove test code from ql\src\java tree, place it itn ql\src\test tree
 -

 Key: HIVE-4597
 URL: https://issues.apache.org/jira/browse/HIVE-4597
 Project: Hive
  Issue Type: Sub-task
  Components: Query Processor
Reporter: Remus Rusanu
Assignee: Tony Murphy
Priority: Minor
 Attachments: HIVE-4597.patch


 The TestCodeGen and the generated files (probably the templates too) belong 
 in the ql\src\test tree, not in the ql\src\java tree

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Commented] (HIVE-4597) Remove test code from ql\src\java tree, place it itn ql\src\test tree

2013-05-23 Thread Tony Murphy (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-4597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13665528#comment-13665528
 ] 

Tony Murphy commented on HIVE-4597:
---

review board review: https://reviews.apache.org/r/11349

 Remove test code from ql\src\java tree, place it itn ql\src\test tree
 -

 Key: HIVE-4597
 URL: https://issues.apache.org/jira/browse/HIVE-4597
 Project: Hive
  Issue Type: Sub-task
  Components: Query Processor
Reporter: Remus Rusanu
Assignee: Tony Murphy
Priority: Minor
 Attachments: HIVE-4597.patch


 The TestCodeGen and the generated files (probably the templates too) belong 
 in the ql\src\test tree, not in the ql\src\java tree

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Updated] (HIVE-4592) ColumnArithmeticColumn.txt template never sets output isNull to true; can give wrong results

2013-05-23 Thread Eric Hanson (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-4592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Eric Hanson updated HIVE-4592:
--

Attachment: HIVE-4592.1.patch

 ColumnArithmeticColumn.txt template never sets output isNull to true; can 
 give wrong results
 

 Key: HIVE-4592
 URL: https://issues.apache.org/jira/browse/HIVE-4592
 Project: Hive
  Issue Type: Sub-task
Affects Versions: vectorization-branch
Reporter: Eric Hanson
Assignee: Eric Hanson
 Fix For: vectorization-branch

 Attachments: HIVE-4592.1.patch


 ColumnArithmeticColumn.txt should set the output column's noNulls flag to 
 true if neither input column has nulls, but it does not do that. This can 
 lead to wrong results is the noNulls was set to false in a previous use of 
 the batch.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Commented] (HIVE-4592) ColumnArithmeticColumn.txt template never sets output isNull to true; can give wrong results

2013-05-23 Thread Eric Hanson (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-4592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13665535#comment-13665535
 ] 

Eric Hanson commented on HIVE-4592:
---

Let me look at the other templates. I expect I will broaden this to cover other 
templates. I fixed the issue in this template ColumnArithmeticColumn.txt 
regarding the assumption that noNulls=false and isRepeating=true means all 
values are null, which is not a correct assumption.

So, the patch is not ready yet. Wait for another revision.

 ColumnArithmeticColumn.txt template never sets output isNull to true; can 
 give wrong results
 

 Key: HIVE-4592
 URL: https://issues.apache.org/jira/browse/HIVE-4592
 Project: Hive
  Issue Type: Sub-task
Affects Versions: vectorization-branch
Reporter: Eric Hanson
Assignee: Eric Hanson
 Fix For: vectorization-branch

 Attachments: HIVE-4592.1.patch


 ColumnArithmeticColumn.txt should set the output column's noNulls flag to 
 true if neither input column has nulls, but it does not do that. This can 
 lead to wrong results is the noNulls was set to false in a previous use of 
 the batch.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Created] (HIVE-4600) Vectorized reader support for timestamp in ORC.

2013-05-23 Thread Sarvesh Sakalanaga (JIRA)
Sarvesh Sakalanaga created HIVE-4600:


 Summary: Vectorized reader support for timestamp in ORC. 
 Key: HIVE-4600
 URL: https://issues.apache.org/jira/browse/HIVE-4600
 Project: Hive
  Issue Type: Sub-task
  Components: File Formats
Reporter: Sarvesh Sakalanaga
Assignee: Sarvesh Sakalanaga




--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Updated] (HIVE-4511) Vectorized reader support for Byte and Boolean.

2013-05-23 Thread Sarvesh Sakalanaga (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sarvesh Sakalanaga updated HIVE-4511:
-

Summary: Vectorized reader support for Byte and Boolean.  (was: Vectorized 
reader support for Byte, Boolean and timestamp in ORC.)

 Vectorized reader support for Byte and Boolean.
 ---

 Key: HIVE-4511
 URL: https://issues.apache.org/jira/browse/HIVE-4511
 Project: Hive
  Issue Type: Sub-task
  Components: File Formats
Reporter: Jitendra Nath Pandey
Assignee: Sarvesh Sakalanaga

 Byte, boolean and timestamp support should be added to vectorized orc reader.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Updated] (HIVE-4511) Vectorized reader support for Byte and Boolean.

2013-05-23 Thread Sarvesh Sakalanaga (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sarvesh Sakalanaga updated HIVE-4511:
-

Status: Patch Available  (was: Open)

 Vectorized reader support for Byte and Boolean.
 ---

 Key: HIVE-4511
 URL: https://issues.apache.org/jira/browse/HIVE-4511
 Project: Hive
  Issue Type: Sub-task
  Components: File Formats
Reporter: Jitendra Nath Pandey
Assignee: Sarvesh Sakalanaga
 Attachments: Hive-4511.0.patch


 Byte, boolean and timestamp support should be added to vectorized orc reader.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Commented] (HIVE-4599) VectorGroupByOperator steals the non-vectorized children and crashes query if vectorization fails

2013-05-23 Thread Jitendra Nath Pandey (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-4599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13665549#comment-13665549
 ] 

Jitendra Nath Pandey commented on HIVE-4599:


I will recommend putting in VectorReduceSinkOperator, because that will make 
vectorized map side and non-vectorize reduce side work together for non-GBy 
queries too.

 VectorGroupByOperator steals the non-vectorized children and crashes query if 
 vectorization fails
 -

 Key: HIVE-4599
 URL: https://issues.apache.org/jira/browse/HIVE-4599
 Project: Hive
  Issue Type: Sub-task
  Components: Query Processor
Affects Versions: vectorization-branch
Reporter: Remus Rusanu
Assignee: Remus Rusanu

 Have the VGBy clone it's own row mode children or implement vector mode 
 output (including VectorReduceSinkOperator)

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


Review Request: Vectorized reader support for Byte and Boolean.

2013-05-23 Thread Sarvesh Sakalanaga

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/11350/
---

Review request for hive.


Description
---

Change adds support for datatypes byte and boolean for Vectorized query 
execution. 


This addresses bug Hive-4511.
https://issues.apache.org/jira/browse/Hive-4511


Diffs
-

  ql/src/java/org/apache/hadoop/hive/ql/exec/vector/VectorizedBatchUtil.java 
0e19e59 
  ql/src/java/org/apache/hadoop/hive/ql/exec/vector/VectorizedRowBatchCtx.java 
1a57766 
  ql/src/java/org/apache/hadoop/hive/ql/io/orc/BitFieldReader.java 11c3fdf 
  ql/src/java/org/apache/hadoop/hive/ql/io/orc/RecordReaderImpl.java f15779d 
  ql/src/java/org/apache/hadoop/hive/ql/io/orc/RunLengthByteReader.java 678a2f5 
  ql/src/test/org/apache/hadoop/hive/ql/io/orc/TestVectorizedORCReader.java 
e8c75c6 

Diff: https://reviews.apache.org/r/11350/diff/


Testing
---


Thanks,

Sarvesh Sakalanaga



[jira] [Commented] (HIVE-4511) Vectorized reader support for Byte and Boolean.

2013-05-23 Thread Sarvesh Sakalanaga (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13665550#comment-13665550
 ] 

Sarvesh Sakalanaga commented on HIVE-4511:
--

Review at : https://reviews.apache.org/r/11350/

 Vectorized reader support for Byte and Boolean.
 ---

 Key: HIVE-4511
 URL: https://issues.apache.org/jira/browse/HIVE-4511
 Project: Hive
  Issue Type: Sub-task
  Components: File Formats
Reporter: Jitendra Nath Pandey
Assignee: Sarvesh Sakalanaga
 Attachments: Hive-4511.0.patch


 Byte, boolean and timestamp support should be added to vectorized orc reader.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Assigned] (HIVE-2390) Expand support for union types

2013-05-23 Thread Jakob Homan (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-2390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jakob Homan reassigned HIVE-2390:
-

Assignee: (was: Jakob Homan)

 Expand support for union types
 --

 Key: HIVE-2390
 URL: https://issues.apache.org/jira/browse/HIVE-2390
 Project: Hive
  Issue Type: Bug
Reporter: Jakob Homan
  Labels: uniontype

 When the union type was introduced, full support for it wasn't provided.  For 
 instance, when working with a union that gets passed to LazyBinarySerde: 
 {noformat}Caused by: java.lang.RuntimeException: Unrecognized type: UNION
   at 
 org.apache.hadoop.hive.serde2.lazybinary.LazyBinarySerDe.serialize(LazyBinarySerDe.java:468)
   at 
 org.apache.hadoop.hive.serde2.lazybinary.LazyBinarySerDe.serializeStruct(LazyBinarySerDe.java:230)
   at 
 org.apache.hadoop.hive.serde2.lazybinary.LazyBinarySerDe.serialize(LazyBinarySerDe.java:184)
 {noformat}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


Jenkins build is back to normal : Hive-0.9.1-SNAPSHOT-h0.21 #381

2013-05-23 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hive-0.9.1-SNAPSHOT-h0.21/381/



[jira] [Commented] (HIVE-4496) JDBC2 won't compile with JDK7

2013-05-23 Thread Xuefu Zhang (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-4496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13665808#comment-13665808
 ] 

Xuefu Zhang commented on HIVE-4496:
---

I think the code base has changed such that applying this patch doesn't 
compiler any more. There is a javadoc warning failing the build. The patch 
might need an update. Thanks.

  [javadoc] Standard Doclet version 1.7.0_21
  [javadoc] Building tree for all the packages and classes...
  [javadoc] 
/home/xzhang/apache/hive-nochange/hcatalog/storage-handlers/hbase/src/java/org/apache/hcatalog/hbase/snapshot/RevisionManagerFactory.java:81:
 warning - @return tag has no arguments.
  [javadoc] Building index for all the packages and classes...
  [javadoc] Building index for all classes...
  [javadoc] Generating 
/home/xzhang/apache/hive-nochange/hcatalog/build/docs/api/help-doc.html...
  [javadoc] 2 warnings

BUILD FAILED
/home/xzhang/apache/hive-nochange/build.xml:520: The following error occurred 
while executing this line:
/home/xzhang/apache/hive-nochange/hcatalog/build.xml:246: Javadoc comments 
contain warnings.


 JDBC2 won't compile with JDK7
 -

 Key: HIVE-4496
 URL: https://issues.apache.org/jira/browse/HIVE-4496
 Project: Hive
  Issue Type: Bug
  Components: JDBC
Affects Versions: 0.12.0
Reporter: Chris Drome
Assignee: Chris Drome
 Fix For: 0.12.0

 Attachments: HIVE-4496.patch


 HiveServer2 related JDBC does not compile with JDK7. Related to HIVE-3384.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Commented] (HIVE-4257) java.sql.SQLNonTransientConnectionException on JDBCStatsAggregator

2013-05-23 Thread Navis (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-4257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13665818#comment-13665818
 ] 

Navis commented on HIVE-4257:
-

Build failed with various exceptions,
{noformat}
[junit] Caused by: java.lang.RuntimeException: Unable to instantiate 
org.apache.hadoop.hive.metastore.HiveMetaStoreClient
[junit] at 
org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1212)
[junit] at 
org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.init(RetryingMetaStoreClient.java:51)
[junit] at 
org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:61)
[junit] at 
org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.java:2286)
[junit] at 
org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:2297)
[junit] at 
org.apache.hadoop.hive.ql.metadata.Hive.dropTable(Hive.java:868)
[junit] ... 8 more
[junit] Caused by: java.lang.reflect.InvocationTargetException
[junit] at 
sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
[junit] at 
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
[junit] at 
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
[junit] at 
java.lang.reflect.Constructor.newInstance(Constructor.java:513)
[junit] at 
org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1210)
[junit] ... 13 more
[junit] Caused by: javax.jdo.JDOFatalInternalException: Error creating 
transactional connection factory
[junit] NestedThrowables:
[junit] java.lang.reflect.InvocationTargetException
[junit] at 
org.datanucleus.jdo.NucleusJDOHelper.getJDOExceptionForNucleusException(NucleusJDOHelper.java:425)
[junit] at 
org.datanucleus.jdo.JDOPersistenceManagerFactory.freezeConfiguration(JDOPersistenceManagerFactory.java:601)
[junit] at 
org.datanucleus.jdo.JDOPersistenceManagerFactory.createPersistenceManagerFactory(JDOPersistenceManagerFactory.java:286)
[junit] at 
org.datanucleus.jdo.JDOPersistenceManagerFactory.getPersistenceManagerFactory(JDOPersistenceManagerFactory.java:182)
[junit] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit] at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
[junit] at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
[junit] at java.lang.reflect.Method.invoke(Method.java:597)
[junit] at javax.jdo.JDOHelper$16.run(JDOHelper.java:1958)
[junit] at java.security.AccessController.doPrivileged(Native Method)
[junit] at javax.jdo.JDOHelper.invoke(JDOHelper.java:1953)
[junit] at 
javax.jdo.JDOHelper.invokeGetPersistenceManagerFactoryOnImplementation(JDOHelper.java:1159)
[junit] at 
javax.jdo.JDOHelper.getPersistenceManagerFactory(JDOHelper.java:803)
[junit] at 
javax.jdo.JDOHelper.getPersistenceManagerFactory(JDOHelper.java:698)
[junit] at 
org.apache.hadoop.hive.metastore.ObjectStore.getPMF(ObjectStore.java:263)
[junit] at 
org.apache.hadoop.hive.metastore.ObjectStore.getPersistenceManager(ObjectStore.java:292)
[junit] at 
org.apache.hadoop.hive.metastore.ObjectStore.initialize(ObjectStore.java:225)
[junit] at 
org.apache.hadoop.hive.metastore.ObjectStore.setConf(ObjectStore.java:200)
[junit] at 
org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:62)
[junit] at 
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
[junit] at 
org.apache.hadoop.hive.metastore.RetryingRawStore.init(RetryingRawStore.java:62)
[junit] at 
org.apache.hadoop.hive.metastore.RetryingRawStore.getProxy(RetryingRawStore.java:71)
[junit] at 
org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.newRawStore(HiveMetaStore.java:414)
[junit] at 
org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.getMS(HiveMetaStore.java:402)
[junit] at 
org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.createDefaultDB(HiveMetaStore.java:440)
[junit] at 
org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.init(HiveMetaStore.java:326)
[junit] at 
org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.init(HiveMetaStore.java:286)
[junit] at 
org.apache.hadoop.hive.metastore.RetryingHMSHandler.init(RetryingHMSHandler.java:53)
[junit] at 
org.apache.hadoop.hive.metastore.RetryingHMSHandler.getProxy(RetryingHMSHandler.java:58)
[junit] at 
org.apache.hadoop.hive.metastore.HiveMetaStore.newHMSHandler(HiveMetaStore.java:4183)
[junit] at 
org.apache.hadoop.hive.metastore.HiveMetaStoreClient.init(HiveMetaStoreClient.java:121)
  

[jira] [Updated] (HIVE-4257) java.sql.SQLNonTransientConnectionException on JDBCStatsAggregator

2013-05-23 Thread Navis (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-4257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Navis updated HIVE-4257:


Status: Open  (was: Patch Available)

 java.sql.SQLNonTransientConnectionException on JDBCStatsAggregator
 --

 Key: HIVE-4257
 URL: https://issues.apache.org/jira/browse/HIVE-4257
 Project: Hive
  Issue Type: Bug
  Components: Statistics
Affects Versions: 0.11.0
Reporter: Teddy Choi
Assignee: Teddy Choi
Priority: Minor
 Attachments: HIVE-4257.1.patch.txt


 java.sql.SQLNonTransientConnectionException occurs on JDBCStatsAggregator 
 after executing dozens of Hive queries periodically, which inserts thousands 
 of rows. It may have a relation with DERBY-5098. To avoid this error, Hive 
 should use a more recent version of Derby(10.6.2.3, 10.7.1.4, 10.8.2.2, 
 10.9.1.0 or later). Hive 0.11.0-SNAPSHOT uses Derby 10.4.2.0.
 {noformat}
 2013-03-24 15:54:30,487 ERROR jdbc.JDBCStatsAggregator 
 (JDBCStatsAggregator.java:aggregateStats(168)) - Error during publishing 
 aggregation. java.sql.SQLNonTransientConnectionException: No current 
 connection.
 2013-03-24 15:54:30,487 ERROR jdbc.JDBCStatsAggregator 
 (JDBCStatsAggregator.java:aggregateStats(168)) - Error during publishing 
 aggregation. java.sql.SQLNonTransientConnectionException: No current 
 connection.
 2013-03-24 15:54:30,487 ERROR jdbc.JDBCStatsAggregator 
 (JDBCStatsAggregator.java:cleanUp(249)) - Error during publishing 
 aggregation. java.sql.SQLNonTransientConnectionException: No current 
 connection.
 {noformat}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Commented] (HIVE-4496) JDBC2 won't compile with JDK7

2013-05-23 Thread Chris Drome (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-4496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13665824#comment-13665824
 ] 

Chris Drome commented on HIVE-4496:
---

[~xuefuz] I don't think the problem is with the patch.

RevisionManagerFactory.java:81 generates the javadoc warning.
This file is not part of this patch, it was imported as part of HIVE-4264.

BTW, I just finished patching trunk and running ant tar, which completed 
successfully.

 JDBC2 won't compile with JDK7
 -

 Key: HIVE-4496
 URL: https://issues.apache.org/jira/browse/HIVE-4496
 Project: Hive
  Issue Type: Bug
  Components: JDBC
Affects Versions: 0.12.0
Reporter: Chris Drome
Assignee: Chris Drome
 Fix For: 0.12.0

 Attachments: HIVE-4496.patch


 HiveServer2 related JDBC does not compile with JDK7. Related to HIVE-3384.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Created] (HIVE-4601) WebHCat, Templeton need to support proxy users

2013-05-23 Thread Dilli Arumugam (JIRA)
Dilli Arumugam created HIVE-4601:


 Summary: WebHCat, Templeton need to support proxy users
 Key: HIVE-4601
 URL: https://issues.apache.org/jira/browse/HIVE-4601
 Project: Hive
  Issue Type: Improvement
  Components: HCatalog
Reporter: Dilli Arumugam


We have a use case where a Gateway would provide unified and controlled access 
to secure hadoop cluster.
The Gateway itself would authenticate to secure WebHDFS, Oozie and Templeton 
with SPNego.
The Gateway would authenticate the end user with http basic and would assert 
the end user identity as douser argument in the calls to downstream WebHDFS, 
Oozie and Templeton.
This works fine with WebHDFS and Oozie. But, does not work for Templeton as 
Templeton does not support proxy users.
Hence, request to add this improvement to Templeton.



--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Created] (HIVE-4602) Enable running all hive e2e tests under vectorization

2013-05-23 Thread Tony Murphy (JIRA)
Tony Murphy created HIVE-4602:
-

 Summary: Enable running all hive e2e tests under vectorization
 Key: HIVE-4602
 URL: https://issues.apache.org/jira/browse/HIVE-4602
 Project: Hive
  Issue Type: Sub-task
Affects Versions: vectorization-branch
Reporter: Tony Murphy
Assignee: Tony Murphy
 Fix For: vectorization-branch




--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Updated] (HIVE-4602) Enable running all hive e2e tests under vectorization

2013-05-23 Thread Tony Murphy (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-4602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Tony Murphy updated HIVE-4602:
--

Attachment: HIVE-4602.patch

Enables running tests under vectorization  when
-Dtest.vectorization.enabled=true 
is specified

 Enable running all hive e2e tests under vectorization
 -

 Key: HIVE-4602
 URL: https://issues.apache.org/jira/browse/HIVE-4602
 Project: Hive
  Issue Type: Sub-task
Affects Versions: vectorization-branch
Reporter: Tony Murphy
Assignee: Tony Murphy
 Fix For: vectorization-branch

 Attachments: HIVE-4602.patch




--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Updated] (HIVE-4602) Enable running all hive e2e tests under vectorization

2013-05-23 Thread Tony Murphy (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-4602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Tony Murphy updated HIVE-4602:
--

Status: Patch Available  (was: Open)

 Enable running all hive e2e tests under vectorization
 -

 Key: HIVE-4602
 URL: https://issues.apache.org/jira/browse/HIVE-4602
 Project: Hive
  Issue Type: Sub-task
Affects Versions: vectorization-branch
Reporter: Tony Murphy
Assignee: Tony Murphy
 Fix For: vectorization-branch

 Attachments: HIVE-4602.patch




--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Commented] (HIVE-4592) ColumnArithmeticColumn.txt template never sets output isNull to true; can give wrong results

2013-05-23 Thread Eric Hanson (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-4592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13665855#comment-13665855
 ] 

Eric Hanson commented on HIVE-4592:
---

Another issue is that output Long column vectors should have 1 in the data 
vector, and output Double column vectors should have NaN in the data vector. 
Adding tests and fixes for this.

 ColumnArithmeticColumn.txt template never sets output isNull to true; can 
 give wrong results
 

 Key: HIVE-4592
 URL: https://issues.apache.org/jira/browse/HIVE-4592
 Project: Hive
  Issue Type: Sub-task
Affects Versions: vectorization-branch
Reporter: Eric Hanson
Assignee: Eric Hanson
 Fix For: vectorization-branch

 Attachments: HIVE-4592.1.patch


 ColumnArithmeticColumn.txt should set the output column's noNulls flag to 
 true if neither input column has nulls, but it does not do that. This can 
 lead to wrong results is the noNulls was set to false in a previous use of 
 the batch.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Commented] (HIVE-4496) JDBC2 won't compile with JDK7

2013-05-23 Thread Xuefu Zhang (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-4496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13665864#comment-13665864
 ] 

Xuefu Zhang commented on HIVE-4496:
---

[~cdrome] I guess it's right: the warning has nothing to do with your patch. I 
did ant tar, but it also stopped due to the warning. Not sure why.

Anyway, is there a plan to check this patch in?


 JDBC2 won't compile with JDK7
 -

 Key: HIVE-4496
 URL: https://issues.apache.org/jira/browse/HIVE-4496
 Project: Hive
  Issue Type: Bug
  Components: JDBC
Affects Versions: 0.12.0
Reporter: Chris Drome
Assignee: Chris Drome
 Fix For: 0.12.0

 Attachments: HIVE-4496.patch


 HiveServer2 related JDBC does not compile with JDK7. Related to HIVE-3384.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Commented] (HIVE-4592) ColumnArithmeticColumn.txt template never sets output isNull to true; can give wrong results

2013-05-23 Thread Eric Hanson (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-4592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13665934#comment-13665934
 ] 

Eric Hanson commented on HIVE-4592:
---

Completed review and update of Col-Col, Col-Scalar, and Scalar-Col arithmetic 
templates. Verified isRepeating and noNulls propagation from input(s)to output 
column. Made sure that NULL values have their data entry set properly in the 
output data vector as well, based on the spec (1 for long, NaN for double).

 ColumnArithmeticColumn.txt template never sets output isNull to true; can 
 give wrong results
 

 Key: HIVE-4592
 URL: https://issues.apache.org/jira/browse/HIVE-4592
 Project: Hive
  Issue Type: Sub-task
Affects Versions: vectorization-branch
Reporter: Eric Hanson
Assignee: Eric Hanson
 Fix For: vectorization-branch

 Attachments: HIVE-4592.1.patch


 ColumnArithmeticColumn.txt should set the output column's noNulls flag to 
 true if neither input column has nulls, but it does not do that. This can 
 lead to wrong results is the noNulls was set to false in a previous use of 
 the batch.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Updated] (HIVE-4592) ColumnArithmeticColumn.txt template never sets output isNull to true; can give wrong results

2013-05-23 Thread Eric Hanson (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-4592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Eric Hanson updated HIVE-4592:
--

Attachment: HIVE-4592.3.patch

 ColumnArithmeticColumn.txt template never sets output isNull to true; can 
 give wrong results
 

 Key: HIVE-4592
 URL: https://issues.apache.org/jira/browse/HIVE-4592
 Project: Hive
  Issue Type: Sub-task
Affects Versions: vectorization-branch
Reporter: Eric Hanson
Assignee: Eric Hanson
 Fix For: vectorization-branch

 Attachments: HIVE-4592.1.patch, HIVE-4592.3.patch


 ColumnArithmeticColumn.txt should set the output column's noNulls flag to 
 true if neither input column has nulls, but it does not do that. This can 
 lead to wrong results is the noNulls was set to false in a previous use of 
 the batch.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Updated] (HIVE-4592) ColumnArithmeticColumn.txt template never sets output isNull to true; can give wrong results

2013-05-23 Thread Eric Hanson (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-4592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Eric Hanson updated HIVE-4592:
--

Status: Patch Available  (was: In Progress)

 ColumnArithmeticColumn.txt template never sets output isNull to true; can 
 give wrong results
 

 Key: HIVE-4592
 URL: https://issues.apache.org/jira/browse/HIVE-4592
 Project: Hive
  Issue Type: Sub-task
Affects Versions: vectorization-branch
Reporter: Eric Hanson
Assignee: Eric Hanson
 Fix For: vectorization-branch

 Attachments: HIVE-4592.1.patch, HIVE-4592.3.patch


 ColumnArithmeticColumn.txt should set the output column's noNulls flag to 
 true if neither input column has nulls, but it does not do that. This can 
 lead to wrong results is the noNulls was set to false in a previous use of 
 the batch.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


Hive-trunk-h0.21 - Build # 2115 - Still Failing

2013-05-23 Thread Apache Jenkins Server
Changes for Build #2089
[cws] HIVE-3957. Add pseudo-BNF grammar for RCFile to Javadoc (Mark Grover via 
cws)

[cws] HIVE-4497. beeline module tests don't get run by default (Thejas Nair via 
cws)

[gangtimliu] HIVE-4474: Column access not tracked properly for partitioned 
tables. Samuel Yuan via Gang Tim Liu

[hashutosh] HIVE-4455 : HCatalog build directories get included in tar file 
produced by ant tar (Alan Gates via Ashutosh Chauhan)


Changes for Build #2090

Changes for Build #2091
[hashutosh] HIVE-4392 : Illogical InvalidObjectException throwed when use mulit 
aggregate functions with star columns  (Navis via Ashutosh Chauhan)

[hashutosh] HIVE-4421 : Improve memory usage by ORC dictionaries (Owen Omalley 
via Ashutosh Chauhan)

[mithun] HCATALOG-627 - Adding thread-safety to NotificationListener. (amalakar 
via mithun)


Changes for Build #2092
[hashutosh] HIVE-4466 : Fix continue.on.failure in unit tests to -well- 
continue on failure in unit tests (Gunther Hagleitner via Ashutosh Chauhan)

[hashutosh] HIVE-4471 : Build fails with hcatalog checkstyle error (Gunther 
Hagleitner via Ashutosh Chauhan)


Changes for Build #2093
[omalley] HIVE-4494 ORC map columns get class cast exception in some contexts 
(omalley)

[omalley] HIVE-4500 Ensure that HiveServer 2 closes log files. (Alan Gates via 
omalley)


Changes for Build #2094
[navis] HIVE-4209 Cache evaluation result of deterministic expression and reuse 
it (Navis via namit)


Changes for Build #2095

Changes for Build #2096

Changes for Build #2097
[cws] HIVE-4530. Enforce minmum ant version required in build script (Arup 
Malakar via cws)

[omalley] Preparing RELEASE_NOTES for Hive 0.11.0rc2.


Changes for Build #2098
[omalley] Update release notes for 0.11.0rc2

[omalley] HIVE-4527 Fix eclipse project template (Carl Steinbach via omalley)

[omalley] HIVE-4505 Hive can't load transforms with remote scripts. (Prasad 
Majumdar and Gunther Hagleitner
via omalley)

[omalley] HIVE-4498 TestBeeLineWithArgs.testPositiveScriptFile fails (Thejas 
Nair via omalley)


Changes for Build #2099

Changes for Build #2100

Changes for Build #2101

Changes for Build #2102

Changes for Build #2103
[daijy] PIG-2955: Fix bunch of Pig e2e tests on Windows


Changes for Build #2104
[daijy] PIG-3069: Native Windows Compatibility for Pig E2E Tests and Harness


Changes for Build #2105
[omalley] HIVE-4550 local_mapred_error_cache fails on some hadoop versions 
(Gunther 
Hagleitner via omalley)

[omalley] HIVE-4440 SMB Operator spills to disk like it's 1999 (Gunther 
Hagleitner via
omalley)


Changes for Build #2106

Changes for Build #2107
[omalley] HIVE-4486 FetchOperator slows down SMB map joins by 50% when there 
are many 
partitions (Gopal V via omalley)


Changes for Build #2108

Changes for Build #2109

Changes for Build #2110

Changes for Build #2111
[omalley] HIVE-4475 Switch RCFile default to LazyBinaryColumnarSerDe. (Guther 
Hagleitner
via omalley)

[omalley] HIVE-4521 Auto join conversion fails in certain cases (Gunther 
Hagleitner via
omalley)


Changes for Build #2112

Changes for Build #2113
[gates] HIVE-4578 Changes to Pig's test harness broke HCat e2e tests (gates)


Changes for Build #2114
[gates] HIVE-4581 HCat e2e tests broken by changes to Hive's describe table 
formatting (gates)


Changes for Build #2115



All tests passed

The Apache Jenkins build system has built Hive-trunk-h0.21 (build #2115)

Status: Still Failing

Check console output at https://builds.apache.org/job/Hive-trunk-h0.21/2115/ to 
view the results.

[jira] [Created] (HIVE-4603) VectorSelectOperator projections change the index of columns for subsequent operators.

2013-05-23 Thread Jitendra Nath Pandey (JIRA)
Jitendra Nath Pandey created HIVE-4603:
--

 Summary: VectorSelectOperator projections change the index of 
columns for subsequent operators.
 Key: HIVE-4603
 URL: https://issues.apache.org/jira/browse/HIVE-4603
 Project: Hive
  Issue Type: Sub-task
Reporter: Jitendra Nath Pandey
Assignee: Jitendra Nath Pandey




--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Updated] (HIVE-4603) VectorSelectOperator projections change the index of columns for subsequent operators.

2013-05-23 Thread Jitendra Nath Pandey (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-4603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jitendra Nath Pandey updated HIVE-4603:
---

Attachment: HIVE-4603.1.patch

Initial patch, the unit test needs to be fixed. I will upload another patch.

 VectorSelectOperator projections change the index of columns for subsequent 
 operators.
 --

 Key: HIVE-4603
 URL: https://issues.apache.org/jira/browse/HIVE-4603
 Project: Hive
  Issue Type: Sub-task
Reporter: Jitendra Nath Pandey
Assignee: Jitendra Nath Pandey
 Attachments: HIVE-4603.1.patch




--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira