[jira] [Created] (HIVE-4596) Fix serialization exceptions in VectorGroupByOperator
Remus Rusanu created HIVE-4596: -- Summary: Fix serialization exceptions in VectorGroupByOperator Key: HIVE-4596 URL: https://issues.apache.org/jira/browse/HIVE-4596 Project: Hive Issue Type: Sub-task Components: Query Processor Affects Versions: vectorization-branch Reporter: Remus Rusanu Assignee: Remus Rusanu Priority: Minor -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HIVE-4595) Support strings in GROUP BY keys
Remus Rusanu created HIVE-4595: -- Summary: Support strings in GROUP BY keys Key: HIVE-4595 URL: https://issues.apache.org/jira/browse/HIVE-4595 Project: Hive Issue Type: Sub-task Components: Query Processor Affects Versions: vectorization-branch Reporter: Remus Rusanu Assignee: Remus Rusanu -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HIVE-4598) Incorrect results when using subquery in multi table insert
Sebastian created HIVE-4598: --- Summary: Incorrect results when using subquery in multi table insert Key: HIVE-4598 URL: https://issues.apache.org/jira/browse/HIVE-4598 Project: Hive Issue Type: Bug Components: Query Processor Affects Versions: 0.11.0 Reporter: Sebastian I'm using a multi table insert like this: FROM x INSERT INTO TABLE t PARTITION (type='x') SELECT * WHERE type='x' INSERT INTO TABLE t PARTITION (type='y') SELECT * WHERE type='y'; Now when x is the name of a table, everything works as expected. However if I use a subquery as x, the query runs but it inserts all results from the subquery into each partition, as if there were no WHERE clauses in the selects. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4581) HCat e2e tests broken by changes to Hive's describe table formatting
[ https://issues.apache.org/jira/browse/HIVE-4581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13664971#comment-13664971 ] Hudson commented on HIVE-4581: -- Integrated in Hive-trunk-h0.21 #2114 (See [https://builds.apache.org/job/Hive-trunk-h0.21/2114/]) HIVE-4581 HCat e2e tests broken by changes to Hive's describe table formatting (gates) (Revision 1485472) Result = FAILURE gates : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1485472 Files : * /hive/trunk/hcatalog/src/test/e2e/hcatalog/tests/hcat.conf HCat e2e tests broken by changes to Hive's describe table formatting Key: HIVE-4581 URL: https://issues.apache.org/jira/browse/HIVE-4581 Project: Hive Issue Type: Bug Components: Tests Affects Versions: 0.11.0 Reporter: Alan Gates Assignee: Alan Gates Fix For: 0.12.0 Attachments: HIVE-4581.patch In Hive 0.11 the default formatting for describe table changed. A number of the HCat e2e tests do describe table and apply regular expressions to the output to make sure the table looks correct. These formatting changes broke those tests. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
Hive-trunk-h0.21 - Build # 2114 - Still Failing
Changes for Build #2089 [cws] HIVE-3957. Add pseudo-BNF grammar for RCFile to Javadoc (Mark Grover via cws) [cws] HIVE-4497. beeline module tests don't get run by default (Thejas Nair via cws) [gangtimliu] HIVE-4474: Column access not tracked properly for partitioned tables. Samuel Yuan via Gang Tim Liu [hashutosh] HIVE-4455 : HCatalog build directories get included in tar file produced by ant tar (Alan Gates via Ashutosh Chauhan) Changes for Build #2090 Changes for Build #2091 [hashutosh] HIVE-4392 : Illogical InvalidObjectException throwed when use mulit aggregate functions with star columns (Navis via Ashutosh Chauhan) [hashutosh] HIVE-4421 : Improve memory usage by ORC dictionaries (Owen Omalley via Ashutosh Chauhan) [mithun] HCATALOG-627 - Adding thread-safety to NotificationListener. (amalakar via mithun) Changes for Build #2092 [hashutosh] HIVE-4466 : Fix continue.on.failure in unit tests to -well- continue on failure in unit tests (Gunther Hagleitner via Ashutosh Chauhan) [hashutosh] HIVE-4471 : Build fails with hcatalog checkstyle error (Gunther Hagleitner via Ashutosh Chauhan) Changes for Build #2093 [omalley] HIVE-4494 ORC map columns get class cast exception in some contexts (omalley) [omalley] HIVE-4500 Ensure that HiveServer 2 closes log files. (Alan Gates via omalley) Changes for Build #2094 [navis] HIVE-4209 Cache evaluation result of deterministic expression and reuse it (Navis via namit) Changes for Build #2095 Changes for Build #2096 Changes for Build #2097 [cws] HIVE-4530. Enforce minmum ant version required in build script (Arup Malakar via cws) [omalley] Preparing RELEASE_NOTES for Hive 0.11.0rc2. Changes for Build #2098 [omalley] Update release notes for 0.11.0rc2 [omalley] HIVE-4527 Fix eclipse project template (Carl Steinbach via omalley) [omalley] HIVE-4505 Hive can't load transforms with remote scripts. (Prasad Majumdar and Gunther Hagleitner via omalley) [omalley] HIVE-4498 TestBeeLineWithArgs.testPositiveScriptFile fails (Thejas Nair via omalley) Changes for Build #2099 Changes for Build #2100 Changes for Build #2101 Changes for Build #2102 Changes for Build #2103 [daijy] PIG-2955: Fix bunch of Pig e2e tests on Windows Changes for Build #2104 [daijy] PIG-3069: Native Windows Compatibility for Pig E2E Tests and Harness Changes for Build #2105 [omalley] HIVE-4550 local_mapred_error_cache fails on some hadoop versions (Gunther Hagleitner via omalley) [omalley] HIVE-4440 SMB Operator spills to disk like it's 1999 (Gunther Hagleitner via omalley) Changes for Build #2106 Changes for Build #2107 [omalley] HIVE-4486 FetchOperator slows down SMB map joins by 50% when there are many partitions (Gopal V via omalley) Changes for Build #2108 Changes for Build #2109 Changes for Build #2110 Changes for Build #2111 [omalley] HIVE-4475 Switch RCFile default to LazyBinaryColumnarSerDe. (Guther Hagleitner via omalley) [omalley] HIVE-4521 Auto join conversion fails in certain cases (Gunther Hagleitner via omalley) Changes for Build #2112 Changes for Build #2113 [gates] HIVE-4578 Changes to Pig's test harness broke HCat e2e tests (gates) Changes for Build #2114 [gates] HIVE-4581 HCat e2e tests broken by changes to Hive's describe table formatting (gates) All tests passed The Apache Jenkins build system has built Hive-trunk-h0.21 (build #2114) Status: Still Failing Check console output at https://builds.apache.org/job/Hive-trunk-h0.21/2114/ to view the results.
[jira] [Commented] (HIVE-4540) JOIN-GRP BY-DISTINCT fails with NPE when mapjoin.mapreduce=true
[ https://issues.apache.org/jira/browse/HIVE-4540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13664994#comment-13664994 ] Navis commented on HIVE-4540: - +1, will run test JOIN-GRP BY-DISTINCT fails with NPE when mapjoin.mapreduce=true --- Key: HIVE-4540 URL: https://issues.apache.org/jira/browse/HIVE-4540 Project: Hive Issue Type: Bug Reporter: Gunther Hagleitner Assignee: Gunther Hagleitner Attachments: HIVE-4540.1.patch If the mapjoin.mapreduce optimization kicks in on a query of this form: {noformat} select count(distinct a.v) from a join b on (a.k = b.k) group by a.g {noformat} The planer will NPE in the metadataonly optimizer. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4526) auto_sortmerge_join_9.q throws NPE but test is succeeded
[ https://issues.apache.org/jira/browse/HIVE-4526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13665009#comment-13665009 ] Navis commented on HIVE-4526: - [~appodictic] I've rebased the patch and confirmed working good. Did you run it with empty partitions? If it is, I'll check that too. auto_sortmerge_join_9.q throws NPE but test is succeeded Key: HIVE-4526 URL: https://issues.apache.org/jira/browse/HIVE-4526 Project: Hive Issue Type: Test Components: Tests Reporter: Navis Assignee: Navis Attachments: HIVE-4526.D10725.1.patch auto_sortmerge_join_9.q {noformat} [junit] Running org.apache.hadoop.hive.cli.TestCliDriver [junit] Begin query: auto_sortmerge_join_9.q [junit] Deleted file:/home/navis/apache/oss-hive/build/ql/test/data/warehouse/tbl1 [junit] Deleted file:/home/navis/apache/oss-hive/build/ql/test/data/warehouse/tbl2 [junit] org.apache.hadoop.hive.ql.metadata.HiveException: Failed with exception nulljava.lang.NullPointerException [junit] at org.apache.hadoop.hive.ql.exec.FetchOperator.getRowInspectorFromPartitionedTable(FetchOperator.java:252) [junit] at org.apache.hadoop.hive.ql.exec.FetchOperator.getOutputObjectInspector(FetchOperator.java:605) [junit] at org.apache.hadoop.hive.ql.exec.MapredLocalTask.initializeOperators(MapredLocalTask.java:393) [junit] at org.apache.hadoop.hive.ql.exec.MapredLocalTask.executeFromChildJVM(MapredLocalTask.java:277) [junit] at org.apache.hadoop.hive.ql.exec.ExecDriver.main(ExecDriver.java:676) [junit] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [junit] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) [junit] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) [junit] at java.lang.reflect.Method.invoke(Method.java:597) [junit] at org.apache.hadoop.util.RunJar.main(RunJar.java:156) [junit] [junit] at org.apache.hadoop.hive.ql.exec.FetchOperator.getOutputObjectInspector(FetchOperator.java:631) [junit] at org.apache.hadoop.hive.ql.exec.MapredLocalTask.initializeOperators(MapredLocalTask.java:393) [junit] at org.apache.hadoop.hive.ql.exec.MapredLocalTask.executeFromChildJVM(MapredLocalTask.java:277) [junit] at org.apache.hadoop.hive.ql.exec.ExecDriver.main(ExecDriver.java:676) [junit] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [junit] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) [junit] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) [junit] at java.lang.reflect.Method.invoke(Method.java:597) [junit] at org.apache.hadoop.util.RunJar.main(RunJar.java:156) [junit] org.apache.hadoop.hive.ql.metadata.HiveException: Failed with exception nulljava.lang.NullPointerException [junit] at org.apache.hadoop.hive.ql.exec.FetchOperator.getRowInspectorFromPartitionedTable(FetchOperator.java:252) [junit] at org.apache.hadoop.hive.ql.exec.FetchOperator.getOutputObjectInspector(FetchOperator.java:605) [junit] at org.apache.hadoop.hive.ql.exec.MapredLocalTask.initializeOperators(MapredLocalTask.java:393) [junit] at org.apache.hadoop.hive.ql.exec.MapredLocalTask.executeFromChildJVM(MapredLocalTask.java:277) [junit] at org.apache.hadoop.hive.ql.exec.ExecDriver.main(ExecDriver.java:676) [junit] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [junit] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) [junit] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) [junit] at java.lang.reflect.Method.invoke(Method.java:597) [junit] at org.apache.hadoop.util.RunJar.main(RunJar.java:156) [junit] [junit] at org.apache.hadoop.hive.ql.exec.FetchOperator.getOutputObjectInspector(FetchOperator.java:631) [junit] at org.apache.hadoop.hive.ql.exec.MapredLocalTask.initializeOperators(MapredLocalTask.java:393) [junit] at org.apache.hadoop.hive.ql.exec.MapredLocalTask.executeFromChildJVM(MapredLocalTask.java:277) [junit] at org.apache.hadoop.hive.ql.exec.ExecDriver.main(ExecDriver.java:676) [junit] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [junit] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) [junit] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) [junit] at java.lang.reflect.Method.invoke(Method.java:597) [junit] at
[jira] [Commented] (HIVE-3534) Add left Lateral view syntax
[ https://issues.apache.org/jira/browse/HIVE-3534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13665011#comment-13665011 ] Navis commented on HIVE-3534: - [~appodictic] Interesting. How about make a grammar something like OUTER LATERAL VIEW, which could be used more generic with all other UDTFs? Add left Lateral view syntax Key: HIVE-3534 URL: https://issues.apache.org/jira/browse/HIVE-3534 Project: Hive Issue Type: New Feature Reporter: Edward Capriolo Assignee: Edward Capriolo Attachments: hive-3534.diff.txt A lateral view is like a join and if the function in question (like explode()) produces zero rows then you lose the row whereas conceivably you could keep the row and just fill all entry with nulls. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-1402) Add parallel ORDER BY to Hive
[ https://issues.apache.org/jira/browse/HIVE-1402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navis updated HIVE-1402: Status: Open (was: Patch Available) Add parallel ORDER BY to Hive - Key: HIVE-1402 URL: https://issues.apache.org/jira/browse/HIVE-1402 Project: Hive Issue Type: New Feature Components: Query Processor Reporter: Jeff Hammerbacher Assignee: Navis Labels: optimization Attachments: HIVE-1402.D8895.1.patch -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4581) HCat e2e tests broken by changes to Hive's describe table formatting
[ https://issues.apache.org/jira/browse/HIVE-4581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13665068#comment-13665068 ] Hudson commented on HIVE-4581: -- Integrated in Hive-trunk-hadoop2 #207 (See [https://builds.apache.org/job/Hive-trunk-hadoop2/207/]) HIVE-4581 HCat e2e tests broken by changes to Hive's describe table formatting (gates) (Revision 1485472) Result = FAILURE gates : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1485472 Files : * /hive/trunk/hcatalog/src/test/e2e/hcatalog/tests/hcat.conf HCat e2e tests broken by changes to Hive's describe table formatting Key: HIVE-4581 URL: https://issues.apache.org/jira/browse/HIVE-4581 Project: Hive Issue Type: Bug Components: Tests Affects Versions: 0.11.0 Reporter: Alan Gates Assignee: Alan Gates Fix For: 0.12.0 Attachments: HIVE-4581.patch In Hive 0.11 the default formatting for describe table changed. A number of the HCat e2e tests do describe table and apply regular expressions to the output to make sure the table looks correct. These formatting changes broke those tests. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Work started] (HIVE-4595) Support strings in GROUP BY keys
[ https://issues.apache.org/jira/browse/HIVE-4595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HIVE-4595 started by Remus Rusanu. Support strings in GROUP BY keys Key: HIVE-4595 URL: https://issues.apache.org/jira/browse/HIVE-4595 Project: Hive Issue Type: Sub-task Components: Query Processor Affects Versions: vectorization-branch Reporter: Remus Rusanu Assignee: Remus Rusanu -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
Review Request: HIVE-4160 Add support for string type keys in vectorized GROUP BY
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/11345/ --- Review request for hive, Jitendra Pandey, Eric Hanson, and Sarvesh Sakalanaga. Description --- Extend the VectorHashKeyWrapper and VectorHashKeyWrapperBatch to support ByteColumnVector (ie. string) keys. The addition falls into the existing VectorKeyHashWrapper behavior: the string keys support is 'compiled' once per query into a VectorHashKeyWrapperBatch instance. The VectorHashKeyWrapper is extended to support byte[] key. It stores the key values just like the ByteColumnVector class, by using a byte[][], a start int[] and a lenght int[]. During batch processing ther eis no value copy, the keywrappers take a reference to the data from the batch (ie. they refer the same byte[p] and copy the start/length). This avoids potentially expensive size-of-key copy operations *before* the hash probe. The VectorHashKeyWrapper clonning that occurs when a probe reveleas a missing key in the hash will copy the key (it must) and this is the only time we copy the key values. This addresses bug HIVE-4160. https://issues.apache.org/jira/browse/HIVE-4160 Diffs - ql/src/java/org/apache/hadoop/hive/ql/exec/VectorHashKeyWrapper.java 35712d0 ql/src/java/org/apache/hadoop/hive/ql/exec/VectorHashKeyWrapperBatch.java c23614c ql/src/java/org/apache/hadoop/hive/ql/exec/vector/VectorizationContext.java 1ef4955 ql/src/test/org/apache/hadoop/hive/ql/exec/vector/FakeVectorRowBatchFromObjectIterables.java PRE-CREATION ql/src/test/org/apache/hadoop/hive/ql/exec/vector/TestVectorGroupByOperator.java b3b5cd2 ql/src/test/org/apache/hadoop/hive/ql/exec/vector/util/FakeVectorRowBatchFromIterables.java cf3399d ql/src/test/org/apache/hadoop/hive/ql/exec/vector/util/FakeVectorRowBatchFromLongIterables.java PRE-CREATION Diff: https://reviews.apache.org/r/11345/diff/ Testing --- Extended vectorized GROUP BY unit test to cover String keys for some cases. Thanks, Remus Rusanu
Re: Review Request: HIVE-4595 Add support for string type keys in vectorized GROUP BY
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/11345/ --- (Updated May 23, 2013, 1:30 p.m.) Review request for hive, Jitendra Pandey, Eric Hanson, and Sarvesh Sakalanaga. Changes --- 4595 obviously, not 4160 Summary (updated) - HIVE-4595 Add support for string type keys in vectorized GROUP BY Description --- Extend the VectorHashKeyWrapper and VectorHashKeyWrapperBatch to support ByteColumnVector (ie. string) keys. The addition falls into the existing VectorKeyHashWrapper behavior: the string keys support is 'compiled' once per query into a VectorHashKeyWrapperBatch instance. The VectorHashKeyWrapper is extended to support byte[] key. It stores the key values just like the ByteColumnVector class, by using a byte[][], a start int[] and a lenght int[]. During batch processing ther eis no value copy, the keywrappers take a reference to the data from the batch (ie. they refer the same byte[p] and copy the start/length). This avoids potentially expensive size-of-key copy operations *before* the hash probe. The VectorHashKeyWrapper clonning that occurs when a probe reveleas a missing key in the hash will copy the key (it must) and this is the only time we copy the key values. This addresses bug HIVE-4595. https://issues.apache.org/jira/browse/HIVE-4595 Diffs - ql/src/java/org/apache/hadoop/hive/ql/exec/VectorHashKeyWrapper.java 35712d0 ql/src/java/org/apache/hadoop/hive/ql/exec/VectorHashKeyWrapperBatch.java c23614c ql/src/java/org/apache/hadoop/hive/ql/exec/vector/VectorizationContext.java 1ef4955 ql/src/test/org/apache/hadoop/hive/ql/exec/vector/FakeVectorRowBatchFromObjectIterables.java PRE-CREATION ql/src/test/org/apache/hadoop/hive/ql/exec/vector/TestVectorGroupByOperator.java b3b5cd2 ql/src/test/org/apache/hadoop/hive/ql/exec/vector/util/FakeVectorRowBatchFromIterables.java cf3399d ql/src/test/org/apache/hadoop/hive/ql/exec/vector/util/FakeVectorRowBatchFromLongIterables.java PRE-CREATION Diff: https://reviews.apache.org/r/11345/diff/ Testing --- Extended vectorized GROUP BY unit test to cover String keys for some cases. Thanks, Remus Rusanu
[jira] [Updated] (HIVE-4595) Support strings in GROUP BY keys
[ https://issues.apache.org/jira/browse/HIVE-4595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Remus Rusanu updated HIVE-4595: --- Attachment: HIVE-4595.patch.txt Support strings in GROUP BY keys Key: HIVE-4595 URL: https://issues.apache.org/jira/browse/HIVE-4595 Project: Hive Issue Type: Sub-task Components: Query Processor Affects Versions: vectorization-branch Reporter: Remus Rusanu Assignee: Remus Rusanu Fix For: vectorization-branch Attachments: HIVE-4595.patch.txt -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4595) Support strings in GROUP BY keys
[ https://issues.apache.org/jira/browse/HIVE-4595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Remus Rusanu updated HIVE-4595: --- Fix Version/s: vectorization-branch Status: Patch Available (was: In Progress) Available in reviewboard https://reviews.apache.org/r/11345/ Support strings in GROUP BY keys Key: HIVE-4595 URL: https://issues.apache.org/jira/browse/HIVE-4595 Project: Hive Issue Type: Sub-task Components: Query Processor Affects Versions: vectorization-branch Reporter: Remus Rusanu Assignee: Remus Rusanu Fix For: vectorization-branch Attachments: HIVE-4595.patch.txt -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4598) Incorrect results when using subquery in multi table insert
[ https://issues.apache.org/jira/browse/HIVE-4598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13665218#comment-13665218 ] Sebastian commented on HIVE-4598: - The same problem exists when x is a view. Incorrect results when using subquery in multi table insert --- Key: HIVE-4598 URL: https://issues.apache.org/jira/browse/HIVE-4598 Project: Hive Issue Type: Bug Components: Query Processor Affects Versions: 0.11.0 Reporter: Sebastian I'm using a multi table insert like this: FROM x INSERT INTO TABLE t PARTITION (type='x') SELECT * WHERE type='x' INSERT INTO TABLE t PARTITION (type='y') SELECT * WHERE type='y'; Now when x is the name of a table, everything works as expected. However if I use a subquery as x, the query runs but it inserts all results from the subquery into each partition, as if there were no WHERE clauses in the selects. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4596) Fix serialization exceptions in VectorGroupByOperator
[ https://issues.apache.org/jira/browse/HIVE-4596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Remus Rusanu updated HIVE-4596: --- Description: Going down the vectorization path java.lang.InstantiationException: org.apache.hadoop.hive.serde2.objectinspector.StandardStructObjectInspector Continuing ... java.lang.RuntimeException: failed to evaluate: unbound=Class.new(); Continuing ... java.lang.InstantiationException: org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator Continuing ... java.lang.Exception: XMLEncoder: discarding statement ArrayList.add(VectorGroupByOperator); Continuing ... Fix serialization exceptions in VectorGroupByOperator - Key: HIVE-4596 URL: https://issues.apache.org/jira/browse/HIVE-4596 Project: Hive Issue Type: Sub-task Components: Query Processor Affects Versions: vectorization-branch Reporter: Remus Rusanu Assignee: Remus Rusanu Priority: Minor Going down the vectorization path java.lang.InstantiationException: org.apache.hadoop.hive.serde2.objectinspector.StandardStructObjectInspector Continuing ... java.lang.RuntimeException: failed to evaluate: unbound=Class.new(); Continuing ... java.lang.InstantiationException: org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator Continuing ... java.lang.Exception: XMLEncoder: discarding statement ArrayList.add(VectorGroupByOperator); Continuing ... -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HIVE-4599) VectorGroupByOperator steals the non-vectorized children and crashes query if vectorization fails
Remus Rusanu created HIVE-4599: -- Summary: VectorGroupByOperator steals the non-vectorized children and crashes query if vectorization fails Key: HIVE-4599 URL: https://issues.apache.org/jira/browse/HIVE-4599 Project: Hive Issue Type: Sub-task Components: Query Processor Affects Versions: vectorization-branch Reporter: Remus Rusanu Assignee: Remus Rusanu Have the VGBy clone it's own row mode children or implement vector mode output (including VectorReduceSinkOperator) -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
Re: Review Request: HIVE-4588: Support session level hooks for HiveServer2
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/11326/#review20940 --- Prasad, looks good to me! (non-binding) - Brock Noland On May 22, 2013, 6:41 a.m., Prasad Mujumdar wrote: --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/11326/ --- (Updated May 22, 2013, 6:41 a.m.) Review request for hive. Description --- Support session level hooks for HiveServer2 - New config parameter to define the hook - New hook context interface to pass the serssion user and config to the hook implementation - Session manager executes the configured hooks when a new session starts This addresses bug HIVE-4588. https://issues.apache.org/jira/browse/HIVE-4588 Diffs - common/src/java/org/apache/hadoop/hive/conf/HiveConf.java 335af45 service/src/java/org/apache/hive/service/cli/session/HiveSessionHook.java PRE-CREATION service/src/java/org/apache/hive/service/cli/session/HiveSessionHookContext.java PRE-CREATION service/src/java/org/apache/hive/service/cli/session/HiveSessionHookContextImpl.java PRE-CREATION service/src/java/org/apache/hive/service/cli/session/SessionManager.java 3bb6807 service/src/test/org/apache/hive/service/cli/session/TestSessionHooks.java PRE-CREATION Diff: https://reviews.apache.org/r/11326/diff/ Testing --- Added new test for session hooks Thanks, Prasad Mujumdar
[jira] [Commented] (HIVE-3534) Add left Lateral view syntax
[ https://issues.apache.org/jira/browse/HIVE-3534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13665247#comment-13665247 ] Edward Capriolo commented on HIVE-3534: --- I did consider that. I have never actually added anything to hive grammar also not skilled on developing query parsers/planners. I would like to add this UDF and possibly do what you are suggesting as a follow up, but I could use someone to guide me through it. Add left Lateral view syntax Key: HIVE-3534 URL: https://issues.apache.org/jira/browse/HIVE-3534 Project: Hive Issue Type: New Feature Reporter: Edward Capriolo Assignee: Edward Capriolo Attachments: hive-3534.diff.txt A lateral view is like a join and if the function in question (like explode()) produces zero rows then you lose the row whereas conceivably you could keep the row and just fill all entry with nulls. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4597) Remove test code from ql\src\java tree, place it itn ql\src\test tree
[ https://issues.apache.org/jira/browse/HIVE-4597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13665328#comment-13665328 ] Tony Murphy commented on HIVE-4597: --- this is tricky since the test cases and vector expressions need to be generated in parallel, otherwise I don't have access to sufficient information to generate the tests. It would take major refactoring of CodeGen to make TestCodeGen independent. we could pull all the code generation(test and dev) up to hive_root\ql\src\gen Remove test code from ql\src\java tree, place it itn ql\src\test tree - Key: HIVE-4597 URL: https://issues.apache.org/jira/browse/HIVE-4597 Project: Hive Issue Type: Sub-task Components: Query Processor Reporter: Remus Rusanu Assignee: Tony Murphy Priority: Minor The TestCodeGen and the generated files (probably the templates too) belong in the ql\src\test tree, not in the ql\src\java tree -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4597) Remove test code from ql\src\java tree, place it itn ql\src\test tree
[ https://issues.apache.org/jira/browse/HIVE-4597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13665340#comment-13665340 ] Tony Murphy commented on HIVE-4597: --- also, the generated test suites are generated under ql\src\test\org\...vector\expressions\gen, the only things in the src tree should be the generation logic and the templates. Remove test code from ql\src\java tree, place it itn ql\src\test tree - Key: HIVE-4597 URL: https://issues.apache.org/jira/browse/HIVE-4597 Project: Hive Issue Type: Sub-task Components: Query Processor Reporter: Remus Rusanu Assignee: Tony Murphy Priority: Minor The TestCodeGen and the generated files (probably the templates too) belong in the ql\src\test tree, not in the ql\src\java tree -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4579) Create a SARG interface for RecordReaders
[ https://issues.apache.org/jira/browse/HIVE-4579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-4579: Attachment: h-4579.patch A patch with the interface for the SARGs. Create a SARG interface for RecordReaders - Key: HIVE-4579 URL: https://issues.apache.org/jira/browse/HIVE-4579 Project: Hive Issue Type: Improvement Reporter: Owen O'Malley Assignee: Owen O'Malley Attachments: h-4579.patch, pushdown.pdf I think we should create a SARG (http://en.wikipedia.org/wiki/Sargable) interface for RecordReaders. For a first pass, I'll create an API that uses the value stored in hive.io.filter.expr.serialized. The desire is to define an simpler interface that the direct AST expression that is provided by hive.io.filter.expr.serialized so that the code to evaluate expressions can be generalized instead of put inside a particular RecordReader. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4597) Remove test code from ql\src\java tree, place it itn ql\src\test tree
[ https://issues.apache.org/jira/browse/HIVE-4597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tony Murphy updated HIVE-4597: -- Attachment: HIVE-4597.patch Remove test code from ql\src\java tree, place it itn ql\src\test tree - Key: HIVE-4597 URL: https://issues.apache.org/jira/browse/HIVE-4597 Project: Hive Issue Type: Sub-task Components: Query Processor Reporter: Remus Rusanu Assignee: Tony Murphy Priority: Minor Attachments: HIVE-4597.patch The TestCodeGen and the generated files (probably the templates too) belong in the ql\src\test tree, not in the ql\src\java tree -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
Review Request: HIVE-4597: Move Vector Expression and Vector Expression Evaluation Test Generation
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/11349/ --- Review request for hive, Jitendra Pandey, Eric Hanson, Sarvesh Sakalanaga, and Remus Rusanu. Description --- Move Vector Expression and Vector Expression Evaluation Test Generation to \ql\src\gen\vectorization and update CodeGen to place generated files correctly into source tree. See lines 218 to 249 for changes. This addresses bug HIVE-4597. https://issues.apache.org/jira/browse/HIVE-4597 Diffs - ql/src/gen/vectorization/org/apache/hadoop/hive/ql/exec/vector/expressions/gen/CodeGen.java PRE-CREATION ql/src/gen/vectorization/org/apache/hadoop/hive/ql/exec/vector/expressions/gen/ColumnArithmeticColumn.txt PRE-CREATION ql/src/gen/vectorization/org/apache/hadoop/hive/ql/exec/vector/expressions/gen/ColumnArithmeticScalar.txt PRE-CREATION ql/src/gen/vectorization/org/apache/hadoop/hive/ql/exec/vector/expressions/gen/ColumnCompareScalar.txt PRE-CREATION ql/src/gen/vectorization/org/apache/hadoop/hive/ql/exec/vector/expressions/gen/ColumnUnaryMinus.txt PRE-CREATION ql/src/gen/vectorization/org/apache/hadoop/hive/ql/exec/vector/expressions/gen/FilterColumnCompareColumn.txt PRE-CREATION ql/src/gen/vectorization/org/apache/hadoop/hive/ql/exec/vector/expressions/gen/FilterColumnCompareScalar.txt PRE-CREATION ql/src/gen/vectorization/org/apache/hadoop/hive/ql/exec/vector/expressions/gen/FilterStringColumnCompareColumn.txt PRE-CREATION ql/src/gen/vectorization/org/apache/hadoop/hive/ql/exec/vector/expressions/gen/FilterStringColumnCompareScalar.txt PRE-CREATION ql/src/gen/vectorization/org/apache/hadoop/hive/ql/exec/vector/expressions/gen/ScalarArithmeticColumn.txt PRE-CREATION ql/src/gen/vectorization/org/apache/hadoop/hive/ql/exec/vector/expressions/gen/TestClass.txt PRE-CREATION ql/src/gen/vectorization/org/apache/hadoop/hive/ql/exec/vector/expressions/gen/TestCodeGen.java PRE-CREATION ql/src/gen/vectorization/org/apache/hadoop/hive/ql/exec/vector/expressions/gen/TestColumnColumnFilterVectorExpressionEvaluation.txt PRE-CREATION ql/src/gen/vectorization/org/apache/hadoop/hive/ql/exec/vector/expressions/gen/TestColumnColumnOperationVectorExpressionEvaluation.txt PRE-CREATION ql/src/gen/vectorization/org/apache/hadoop/hive/ql/exec/vector/expressions/gen/TestColumnScalarFilterVectorExpressionEvaluation.txt PRE-CREATION ql/src/gen/vectorization/org/apache/hadoop/hive/ql/exec/vector/expressions/gen/TestColumnScalarOperationVectorExpressionEvaluation.txt PRE-CREATION ql/src/gen/vectorization/org/apache/hadoop/hive/ql/exec/vector/expressions/gen/VectorUDAFAvg.txt PRE-CREATION ql/src/gen/vectorization/org/apache/hadoop/hive/ql/exec/vector/expressions/gen/VectorUDAFCount.txt PRE-CREATION ql/src/gen/vectorization/org/apache/hadoop/hive/ql/exec/vector/expressions/gen/VectorUDAFMinMax.txt PRE-CREATION ql/src/gen/vectorization/org/apache/hadoop/hive/ql/exec/vector/expressions/gen/VectorUDAFSum.txt PRE-CREATION ql/src/gen/vectorization/org/apache/hadoop/hive/ql/exec/vector/expressions/gen/VectorUDAFVar.txt PRE-CREATION ql/src/java/org/apache/hadoop/hive/ql/exec/vector/expressions/templates/CodeGen.java 3ef2aa8 ql/src/java/org/apache/hadoop/hive/ql/exec/vector/expressions/templates/ColumnArithmeticColumn.txt 0e56721 ql/src/java/org/apache/hadoop/hive/ql/exec/vector/expressions/templates/ColumnArithmeticScalar.txt 474a979 ql/src/java/org/apache/hadoop/hive/ql/exec/vector/expressions/templates/ColumnCompareScalar.txt dcf87b0 ql/src/java/org/apache/hadoop/hive/ql/exec/vector/expressions/templates/ColumnUnaryMinus.txt 9d16bdd ql/src/java/org/apache/hadoop/hive/ql/exec/vector/expressions/templates/FilterColumnCompareColumn.txt 8e3b717 ql/src/java/org/apache/hadoop/hive/ql/exec/vector/expressions/templates/FilterColumnCompareScalar.txt 04bc69c ql/src/java/org/apache/hadoop/hive/ql/exec/vector/expressions/templates/FilterStringColumnCompareColumn.txt 9309326 ql/src/java/org/apache/hadoop/hive/ql/exec/vector/expressions/templates/FilterStringColumnCompareScalar.txt 30eddcf ql/src/java/org/apache/hadoop/hive/ql/exec/vector/expressions/templates/ScalarArithmeticColumn.txt 9899e7e ql/src/java/org/apache/hadoop/hive/ql/exec/vector/expressions/templates/TestClass.txt c8de5de ql/src/java/org/apache/hadoop/hive/ql/exec/vector/expressions/templates/TestCodeGen.java 34c093c ql/src/java/org/apache/hadoop/hive/ql/exec/vector/expressions/templates/TestColumnColumnFilterVectorExpressionEvaluation.txt 2bb1aa3 ql/src/java/org/apache/hadoop/hive/ql/exec/vector/expressions/templates/TestColumnColumnOperationVectorExpressionEvaluation.txt 4ab3e76
[jira] [Updated] (HIVE-4597) Remove test code from ql\src\java tree, place it itn ql\src\test tree
[ https://issues.apache.org/jira/browse/HIVE-4597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tony Murphy updated HIVE-4597: -- Attachment: (was: HIVE-4597.patch) Remove test code from ql\src\java tree, place it itn ql\src\test tree - Key: HIVE-4597 URL: https://issues.apache.org/jira/browse/HIVE-4597 Project: Hive Issue Type: Sub-task Components: Query Processor Reporter: Remus Rusanu Assignee: Tony Murphy Priority: Minor The TestCodeGen and the generated files (probably the templates too) belong in the ql\src\test tree, not in the ql\src\java tree -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4597) Remove test code from ql\src\java tree, place it itn ql\src\test tree
[ https://issues.apache.org/jira/browse/HIVE-4597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tony Murphy updated HIVE-4597: -- Attachment: HIVE-4597.patch Remove test code from ql\src\java tree, place it itn ql\src\test tree - Key: HIVE-4597 URL: https://issues.apache.org/jira/browse/HIVE-4597 Project: Hive Issue Type: Sub-task Components: Query Processor Reporter: Remus Rusanu Assignee: Tony Murphy Priority: Minor Attachments: HIVE-4597.patch The TestCodeGen and the generated files (probably the templates too) belong in the ql\src\test tree, not in the ql\src\java tree -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4597) Remove test code from ql\src\java tree, place it itn ql\src\test tree
[ https://issues.apache.org/jira/browse/HIVE-4597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13665528#comment-13665528 ] Tony Murphy commented on HIVE-4597: --- review board review: https://reviews.apache.org/r/11349 Remove test code from ql\src\java tree, place it itn ql\src\test tree - Key: HIVE-4597 URL: https://issues.apache.org/jira/browse/HIVE-4597 Project: Hive Issue Type: Sub-task Components: Query Processor Reporter: Remus Rusanu Assignee: Tony Murphy Priority: Minor Attachments: HIVE-4597.patch The TestCodeGen and the generated files (probably the templates too) belong in the ql\src\test tree, not in the ql\src\java tree -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4592) ColumnArithmeticColumn.txt template never sets output isNull to true; can give wrong results
[ https://issues.apache.org/jira/browse/HIVE-4592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Hanson updated HIVE-4592: -- Attachment: HIVE-4592.1.patch ColumnArithmeticColumn.txt template never sets output isNull to true; can give wrong results Key: HIVE-4592 URL: https://issues.apache.org/jira/browse/HIVE-4592 Project: Hive Issue Type: Sub-task Affects Versions: vectorization-branch Reporter: Eric Hanson Assignee: Eric Hanson Fix For: vectorization-branch Attachments: HIVE-4592.1.patch ColumnArithmeticColumn.txt should set the output column's noNulls flag to true if neither input column has nulls, but it does not do that. This can lead to wrong results is the noNulls was set to false in a previous use of the batch. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4592) ColumnArithmeticColumn.txt template never sets output isNull to true; can give wrong results
[ https://issues.apache.org/jira/browse/HIVE-4592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13665535#comment-13665535 ] Eric Hanson commented on HIVE-4592: --- Let me look at the other templates. I expect I will broaden this to cover other templates. I fixed the issue in this template ColumnArithmeticColumn.txt regarding the assumption that noNulls=false and isRepeating=true means all values are null, which is not a correct assumption. So, the patch is not ready yet. Wait for another revision. ColumnArithmeticColumn.txt template never sets output isNull to true; can give wrong results Key: HIVE-4592 URL: https://issues.apache.org/jira/browse/HIVE-4592 Project: Hive Issue Type: Sub-task Affects Versions: vectorization-branch Reporter: Eric Hanson Assignee: Eric Hanson Fix For: vectorization-branch Attachments: HIVE-4592.1.patch ColumnArithmeticColumn.txt should set the output column's noNulls flag to true if neither input column has nulls, but it does not do that. This can lead to wrong results is the noNulls was set to false in a previous use of the batch. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HIVE-4600) Vectorized reader support for timestamp in ORC.
Sarvesh Sakalanaga created HIVE-4600: Summary: Vectorized reader support for timestamp in ORC. Key: HIVE-4600 URL: https://issues.apache.org/jira/browse/HIVE-4600 Project: Hive Issue Type: Sub-task Components: File Formats Reporter: Sarvesh Sakalanaga Assignee: Sarvesh Sakalanaga -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4511) Vectorized reader support for Byte and Boolean.
[ https://issues.apache.org/jira/browse/HIVE-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sarvesh Sakalanaga updated HIVE-4511: - Summary: Vectorized reader support for Byte and Boolean. (was: Vectorized reader support for Byte, Boolean and timestamp in ORC.) Vectorized reader support for Byte and Boolean. --- Key: HIVE-4511 URL: https://issues.apache.org/jira/browse/HIVE-4511 Project: Hive Issue Type: Sub-task Components: File Formats Reporter: Jitendra Nath Pandey Assignee: Sarvesh Sakalanaga Byte, boolean and timestamp support should be added to vectorized orc reader. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4511) Vectorized reader support for Byte and Boolean.
[ https://issues.apache.org/jira/browse/HIVE-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sarvesh Sakalanaga updated HIVE-4511: - Status: Patch Available (was: Open) Vectorized reader support for Byte and Boolean. --- Key: HIVE-4511 URL: https://issues.apache.org/jira/browse/HIVE-4511 Project: Hive Issue Type: Sub-task Components: File Formats Reporter: Jitendra Nath Pandey Assignee: Sarvesh Sakalanaga Attachments: Hive-4511.0.patch Byte, boolean and timestamp support should be added to vectorized orc reader. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4599) VectorGroupByOperator steals the non-vectorized children and crashes query if vectorization fails
[ https://issues.apache.org/jira/browse/HIVE-4599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13665549#comment-13665549 ] Jitendra Nath Pandey commented on HIVE-4599: I will recommend putting in VectorReduceSinkOperator, because that will make vectorized map side and non-vectorize reduce side work together for non-GBy queries too. VectorGroupByOperator steals the non-vectorized children and crashes query if vectorization fails - Key: HIVE-4599 URL: https://issues.apache.org/jira/browse/HIVE-4599 Project: Hive Issue Type: Sub-task Components: Query Processor Affects Versions: vectorization-branch Reporter: Remus Rusanu Assignee: Remus Rusanu Have the VGBy clone it's own row mode children or implement vector mode output (including VectorReduceSinkOperator) -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
Review Request: Vectorized reader support for Byte and Boolean.
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/11350/ --- Review request for hive. Description --- Change adds support for datatypes byte and boolean for Vectorized query execution. This addresses bug Hive-4511. https://issues.apache.org/jira/browse/Hive-4511 Diffs - ql/src/java/org/apache/hadoop/hive/ql/exec/vector/VectorizedBatchUtil.java 0e19e59 ql/src/java/org/apache/hadoop/hive/ql/exec/vector/VectorizedRowBatchCtx.java 1a57766 ql/src/java/org/apache/hadoop/hive/ql/io/orc/BitFieldReader.java 11c3fdf ql/src/java/org/apache/hadoop/hive/ql/io/orc/RecordReaderImpl.java f15779d ql/src/java/org/apache/hadoop/hive/ql/io/orc/RunLengthByteReader.java 678a2f5 ql/src/test/org/apache/hadoop/hive/ql/io/orc/TestVectorizedORCReader.java e8c75c6 Diff: https://reviews.apache.org/r/11350/diff/ Testing --- Thanks, Sarvesh Sakalanaga
[jira] [Commented] (HIVE-4511) Vectorized reader support for Byte and Boolean.
[ https://issues.apache.org/jira/browse/HIVE-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13665550#comment-13665550 ] Sarvesh Sakalanaga commented on HIVE-4511: -- Review at : https://reviews.apache.org/r/11350/ Vectorized reader support for Byte and Boolean. --- Key: HIVE-4511 URL: https://issues.apache.org/jira/browse/HIVE-4511 Project: Hive Issue Type: Sub-task Components: File Formats Reporter: Jitendra Nath Pandey Assignee: Sarvesh Sakalanaga Attachments: Hive-4511.0.patch Byte, boolean and timestamp support should be added to vectorized orc reader. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (HIVE-2390) Expand support for union types
[ https://issues.apache.org/jira/browse/HIVE-2390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan reassigned HIVE-2390: - Assignee: (was: Jakob Homan) Expand support for union types -- Key: HIVE-2390 URL: https://issues.apache.org/jira/browse/HIVE-2390 Project: Hive Issue Type: Bug Reporter: Jakob Homan Labels: uniontype When the union type was introduced, full support for it wasn't provided. For instance, when working with a union that gets passed to LazyBinarySerde: {noformat}Caused by: java.lang.RuntimeException: Unrecognized type: UNION at org.apache.hadoop.hive.serde2.lazybinary.LazyBinarySerDe.serialize(LazyBinarySerDe.java:468) at org.apache.hadoop.hive.serde2.lazybinary.LazyBinarySerDe.serializeStruct(LazyBinarySerDe.java:230) at org.apache.hadoop.hive.serde2.lazybinary.LazyBinarySerDe.serialize(LazyBinarySerDe.java:184) {noformat} -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
Jenkins build is back to normal : Hive-0.9.1-SNAPSHOT-h0.21 #381
See https://builds.apache.org/job/Hive-0.9.1-SNAPSHOT-h0.21/381/
[jira] [Commented] (HIVE-4496) JDBC2 won't compile with JDK7
[ https://issues.apache.org/jira/browse/HIVE-4496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13665808#comment-13665808 ] Xuefu Zhang commented on HIVE-4496: --- I think the code base has changed such that applying this patch doesn't compiler any more. There is a javadoc warning failing the build. The patch might need an update. Thanks. [javadoc] Standard Doclet version 1.7.0_21 [javadoc] Building tree for all the packages and classes... [javadoc] /home/xzhang/apache/hive-nochange/hcatalog/storage-handlers/hbase/src/java/org/apache/hcatalog/hbase/snapshot/RevisionManagerFactory.java:81: warning - @return tag has no arguments. [javadoc] Building index for all the packages and classes... [javadoc] Building index for all classes... [javadoc] Generating /home/xzhang/apache/hive-nochange/hcatalog/build/docs/api/help-doc.html... [javadoc] 2 warnings BUILD FAILED /home/xzhang/apache/hive-nochange/build.xml:520: The following error occurred while executing this line: /home/xzhang/apache/hive-nochange/hcatalog/build.xml:246: Javadoc comments contain warnings. JDBC2 won't compile with JDK7 - Key: HIVE-4496 URL: https://issues.apache.org/jira/browse/HIVE-4496 Project: Hive Issue Type: Bug Components: JDBC Affects Versions: 0.12.0 Reporter: Chris Drome Assignee: Chris Drome Fix For: 0.12.0 Attachments: HIVE-4496.patch HiveServer2 related JDBC does not compile with JDK7. Related to HIVE-3384. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4257) java.sql.SQLNonTransientConnectionException on JDBCStatsAggregator
[ https://issues.apache.org/jira/browse/HIVE-4257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13665818#comment-13665818 ] Navis commented on HIVE-4257: - Build failed with various exceptions, {noformat} [junit] Caused by: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.metastore.HiveMetaStoreClient [junit] at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1212) [junit] at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.init(RetryingMetaStoreClient.java:51) [junit] at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:61) [junit] at org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.java:2286) [junit] at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:2297) [junit] at org.apache.hadoop.hive.ql.metadata.Hive.dropTable(Hive.java:868) [junit] ... 8 more [junit] Caused by: java.lang.reflect.InvocationTargetException [junit] at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) [junit] at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39) [junit] at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27) [junit] at java.lang.reflect.Constructor.newInstance(Constructor.java:513) [junit] at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1210) [junit] ... 13 more [junit] Caused by: javax.jdo.JDOFatalInternalException: Error creating transactional connection factory [junit] NestedThrowables: [junit] java.lang.reflect.InvocationTargetException [junit] at org.datanucleus.jdo.NucleusJDOHelper.getJDOExceptionForNucleusException(NucleusJDOHelper.java:425) [junit] at org.datanucleus.jdo.JDOPersistenceManagerFactory.freezeConfiguration(JDOPersistenceManagerFactory.java:601) [junit] at org.datanucleus.jdo.JDOPersistenceManagerFactory.createPersistenceManagerFactory(JDOPersistenceManagerFactory.java:286) [junit] at org.datanucleus.jdo.JDOPersistenceManagerFactory.getPersistenceManagerFactory(JDOPersistenceManagerFactory.java:182) [junit] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [junit] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) [junit] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) [junit] at java.lang.reflect.Method.invoke(Method.java:597) [junit] at javax.jdo.JDOHelper$16.run(JDOHelper.java:1958) [junit] at java.security.AccessController.doPrivileged(Native Method) [junit] at javax.jdo.JDOHelper.invoke(JDOHelper.java:1953) [junit] at javax.jdo.JDOHelper.invokeGetPersistenceManagerFactoryOnImplementation(JDOHelper.java:1159) [junit] at javax.jdo.JDOHelper.getPersistenceManagerFactory(JDOHelper.java:803) [junit] at javax.jdo.JDOHelper.getPersistenceManagerFactory(JDOHelper.java:698) [junit] at org.apache.hadoop.hive.metastore.ObjectStore.getPMF(ObjectStore.java:263) [junit] at org.apache.hadoop.hive.metastore.ObjectStore.getPersistenceManager(ObjectStore.java:292) [junit] at org.apache.hadoop.hive.metastore.ObjectStore.initialize(ObjectStore.java:225) [junit] at org.apache.hadoop.hive.metastore.ObjectStore.setConf(ObjectStore.java:200) [junit] at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:62) [junit] at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117) [junit] at org.apache.hadoop.hive.metastore.RetryingRawStore.init(RetryingRawStore.java:62) [junit] at org.apache.hadoop.hive.metastore.RetryingRawStore.getProxy(RetryingRawStore.java:71) [junit] at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.newRawStore(HiveMetaStore.java:414) [junit] at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.getMS(HiveMetaStore.java:402) [junit] at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.createDefaultDB(HiveMetaStore.java:440) [junit] at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.init(HiveMetaStore.java:326) [junit] at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.init(HiveMetaStore.java:286) [junit] at org.apache.hadoop.hive.metastore.RetryingHMSHandler.init(RetryingHMSHandler.java:53) [junit] at org.apache.hadoop.hive.metastore.RetryingHMSHandler.getProxy(RetryingHMSHandler.java:58) [junit] at org.apache.hadoop.hive.metastore.HiveMetaStore.newHMSHandler(HiveMetaStore.java:4183) [junit] at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.init(HiveMetaStoreClient.java:121)
[jira] [Updated] (HIVE-4257) java.sql.SQLNonTransientConnectionException on JDBCStatsAggregator
[ https://issues.apache.org/jira/browse/HIVE-4257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navis updated HIVE-4257: Status: Open (was: Patch Available) java.sql.SQLNonTransientConnectionException on JDBCStatsAggregator -- Key: HIVE-4257 URL: https://issues.apache.org/jira/browse/HIVE-4257 Project: Hive Issue Type: Bug Components: Statistics Affects Versions: 0.11.0 Reporter: Teddy Choi Assignee: Teddy Choi Priority: Minor Attachments: HIVE-4257.1.patch.txt java.sql.SQLNonTransientConnectionException occurs on JDBCStatsAggregator after executing dozens of Hive queries periodically, which inserts thousands of rows. It may have a relation with DERBY-5098. To avoid this error, Hive should use a more recent version of Derby(10.6.2.3, 10.7.1.4, 10.8.2.2, 10.9.1.0 or later). Hive 0.11.0-SNAPSHOT uses Derby 10.4.2.0. {noformat} 2013-03-24 15:54:30,487 ERROR jdbc.JDBCStatsAggregator (JDBCStatsAggregator.java:aggregateStats(168)) - Error during publishing aggregation. java.sql.SQLNonTransientConnectionException: No current connection. 2013-03-24 15:54:30,487 ERROR jdbc.JDBCStatsAggregator (JDBCStatsAggregator.java:aggregateStats(168)) - Error during publishing aggregation. java.sql.SQLNonTransientConnectionException: No current connection. 2013-03-24 15:54:30,487 ERROR jdbc.JDBCStatsAggregator (JDBCStatsAggregator.java:cleanUp(249)) - Error during publishing aggregation. java.sql.SQLNonTransientConnectionException: No current connection. {noformat} -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4496) JDBC2 won't compile with JDK7
[ https://issues.apache.org/jira/browse/HIVE-4496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13665824#comment-13665824 ] Chris Drome commented on HIVE-4496: --- [~xuefuz] I don't think the problem is with the patch. RevisionManagerFactory.java:81 generates the javadoc warning. This file is not part of this patch, it was imported as part of HIVE-4264. BTW, I just finished patching trunk and running ant tar, which completed successfully. JDBC2 won't compile with JDK7 - Key: HIVE-4496 URL: https://issues.apache.org/jira/browse/HIVE-4496 Project: Hive Issue Type: Bug Components: JDBC Affects Versions: 0.12.0 Reporter: Chris Drome Assignee: Chris Drome Fix For: 0.12.0 Attachments: HIVE-4496.patch HiveServer2 related JDBC does not compile with JDK7. Related to HIVE-3384. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HIVE-4601) WebHCat, Templeton need to support proxy users
Dilli Arumugam created HIVE-4601: Summary: WebHCat, Templeton need to support proxy users Key: HIVE-4601 URL: https://issues.apache.org/jira/browse/HIVE-4601 Project: Hive Issue Type: Improvement Components: HCatalog Reporter: Dilli Arumugam We have a use case where a Gateway would provide unified and controlled access to secure hadoop cluster. The Gateway itself would authenticate to secure WebHDFS, Oozie and Templeton with SPNego. The Gateway would authenticate the end user with http basic and would assert the end user identity as douser argument in the calls to downstream WebHDFS, Oozie and Templeton. This works fine with WebHDFS and Oozie. But, does not work for Templeton as Templeton does not support proxy users. Hence, request to add this improvement to Templeton. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HIVE-4602) Enable running all hive e2e tests under vectorization
Tony Murphy created HIVE-4602: - Summary: Enable running all hive e2e tests under vectorization Key: HIVE-4602 URL: https://issues.apache.org/jira/browse/HIVE-4602 Project: Hive Issue Type: Sub-task Affects Versions: vectorization-branch Reporter: Tony Murphy Assignee: Tony Murphy Fix For: vectorization-branch -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4602) Enable running all hive e2e tests under vectorization
[ https://issues.apache.org/jira/browse/HIVE-4602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tony Murphy updated HIVE-4602: -- Attachment: HIVE-4602.patch Enables running tests under vectorization when -Dtest.vectorization.enabled=true is specified Enable running all hive e2e tests under vectorization - Key: HIVE-4602 URL: https://issues.apache.org/jira/browse/HIVE-4602 Project: Hive Issue Type: Sub-task Affects Versions: vectorization-branch Reporter: Tony Murphy Assignee: Tony Murphy Fix For: vectorization-branch Attachments: HIVE-4602.patch -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4602) Enable running all hive e2e tests under vectorization
[ https://issues.apache.org/jira/browse/HIVE-4602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tony Murphy updated HIVE-4602: -- Status: Patch Available (was: Open) Enable running all hive e2e tests under vectorization - Key: HIVE-4602 URL: https://issues.apache.org/jira/browse/HIVE-4602 Project: Hive Issue Type: Sub-task Affects Versions: vectorization-branch Reporter: Tony Murphy Assignee: Tony Murphy Fix For: vectorization-branch Attachments: HIVE-4602.patch -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4592) ColumnArithmeticColumn.txt template never sets output isNull to true; can give wrong results
[ https://issues.apache.org/jira/browse/HIVE-4592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13665855#comment-13665855 ] Eric Hanson commented on HIVE-4592: --- Another issue is that output Long column vectors should have 1 in the data vector, and output Double column vectors should have NaN in the data vector. Adding tests and fixes for this. ColumnArithmeticColumn.txt template never sets output isNull to true; can give wrong results Key: HIVE-4592 URL: https://issues.apache.org/jira/browse/HIVE-4592 Project: Hive Issue Type: Sub-task Affects Versions: vectorization-branch Reporter: Eric Hanson Assignee: Eric Hanson Fix For: vectorization-branch Attachments: HIVE-4592.1.patch ColumnArithmeticColumn.txt should set the output column's noNulls flag to true if neither input column has nulls, but it does not do that. This can lead to wrong results is the noNulls was set to false in a previous use of the batch. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4496) JDBC2 won't compile with JDK7
[ https://issues.apache.org/jira/browse/HIVE-4496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13665864#comment-13665864 ] Xuefu Zhang commented on HIVE-4496: --- [~cdrome] I guess it's right: the warning has nothing to do with your patch. I did ant tar, but it also stopped due to the warning. Not sure why. Anyway, is there a plan to check this patch in? JDBC2 won't compile with JDK7 - Key: HIVE-4496 URL: https://issues.apache.org/jira/browse/HIVE-4496 Project: Hive Issue Type: Bug Components: JDBC Affects Versions: 0.12.0 Reporter: Chris Drome Assignee: Chris Drome Fix For: 0.12.0 Attachments: HIVE-4496.patch HiveServer2 related JDBC does not compile with JDK7. Related to HIVE-3384. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4592) ColumnArithmeticColumn.txt template never sets output isNull to true; can give wrong results
[ https://issues.apache.org/jira/browse/HIVE-4592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13665934#comment-13665934 ] Eric Hanson commented on HIVE-4592: --- Completed review and update of Col-Col, Col-Scalar, and Scalar-Col arithmetic templates. Verified isRepeating and noNulls propagation from input(s)to output column. Made sure that NULL values have their data entry set properly in the output data vector as well, based on the spec (1 for long, NaN for double). ColumnArithmeticColumn.txt template never sets output isNull to true; can give wrong results Key: HIVE-4592 URL: https://issues.apache.org/jira/browse/HIVE-4592 Project: Hive Issue Type: Sub-task Affects Versions: vectorization-branch Reporter: Eric Hanson Assignee: Eric Hanson Fix For: vectorization-branch Attachments: HIVE-4592.1.patch ColumnArithmeticColumn.txt should set the output column's noNulls flag to true if neither input column has nulls, but it does not do that. This can lead to wrong results is the noNulls was set to false in a previous use of the batch. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4592) ColumnArithmeticColumn.txt template never sets output isNull to true; can give wrong results
[ https://issues.apache.org/jira/browse/HIVE-4592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Hanson updated HIVE-4592: -- Attachment: HIVE-4592.3.patch ColumnArithmeticColumn.txt template never sets output isNull to true; can give wrong results Key: HIVE-4592 URL: https://issues.apache.org/jira/browse/HIVE-4592 Project: Hive Issue Type: Sub-task Affects Versions: vectorization-branch Reporter: Eric Hanson Assignee: Eric Hanson Fix For: vectorization-branch Attachments: HIVE-4592.1.patch, HIVE-4592.3.patch ColumnArithmeticColumn.txt should set the output column's noNulls flag to true if neither input column has nulls, but it does not do that. This can lead to wrong results is the noNulls was set to false in a previous use of the batch. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4592) ColumnArithmeticColumn.txt template never sets output isNull to true; can give wrong results
[ https://issues.apache.org/jira/browse/HIVE-4592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Hanson updated HIVE-4592: -- Status: Patch Available (was: In Progress) ColumnArithmeticColumn.txt template never sets output isNull to true; can give wrong results Key: HIVE-4592 URL: https://issues.apache.org/jira/browse/HIVE-4592 Project: Hive Issue Type: Sub-task Affects Versions: vectorization-branch Reporter: Eric Hanson Assignee: Eric Hanson Fix For: vectorization-branch Attachments: HIVE-4592.1.patch, HIVE-4592.3.patch ColumnArithmeticColumn.txt should set the output column's noNulls flag to true if neither input column has nulls, but it does not do that. This can lead to wrong results is the noNulls was set to false in a previous use of the batch. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
Hive-trunk-h0.21 - Build # 2115 - Still Failing
Changes for Build #2089 [cws] HIVE-3957. Add pseudo-BNF grammar for RCFile to Javadoc (Mark Grover via cws) [cws] HIVE-4497. beeline module tests don't get run by default (Thejas Nair via cws) [gangtimliu] HIVE-4474: Column access not tracked properly for partitioned tables. Samuel Yuan via Gang Tim Liu [hashutosh] HIVE-4455 : HCatalog build directories get included in tar file produced by ant tar (Alan Gates via Ashutosh Chauhan) Changes for Build #2090 Changes for Build #2091 [hashutosh] HIVE-4392 : Illogical InvalidObjectException throwed when use mulit aggregate functions with star columns (Navis via Ashutosh Chauhan) [hashutosh] HIVE-4421 : Improve memory usage by ORC dictionaries (Owen Omalley via Ashutosh Chauhan) [mithun] HCATALOG-627 - Adding thread-safety to NotificationListener. (amalakar via mithun) Changes for Build #2092 [hashutosh] HIVE-4466 : Fix continue.on.failure in unit tests to -well- continue on failure in unit tests (Gunther Hagleitner via Ashutosh Chauhan) [hashutosh] HIVE-4471 : Build fails with hcatalog checkstyle error (Gunther Hagleitner via Ashutosh Chauhan) Changes for Build #2093 [omalley] HIVE-4494 ORC map columns get class cast exception in some contexts (omalley) [omalley] HIVE-4500 Ensure that HiveServer 2 closes log files. (Alan Gates via omalley) Changes for Build #2094 [navis] HIVE-4209 Cache evaluation result of deterministic expression and reuse it (Navis via namit) Changes for Build #2095 Changes for Build #2096 Changes for Build #2097 [cws] HIVE-4530. Enforce minmum ant version required in build script (Arup Malakar via cws) [omalley] Preparing RELEASE_NOTES for Hive 0.11.0rc2. Changes for Build #2098 [omalley] Update release notes for 0.11.0rc2 [omalley] HIVE-4527 Fix eclipse project template (Carl Steinbach via omalley) [omalley] HIVE-4505 Hive can't load transforms with remote scripts. (Prasad Majumdar and Gunther Hagleitner via omalley) [omalley] HIVE-4498 TestBeeLineWithArgs.testPositiveScriptFile fails (Thejas Nair via omalley) Changes for Build #2099 Changes for Build #2100 Changes for Build #2101 Changes for Build #2102 Changes for Build #2103 [daijy] PIG-2955: Fix bunch of Pig e2e tests on Windows Changes for Build #2104 [daijy] PIG-3069: Native Windows Compatibility for Pig E2E Tests and Harness Changes for Build #2105 [omalley] HIVE-4550 local_mapred_error_cache fails on some hadoop versions (Gunther Hagleitner via omalley) [omalley] HIVE-4440 SMB Operator spills to disk like it's 1999 (Gunther Hagleitner via omalley) Changes for Build #2106 Changes for Build #2107 [omalley] HIVE-4486 FetchOperator slows down SMB map joins by 50% when there are many partitions (Gopal V via omalley) Changes for Build #2108 Changes for Build #2109 Changes for Build #2110 Changes for Build #2111 [omalley] HIVE-4475 Switch RCFile default to LazyBinaryColumnarSerDe. (Guther Hagleitner via omalley) [omalley] HIVE-4521 Auto join conversion fails in certain cases (Gunther Hagleitner via omalley) Changes for Build #2112 Changes for Build #2113 [gates] HIVE-4578 Changes to Pig's test harness broke HCat e2e tests (gates) Changes for Build #2114 [gates] HIVE-4581 HCat e2e tests broken by changes to Hive's describe table formatting (gates) Changes for Build #2115 All tests passed The Apache Jenkins build system has built Hive-trunk-h0.21 (build #2115) Status: Still Failing Check console output at https://builds.apache.org/job/Hive-trunk-h0.21/2115/ to view the results.
[jira] [Created] (HIVE-4603) VectorSelectOperator projections change the index of columns for subsequent operators.
Jitendra Nath Pandey created HIVE-4603: -- Summary: VectorSelectOperator projections change the index of columns for subsequent operators. Key: HIVE-4603 URL: https://issues.apache.org/jira/browse/HIVE-4603 Project: Hive Issue Type: Sub-task Reporter: Jitendra Nath Pandey Assignee: Jitendra Nath Pandey -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4603) VectorSelectOperator projections change the index of columns for subsequent operators.
[ https://issues.apache.org/jira/browse/HIVE-4603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey updated HIVE-4603: --- Attachment: HIVE-4603.1.patch Initial patch, the unit test needs to be fixed. I will upload another patch. VectorSelectOperator projections change the index of columns for subsequent operators. -- Key: HIVE-4603 URL: https://issues.apache.org/jira/browse/HIVE-4603 Project: Hive Issue Type: Sub-task Reporter: Jitendra Nath Pandey Assignee: Jitendra Nath Pandey Attachments: HIVE-4603.1.patch -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira