[jira] [Commented] (HIVE-2577) Expose the HiveConf in HiveConnection API
[ https://issues.apache.org/jira/browse/HIVE-2577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13236462#comment-13236462 ] Hudson commented on HIVE-2577: -- Integrated in Hive-trunk-h0.21 #1327 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1327/]) HIVE-2577: Expose the HiveConf in HiveConnection API (Nicolas Lalevee via Ashutosh Chauhan) (Revision 1304068) Result = ABORTED hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1304068 Files : * /hive/trunk/jdbc/src/java/org/apache/hadoop/hive/jdbc/HiveConnection.java Expose the HiveConf in HiveConnection API - Key: HIVE-2577 URL: https://issues.apache.org/jira/browse/HIVE-2577 Project: Hive Issue Type: Improvement Affects Versions: 0.8.0 Reporter: Nicolas Lalevée Assignee: Nicolas Lalevée Fix For: 0.9.0 Attachments: HIVE-2577-r1201637.patch When running the jdbc code in a local mode, there no way to programatically manage the hive conf. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-1853) downgrade JDO version
[ https://issues.apache.org/jira/browse/HIVE-1853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13236476#comment-13236476 ] Andy Jefferson commented on HIVE-1853: -- Since the bug is within the newer version JDO/datanucleus Why not reference what this bug was in DataNucleus JIRA ? that way someone at that side can understand what this refers to. Or maybe it was never reported to DataNucleus? downgrade JDO version - Key: HIVE-1853 URL: https://issues.apache.org/jira/browse/HIVE-1853 Project: Hive Issue Type: Bug Affects Versions: 0.7.0 Reporter: Namit Jain Assignee: Paul Yang Fix For: 0.7.0 Attachments: HIVE-1853.1.patch, HIVE-1853.2.patch After HIVE-1609, we are seeing some table not found errors intermittently. We have a test case where 5 processes are concurrently issueing the same query - explain extended insert .. select from T and once in a while, we get a error T not found - When we revert back the JDO version, the error is gone. We can investigate later to find the JDO bug, but for now this is a show-stopper for facebook, and needs to be reverted back immediately. This also means, that the filters will not be pushed to mysql. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-1721) use bloom filters to improve the performance of joins
[ https://issues.apache.org/jira/browse/HIVE-1721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13236611#comment-13236611 ] Srinivasan Sembakkam Rajivelu commented on HIVE-1721: - @Namit, Could you please assign this ticket for me. Can I take it for GSOC 2012. use bloom filters to improve the performance of joins - Key: HIVE-1721 URL: https://issues.apache.org/jira/browse/HIVE-1721 Project: Hive Issue Type: New Feature Components: Query Processor Reporter: Namit Jain Labels: gsoc, gsoc2012, optimization In case of map-joins, it is likely that the big table will not find many matching rows from the small table. Currently, we perform a hash-map lookup for every row in the big table, which can be pretty expensive. It might be useful to try out a bloom-filter containing all the elements in the small table. Each element from the big table is first searched in the bloom filter, and only in case of a positive match, the small table hash table is explored. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2879) Add rat target to build to look for missing license headers
[ https://issues.apache.org/jira/browse/HIVE-2879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-2879: Status: Patch Available (was: Open) Unsurprisingly, tests pass. Add rat target to build to look for missing license headers - Key: HIVE-2879 URL: https://issues.apache.org/jira/browse/HIVE-2879 Project: Hive Issue Type: Improvement Components: Build Infrastructure Reporter: Owen O'Malley Assignee: Owen O'Malley Attachments: HIVE-2879.D2373.1.patch We should have a rat target that can generate an Apache RAT report. RAT is used for finding missing license headers. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HIVE-2898) Add nicer helper functions for adding and reading metadata from RCFiles
Add nicer helper functions for adding and reading metadata from RCFiles --- Key: HIVE-2898 URL: https://issues.apache.org/jira/browse/HIVE-2898 Project: Hive Issue Type: New Feature Components: Serializers/Deserializers Reporter: Owen O'Malley Assignee: Owen O'Malley Currently, to use the metadata in RCFile, you need to manipulate it using SequenceFile.Metadata. I'd like to add two helper functions that make it more convenient. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2558) Timestamp comparisons don't work
[
https://issues.apache.org/jira/browse/HIVE-2558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13236736#comment-13236736
]
Michael Ubell commented on HIVE-2558:
-
In the query:
select * from rrt where r = '1970-01-01 00:00:01';
you say that the problem is that the field is treated as a string not as a time
stamp but if it is treated as a string then either there should be a proper
conversion of the string to timestamp (or vice versa) to do the compare or an
error should be raised, you cannot just compare the bytes (or what ever hive is
doing) and return an invalid answer.
The first query:
select * from rrt where r in ('1970-01-01 00:00:01');
does the right thing:
FAILED: Error in semantic analysis: Line 1:26 Wrong arguments ''1970-01-01
00:00:01'': The arguments for IN should be the same type! Types are: {timestamp
IN (string)}
Timestamp comparisons don't work
Key: HIVE-2558
URL: https://issues.apache.org/jira/browse/HIVE-2558
Project: Hive
Issue Type: Bug
Reporter: Robert Surówka
I may be missing something, but:
After performing:
create table rrt (r timestamp);
insert into table rrt select '1970-01-01 00:00:01' from src limit 1;
Following queries give undesirable results:
select * from rrt where r in ('1970-01-01 00:00:01');
select * from rrt where r in (0);
select * from rrt where r = 0;
select * from rrt where r = '1970-01-01 00:00:01';
At least for the first two, the reason may be the lack of timestamp in
numericTypes Map from FunctionRegistry.java (591) . Yet whether we really
want to have a linear hierarchy of primitive types in the end, is another
question.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2898) Add nicer helper functions for adding and reading metadata from RCFiles
[ https://issues.apache.org/jira/browse/HIVE-2898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phabricator updated HIVE-2898: -- Attachment: HIVE-2898.D2433.1.patch omalley requested code review of HIVE-2898 [jira] Add nicer helper functions for adding and reading metadata from RCFiles. Reviewers: JIRA hive-2898 add helper functions for RCFile metadata Currently, to use the metadata in RCFile, you need to manipulate it using SequenceFile.Metadata. I'd like to add two helper functions that make it more convenient. TEST PLAN add tests to test the new function calls REVISION DETAIL https://reviews.facebook.net/D2433 AFFECTED FILES ql/src/java/org/apache/hadoop/hive/ql/io/RCFile.java ql/src/test/org/apache/hadoop/hive/ql/io/TestRCFile.java MANAGE HERALD DIFFERENTIAL RULES https://reviews.facebook.net/herald/view/differential/ WHY DID I GET THIS EMAIL? https://reviews.facebook.net/herald/transcript/5469/ Tip: use the X-Herald-Rules header to filter Herald messages in your client. Add nicer helper functions for adding and reading metadata from RCFiles --- Key: HIVE-2898 URL: https://issues.apache.org/jira/browse/HIVE-2898 Project: Hive Issue Type: New Feature Components: Serializers/Deserializers Reporter: Owen O'Malley Assignee: Owen O'Malley Attachments: HIVE-2898.D2433.1.patch Currently, to use the metadata in RCFile, you need to manipulate it using SequenceFile.Metadata. I'd like to add two helper functions that make it more convenient. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2898) Add nicer helper functions for adding and reading metadata from RCFiles
[ https://issues.apache.org/jira/browse/HIVE-2898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phabricator updated HIVE-2898: -- Attachment: HIVE-2898.D2439.1.patch omalley requested code review of HIVE-2898 [jira] Add nicer helper functions for adding and reading metadata from RCFiles. Reviewers: JIRA Enter Revision Title fixed syntax error in test code Currently, to use the metadata in RCFile, you need to manipulate it using SequenceFile.Metadata. I'd like to add two helper functions that make it more convenient. TEST PLAN EMPTY REVISION DETAIL https://reviews.facebook.net/D2439 AFFECTED FILES ql/src/test/org/apache/hadoop/hive/ql/io/TestRCFile.java MANAGE HERALD DIFFERENTIAL RULES https://reviews.facebook.net/herald/view/differential/ WHY DID I GET THIS EMAIL? https://reviews.facebook.net/herald/transcript/5475/ Tip: use the X-Herald-Rules header to filter Herald messages in your client. Add nicer helper functions for adding and reading metadata from RCFiles --- Key: HIVE-2898 URL: https://issues.apache.org/jira/browse/HIVE-2898 Project: Hive Issue Type: New Feature Components: Serializers/Deserializers Reporter: Owen O'Malley Assignee: Owen O'Malley Attachments: HIVE-2898.D2433.1.patch, HIVE-2898.D2439.1.patch Currently, to use the metadata in RCFile, you need to manipulate it using SequenceFile.Metadata. I'd like to add two helper functions that make it more convenient. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2773) HiveStorageHandler.configureTableJobProperites() should let the handler know wether it is configuration for input or output
[ https://issues.apache.org/jira/browse/HIVE-2773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13236772#comment-13236772 ] Hudson commented on HIVE-2773: -- Integrated in Hive-trunk-h0.21 #1328 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1328/]) HIVE-2773: HiveStorageHandler.configureTableJobProperites() should let the handler know wether it is configuration for input or output (Francis Liu via Ashutosh Chauhan) (Revision 1304167) Result = ABORTED hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1304167 Files : * /hive/trunk/hbase-handler/src/java/org/apache/hadoop/hive/hbase/HBaseStorageHandler.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/FileSinkOperator.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/metadata/DefaultStorageHandler.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/metadata/HiveStorageHandler.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/MapredLocalWork.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/PartitionDesc.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/PlanUtils.java HiveStorageHandler.configureTableJobProperites() should let the handler know wether it is configuration for input or output --- Key: HIVE-2773 URL: https://issues.apache.org/jira/browse/HIVE-2773 Project: Hive Issue Type: Improvement Reporter: Francis Liu Assignee: Francis Liu Labels: hcatalog, storage_handler Fix For: 0.9.0 Attachments: HIVE-2773.D1815.1.patch, HIVE-2773.D2007.1.patch, HIVE-2773.D2415.1.patch, HIVE-2773.patch HiveStorageHandler.configureTableJobProperties() is called to allow the storage handler to setup any properties that the underlying inputformat/outputformat/serde may need. But the handler implementation does not know whether it is being called for configuring input or output. This makes it a problem for handlers which sets an external state. In the case of HCatalog's HBase storageHandler, whenever a write needs to be configured we create a write transaction which needs to be committed or aborted later on. In this case configuring for both input and output each time configureTableJobProperties() is called would not be desirable. This has become an issue since HCatalog is dropping storageDrivers for SerDe and StorageHandler (see HCATALOG-237). My proposal is to replace configureTableJobProperties() with two methods: configureInputJobProperties() configureOutputJobProperties() Each method will have the same signature. I cursory look at the code and I believe changes should be straighforward also given that we are not really changing anything just splitting responsibility. If the community is fine with this approach I will go ahead and create a aptch. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2898) Add nicer helper functions for adding and reading metadata from RCFiles
[ https://issues.apache.org/jira/browse/HIVE-2898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13236776#comment-13236776 ] Phabricator commented on HIVE-2898: --- omalley has abandoned the revision HIVE-2898 [jira] Add nicer helper functions for adding and reading metadata from RCFiles. This should have merged with the previous one. REVISION DETAIL https://reviews.facebook.net/D2439 Add nicer helper functions for adding and reading metadata from RCFiles --- Key: HIVE-2898 URL: https://issues.apache.org/jira/browse/HIVE-2898 Project: Hive Issue Type: New Feature Components: Serializers/Deserializers Reporter: Owen O'Malley Assignee: Owen O'Malley Attachments: HIVE-2898.D2433.1.patch, HIVE-2898.D2439.1.patch Currently, to use the metadata in RCFile, you need to manipulate it using SequenceFile.Metadata. I'd like to add two helper functions that make it more convenient. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2898) Add nicer helper functions for adding and reading metadata from RCFiles
[ https://issues.apache.org/jira/browse/HIVE-2898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phabricator updated HIVE-2898: -- Attachment: HIVE-2898.D2433.2.patch omalley updated the revision HIVE-2898 [jira] Add nicer helper functions for adding and reading metadata from RCFiles. Reviewers: JIRA fixed syntax error in test REVISION DETAIL https://reviews.facebook.net/D2433 AFFECTED FILES ql/src/java/org/apache/hadoop/hive/ql/io/RCFile.java ql/src/test/org/apache/hadoop/hive/ql/io/TestRCFile.java Add nicer helper functions for adding and reading metadata from RCFiles --- Key: HIVE-2898 URL: https://issues.apache.org/jira/browse/HIVE-2898 Project: Hive Issue Type: New Feature Components: Serializers/Deserializers Reporter: Owen O'Malley Assignee: Owen O'Malley Attachments: HIVE-2898.D2433.1.patch, HIVE-2898.D2433.2.patch, HIVE-2898.D2439.1.patch Currently, to use the metadata in RCFile, you need to manipulate it using SequenceFile.Metadata. I'd like to add two helper functions that make it more convenient. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
Hive-trunk-h0.21 - Build # 1329 - Failure
Changes for Build #1326 [hashutosh] HIVE-2819 : Closed range scans on hbase keys : Reviewed by Carl Steinbach (hashutosh) Changes for Build #1327 [hashutosh] HIVE-2577: Expose the HiveConf in HiveConnection API (Nicolas Lalevee via Ashutosh Chauhan) Changes for Build #1328 [hashutosh] HIVE-2773: HiveStorageHandler.configureTableJobProperites() should let the handler know wether it is configuration for input or output (Francis Liu via Ashutosh Chauhan) Changes for Build #1329 1 tests failed. REGRESSION: org.apache.hadoop.hive.thrift.TestHadoop20SAuthBridge.testSaslWithHiveMetaStore Error Message: Connection refused Stack Trace: java.net.ConnectException: Connection refused at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:351) at java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:211) at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:200) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366) at java.net.Socket.connect(Socket.java:529) at org.apache.hadoop.hive.metastore.MetaStoreUtils.loopUntilHMSReady(MetaStoreUtils.java:760) at org.apache.hadoop.hive.metastore.MetaStoreUtils.startMetaStore(MetaStoreUtils.java:748) at org.apache.hadoop.hive.thrift.TestHadoop20SAuthBridge.setup(TestHadoop20SAuthBridge.java:129) at org.apache.hadoop.hive.thrift.TestHadoop20SAuthBridge.testSaslWithHiveMetaStore(TestHadoop20SAuthBridge.java:210) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at junit.framework.TestCase.runTest(TestCase.java:168) at junit.framework.TestCase.runBare(TestCase.java:134) at junit.framework.TestResult$1.protect(TestResult.java:110) at junit.framework.TestResult.runProtected(TestResult.java:128) at junit.framework.TestResult.run(TestResult.java:113) at junit.framework.TestCase.run(TestCase.java:124) at junit.framework.TestSuite.runTest(TestSuite.java:243) at junit.framework.TestSuite.run(TestSuite.java:238) at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:518) at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:1052) at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:906) The Apache Jenkins build system has built Hive-trunk-h0.21 (build #1329) Status: Failure Check console output at https://builds.apache.org/job/Hive-trunk-h0.21/1329/ to view the results.
[jira] [Updated] (HIVE-2898) Add nicer helper functions for adding and reading metadata from RCFiles
[ https://issues.apache.org/jira/browse/HIVE-2898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phabricator updated HIVE-2898: -- Attachment: HIVE-2898.D2433.3.patch omalley updated the revision HIVE-2898 [jira] Add nicer helper functions for adding and reading metadata from RCFiles. Reviewers: JIRA fixed a merge problem REVISION DETAIL https://reviews.facebook.net/D2433 AFFECTED FILES ql/src/java/org/apache/hadoop/hive/ql/io/RCFile.java ql/src/test/org/apache/hadoop/hive/ql/io/TestRCFile.java Add nicer helper functions for adding and reading metadata from RCFiles --- Key: HIVE-2898 URL: https://issues.apache.org/jira/browse/HIVE-2898 Project: Hive Issue Type: New Feature Components: Serializers/Deserializers Reporter: Owen O'Malley Assignee: Owen O'Malley Attachments: HIVE-2898.D2433.1.patch, HIVE-2898.D2433.2.patch, HIVE-2898.D2433.3.patch, HIVE-2898.D2439.1.patch Currently, to use the metadata in RCFile, you need to manipulate it using SequenceFile.Metadata. I'd like to add two helper functions that make it more convenient. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2856) Fix TestCliDriver escape1.q failure on MR2
[ https://issues.apache.org/jira/browse/HIVE-2856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenxiao Luo updated HIVE-2856: --- Attachment: HIVE-2794.1.patch.txt Fix TestCliDriver escape1.q failure on MR2 -- Key: HIVE-2856 URL: https://issues.apache.org/jira/browse/HIVE-2856 Project: Hive Issue Type: Bug Components: Query Processor, Tests Affects Versions: 0.8.0 Reporter: Zhenxiao Luo Assignee: Zhenxiao Luo Fix For: 0.9.0 Attachments: HIVE-2794.1.patch.txt, HIVE-2856.1.patch.txt, HIVE-2856.2.patch.txt, escape1.q.out, escape1.q.out, escape2.q.out Additional '^' in escape test: [junit] Begin query: escape1.q [junit] Copying file: file:/home/cloudera/Code/hive/data/files/escapetest.txt [junit] 12/01/23 15:22:15 WARN conf.Configuration: mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir [junit] 12/01/23 15:22:15 WARN conf.Configuration: mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir [junit] diff -a -I file: -I pfile: -I hdfs: -I /tmp/ -I invalidscheme: -I lastUpdateTime -I lastAccessTime -I [Oo]wner -I CreateTime -I LastAccessTime -I Location -I LOCATION ' -I transient_lastDdlTime -I last_modified_ -I java.lang.RuntimeException -I at org -I at sun -I at java -I at junit -I Caused by: -I LOCK_QUERYID: -I LOCK_TIME: -I grantTime -I [.][.][.] [0-9]* more -I job_[0-9]*_[0-9]* -I USING 'java -cp /home/cloudera/Code/hive/build/ql/test/logs/clientpositive/escape1.q.out /home/cloudera/Code/hive/ql/src/test/results/clientpositive/escape1.q.out [junit] 893d892 [junit] 1 1 ^ [junit] junit.framework.AssertionFailedError: Client execution results failed with error code = 1 [junit] See build/ql/tmp/hive.log, or try ant test ... -Dtest.silent=false to get more logs. [junit] at junit.framework.Assert.fail(Assert.java:50) [junit] at org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_escape1(TestCliDriver.java:131) [junit] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [junit] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [junit] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [junit] at java.lang.reflect.Method.invoke(Method.java:616) [junit] at junit.framework.TestCase.runTest(TestCase.java:168) [junit] at junit.framework.TestCase.runBare(TestCase.java:134) [junit] at junit.framework.TestResult$1.protect(TestResult.java:110) [junit] at junit.framework.TestResult.runProtected(TestResult.java:128) [junit] at junit.framework.TestResult.run(TestResult.java:113) [junit] at junit.framework.TestCase.run(TestCase.java:124) [junit] at junit.framework.TestSuite.runTest(TestSuite.java:243) [junit] at junit.framework.TestSuite.run(TestSuite.java:238) [junit] at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:420) [junit] at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:911) [junit] at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:768) [junit] Exception: Client execution results failed with error code = 1 [junit] See build/ql/tmp/hive.log, or try ant test ... -Dtest.silent=false to get more logs. [junit] See build/ql/tmp/hive.log, or try ant test ... -Dtest.silent=false to get more logs.) -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2794) Aggregations without grouping should return NULL when applied to partitioning column of a partitionless table
[ https://issues.apache.org/jira/browse/HIVE-2794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenxiao Luo updated HIVE-2794: --- Attachment: HIVE-2794.1.patch.txt Aggregations without grouping should return NULL when applied to partitioning column of a partitionless table - Key: HIVE-2794 URL: https://issues.apache.org/jira/browse/HIVE-2794 Project: Hive Issue Type: Bug Components: Query Processor Reporter: Carl Steinbach Assignee: Zhenxiao Luo Attachments: HIVE-2794.1.patch.txt -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2794) Aggregations without grouping should return NULL when applied to partitioning column of a partitionless table
[ https://issues.apache.org/jira/browse/HIVE-2794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenxiao Luo updated HIVE-2794: --- Status: Patch Available (was: Open) Aggregations without grouping should return NULL when applied to partitioning column of a partitionless table - Key: HIVE-2794 URL: https://issues.apache.org/jira/browse/HIVE-2794 Project: Hive Issue Type: Bug Components: Query Processor Reporter: Carl Steinbach Assignee: Zhenxiao Luo Attachments: HIVE-2794.1.patch.txt -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2558) Timestamp comparisons don't work
[
https://issues.apache.org/jira/browse/HIVE-2558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13236800#comment-13236800
]
Michael Ubell commented on HIVE-2558:
-
Actually I misunderstood what hive is doing. It is converting the string to a
number and then comparing it to the timestamp:
select * from rrt where r = '28801';
OK
1970-01-01 00:00:01
While this does pass the reasonability test, I don't think its the right thing
to do. It would be much better to implicitly cast the string constant to a
timestamp.
Timestamp comparisons don't work
Key: HIVE-2558
URL: https://issues.apache.org/jira/browse/HIVE-2558
Project: Hive
Issue Type: Bug
Reporter: Robert Surówka
I may be missing something, but:
After performing:
create table rrt (r timestamp);
insert into table rrt select '1970-01-01 00:00:01' from src limit 1;
Following queries give undesirable results:
select * from rrt where r in ('1970-01-01 00:00:01');
select * from rrt where r in (0);
select * from rrt where r = 0;
select * from rrt where r = '1970-01-01 00:00:01';
At least for the first two, the reason may be the lack of timestamp in
numericTypes Map from FunctionRegistry.java (591) . Yet whether we really
want to have a linear hierarchy of primitive types in the end, is another
question.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2879) Add rat target to build to look for missing license headers
[ https://issues.apache.org/jira/browse/HIVE-2879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13236813#comment-13236813 ] Phabricator commented on HIVE-2879: --- ashutoshc has requested changes to the revision HIVE-2879 [jira] Add rat target to build to look for missing license headers. Bunch of excludes needs to be excluded. Headers in them can be tracked in separate jira. INLINE COMMENTS build.xml:810 This dir contains sources written by Hive project. This shouldn't be excluded. build.xml:812 This is also in svn. Shouldn't be excluded build.xml:813 This is also in svn. Shouldn't be excluded build.xml:820 These are metastore upgrade scripts. Shouldn't be excluded. build.xml:822 Duplication REVISION DETAIL https://reviews.facebook.net/D2373 BRANCH rat Add rat target to build to look for missing license headers - Key: HIVE-2879 URL: https://issues.apache.org/jira/browse/HIVE-2879 Project: Hive Issue Type: Improvement Components: Build Infrastructure Reporter: Owen O'Malley Assignee: Owen O'Malley Attachments: HIVE-2879.D2373.1.patch We should have a rat target that can generate an Apache RAT report. RAT is used for finding missing license headers. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2897) Remove filter operator of which all the predicates have pushed down to storage handler
[ https://issues.apache.org/jira/browse/HIVE-2897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13236821#comment-13236821 ] Ashutosh Chauhan commented on HIVE-2897: Thanks Navis for tracking this down. We should remove filter altogether once its been pushed. I am guessing this may result in changes in query plan in other *.q.out files in hbase tests, though test output itself must not change. Can you check that and update the patch if thats the case. Remove filter operator of which all the predicates have pushed down to storage handler -- Key: HIVE-2897 URL: https://issues.apache.org/jira/browse/HIVE-2897 Project: Hive Issue Type: Bug Components: Query Processor Reporter: Navis Assignee: Navis Priority: Trivial Attachments: HIVE-2897.D2427.1.patch If all the predicates have pushed down to StorageHandler in TS, it should be removed (or make empty). Might it be intentional? -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2898) Add nicer helper functions for adding and reading metadata from RCFiles
[ https://issues.apache.org/jira/browse/HIVE-2898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phabricator updated HIVE-2898: -- Attachment: HIVE-2898.D2433.4.patch omalley updated the revision HIVE-2898 [jira] Add nicer helper functions for adding and reading metadata from RCFiles. Reviewers: JIRA fixed one more mistake REVISION DETAIL https://reviews.facebook.net/D2433 AFFECTED FILES ql/src/java/org/apache/hadoop/hive/ql/io/RCFile.java ql/src/test/org/apache/hadoop/hive/ql/io/TestRCFile.java Add nicer helper functions for adding and reading metadata from RCFiles --- Key: HIVE-2898 URL: https://issues.apache.org/jira/browse/HIVE-2898 Project: Hive Issue Type: New Feature Components: Serializers/Deserializers Reporter: Owen O'Malley Assignee: Owen O'Malley Attachments: HIVE-2898.D2433.1.patch, HIVE-2898.D2433.2.patch, HIVE-2898.D2433.3.patch, HIVE-2898.D2433.4.patch, HIVE-2898.D2439.1.patch Currently, to use the metadata in RCFile, you need to manipulate it using SequenceFile.Metadata. I'd like to add two helper functions that make it more convenient. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Moved] (HIVE-2899) Remove dependency on sun's jdk.
[ https://issues.apache.org/jira/browse/HIVE-2899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley moved HADOOP-8203 to HIVE-2899: - Key: HIVE-2899 (was: HADOOP-8203) Project: Hive (was: Hadoop Common) Remove dependency on sun's jdk. --- Key: HIVE-2899 URL: https://issues.apache.org/jira/browse/HIVE-2899 Project: Hive Issue Type: Improvement Reporter: Owen O'Malley Assignee: Owen O'Malley When the signal handlers were added, they introduced a dependency on sun.misc.Signal and sun.misc.SignalHandler. We can look these classes up by reflection and avoid the warning and also provide a soft-fail for non-sun jvms. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
Hive-0.8.1-SNAPSHOT-h0.21 - Build # 231 - Fixed
Changes for Build #230 Changes for Build #231 All tests passed The Apache Jenkins build system has built Hive-0.8.1-SNAPSHOT-h0.21 (build #231) Status: Fixed Check console output at https://builds.apache.org/job/Hive-0.8.1-SNAPSHOT-h0.21/231/ to view the results.
[jira] [Commented] (HIVE-747) void type (null column) cannot be UNIONed with other type
[ https://issues.apache.org/jira/browse/HIVE-747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13237217#comment-13237217 ] Kevin Wilfong commented on HIVE-747: This is now producing wrong results. select x from (select 'a' as x from src union all select NULL as x from src)a; returns NULL for every row. void type (null column) cannot be UNIONed with other type - Key: HIVE-747 URL: https://issues.apache.org/jira/browse/HIVE-747 Project: Hive Issue Type: Bug Components: Query Processor Reporter: Ning Zhang Assignee: Ning Zhang hive select * from (select NULL from zshao_tt union all select 1 from zshao_tt)x; select * from (select NULL from zshao_tt union all select 1 from zshao_tt)x; FAILED: Error in semantic analysis: Schema of both sides of union should match: Column _c0 is of type void on first table and type int on second table -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HIVE-2900) Add target for fatjar
Add target for fatjar - Key: HIVE-2900 URL: https://issues.apache.org/jira/browse/HIVE-2900 Project: Hive Issue Type: New Feature Components: Build Infrastructure Reporter: Ashutosh Chauhan Assignee: Ashutosh Chauhan Currently, hive generates many different jars and also has slew of deps. It would be useful to bundle all these jars together for easier downstream consumption. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2900) Add target for fatjar
[ https://issues.apache.org/jira/browse/HIVE-2900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-2900: --- Fix Version/s: 0.9.0 Status: Patch Available (was: Open) Marking Patch available. Add target for fatjar - Key: HIVE-2900 URL: https://issues.apache.org/jira/browse/HIVE-2900 Project: Hive Issue Type: New Feature Components: Build Infrastructure Reporter: Ashutosh Chauhan Assignee: Ashutosh Chauhan Fix For: 0.9.0 Attachments: HIVE-2900.D2469.1.patch Currently, hive generates many different jars and also has slew of deps. It would be useful to bundle all these jars together for easier downstream consumption. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2900) Add target for fatjar
[ https://issues.apache.org/jira/browse/HIVE-2900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phabricator updated HIVE-2900: -- Attachment: HIVE-2900.D2469.1.patch ashutoshc requested code review of HIVE-2900 [jira] Add target for fatjar. Reviewers: JIRA https://issues.apache.org/jira/browse/HIVE-2900 Uses jarjar for repackaging of jars Currently, hive generates many different jars and also has slew of deps. It would be useful to bundle all these jars together for easier downstream consumption. TEST PLAN EMPTY REVISION DETAIL https://reviews.facebook.net/D2469 AFFECTED FILES build.xml ivy/libraries.properties ivy.xml MANAGE HERALD DIFFERENTIAL RULES https://reviews.facebook.net/herald/view/differential/ WHY DID I GET THIS EMAIL? https://reviews.facebook.net/herald/transcript/5541/ Tip: use the X-Herald-Rules header to filter Herald messages in your client. Add target for fatjar - Key: HIVE-2900 URL: https://issues.apache.org/jira/browse/HIVE-2900 Project: Hive Issue Type: New Feature Components: Build Infrastructure Reporter: Ashutosh Chauhan Assignee: Ashutosh Chauhan Fix For: 0.9.0 Attachments: HIVE-2900.D2469.1.patch Currently, hive generates many different jars and also has slew of deps. It would be useful to bundle all these jars together for easier downstream consumption. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2711) Make the header of RCFile unique
[ https://issues.apache.org/jira/browse/HIVE-2711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13237371#comment-13237371 ] Ashutosh Chauhan commented on HIVE-2711: @Owen, I think original design of RCFile was done with compatibility with Sequence File in mind. This patch will break that. Whats the advantage of this change? Make the header of RCFile unique Key: HIVE-2711 URL: https://issues.apache.org/jira/browse/HIVE-2711 Project: Hive Issue Type: Bug Components: Serializers/Deserializers Reporter: Owen O'Malley Assignee: Owen O'Malley Attachments: HIVE-2711.D2115.1.patch The RCFile implementation was copied from Hadoop's SequenceFile and copied the 'magic' string in the header. This means that you can't use the header to distinguish between RCFiles and SequenceFiles. I'd propose that we create a new header for RCFiles (RCF?) to replace the current SEQ. To maintain compatibility, we'll need to continue to accept the current 'SEQ\06' and just make new files contain the new header. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2894) RCFile Reader doesn't provide access to Metadata
[ https://issues.apache.org/jira/browse/HIVE-2894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13237373#comment-13237373 ] Phabricator commented on HIVE-2894: --- ashutoshc has accepted the revision HIVE-2894 [jira] RCFile Reader doesn't provide access to Metadata. +1 will commit this one soon REVISION DETAIL https://reviews.facebook.net/D2421 BRANCH h-2894 RCFile Reader doesn't provide access to Metadata Key: HIVE-2894 URL: https://issues.apache.org/jira/browse/HIVE-2894 Project: Hive Issue Type: New Feature Reporter: Owen O'Malley Assignee: Owen O'Malley Attachments: HIVE-2894.D2421.1.patch Currently the RCFile writer can add metadata to an RCFile, but the reader doesn't provide an accessor. I'd like to add one. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2879) Add rat target to build to look for missing license headers
[ https://issues.apache.org/jira/browse/HIVE-2879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-2879: --- Status: Open (was: Patch Available) Add rat target to build to look for missing license headers - Key: HIVE-2879 URL: https://issues.apache.org/jira/browse/HIVE-2879 Project: Hive Issue Type: Improvement Components: Build Infrastructure Reporter: Owen O'Malley Assignee: Owen O'Malley Attachments: HIVE-2879.D2373.1.patch We should have a rat target that can generate an Apache RAT report. RAT is used for finding missing license headers. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2894) RCFile Reader doesn't provide access to Metadata
[ https://issues.apache.org/jira/browse/HIVE-2894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-2894: --- Resolution: Fixed Fix Version/s: 0.9.0 Status: Resolved (was: Patch Available) Committed to trunk. Thanks, Owen! RCFile Reader doesn't provide access to Metadata Key: HIVE-2894 URL: https://issues.apache.org/jira/browse/HIVE-2894 Project: Hive Issue Type: New Feature Reporter: Owen O'Malley Assignee: Owen O'Malley Fix For: 0.9.0 Attachments: HIVE-2894.D2421.1.patch Currently the RCFile writer can add metadata to an RCFile, but the reader doesn't provide an accessor. I'd like to add one. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2894) RCFile Reader doesn't provide access to Metadata
[ https://issues.apache.org/jira/browse/HIVE-2894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13237378#comment-13237378 ] Phabricator commented on HIVE-2894: --- omalley has committed the revision HIVE-2894 [jira] RCFile Reader doesn't provide access to Metadata. Change committed by hashutosh. REVISION DETAIL https://reviews.facebook.net/D2421 COMMIT https://reviews.facebook.net/rHIVE1304693 RCFile Reader doesn't provide access to Metadata Key: HIVE-2894 URL: https://issues.apache.org/jira/browse/HIVE-2894 Project: Hive Issue Type: New Feature Reporter: Owen O'Malley Assignee: Owen O'Malley Fix For: 0.9.0 Attachments: HIVE-2894.D2421.1.patch Currently the RCFile writer can add metadata to an RCFile, but the reader doesn't provide an accessor. I'd like to add one. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HIVE-2901) Hive union with NULL constant and string in same column returns all null
Hive union with NULL constant and string in same column returns all null Key: HIVE-2901 URL: https://issues.apache.org/jira/browse/HIVE-2901 Project: Hive Issue Type: Bug Reporter: Kevin Wilfong Priority: Critical select x from (select value as x from src union all select NULL as x from src)a; This query produces all nulls, where value is a string column. Notably, select x from (select key as x from src union all select NULL as x from src)a; where key is a string, but can be cast to a double, the query returns correct results. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2504) Warehouse table subdirectories should inherit the group permissions of the warehouse parent directory
[ https://issues.apache.org/jira/browse/HIVE-2504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13237414#comment-13237414 ] Rohini Palaniswamy commented on HIVE-2504: -- This fix makes the table directory always have permission of 775 and does not actually inherit the group permissions of the parent directory. In most of our cases, the owner produces the data while the group permissions are meant for users reading the data. Now hive.files.umask.value always need to be set to ensure the users belonging to the group cannot write or modify the table. Can't we change the fix to set the same permissions as the parent directory and get rid of this configuration? Also it is always prudent to do fs.mkdirs() and then fs.setPermission() as setting the umask in configuration is not guaranteed to work. The DistributedFileSystem is cached and it refers to the Configuration that it was first initialized with. Warehouse table subdirectories should inherit the group permissions of the warehouse parent directory - Key: HIVE-2504 URL: https://issues.apache.org/jira/browse/HIVE-2504 Project: Hive Issue Type: Bug Components: Metastore Reporter: Carl Steinbach Assignee: Chinna Rao Lalam Fix For: 0.9.0 Attachments: HIVE-2504.patch When the Hive Metastore creates a subdirectory in the Hive warehouse for a new table it does so with the default HDFS permissions. Since the default dfs.umask value is 022, this means that the new subdirectory will not inherit the group write permissions of the hive warehouse directory. We should make the umask used by Warehouse.mkdirs() configurable, and set it to use a default value of 002. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
