[jira] [Commented] (HIVE-2471) Add timestamp column to the partition stats table.
[ https://issues.apache.org/jira/browse/HIVE-2471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13233258#comment-13233258 ] Hudson commented on HIVE-2471: -- Integrated in Hive-trunk-h0.21 #1322 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1322/]) HIVE-2471 Add timestamp column to the partition stats table. (Kevin Wilfong via namit) (Revision 1302739) Result = FAILURE namit : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1302739 Files : * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/stats/jdbc/JDBCStatsSetupConstants.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/stats/jdbc/JDBCStatsUtils.java > Add timestamp column to the partition stats table. > -- > > Key: HIVE-2471 > URL: https://issues.apache.org/jira/browse/HIVE-2471 > Project: Hive > Issue Type: Improvement >Reporter: Kevin Wilfong >Assignee: Kevin Wilfong > Attachments: HIVE-2471.1.patch.txt, HIVE-2471.D2367.1.patch, > HIVE-2471.D2367.2.patch, HIVE-2471.D2367.3.patch > > > Occasionally, when entries are added to the partition stats table the program > is halted before it can delete those entries, by an exception, keyboard > interrupt, etc. These build up to the point where the table gets very large, > and it hurts the performance of the update statement which is often called. > In order to fix this, I am adding a column to the table which is > auto-populated with the current timestamp. This will allow us to create > scripts that go through periodically and clean out old entries from the table. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
Hive-trunk-h0.21 - Build # 1322 - Failure
Changes for Build #1322 [namit] HIVE-2471 Add timestamp column to the partition stats table. (Kevin Wilfong via namit) 1 tests failed. REGRESSION: org.apache.hadoop.hive.cli.TestNegativeCliDriver.testNegativeCliDriver_script_broken_pipe1 Error Message: Unexpected exception See build/ql/tmp/hive.log, or try "ant test ... -Dtest.silent=false" to get more logs. Stack Trace: junit.framework.AssertionFailedError: Unexpected exception See build/ql/tmp/hive.log, or try "ant test ... -Dtest.silent=false" to get more logs. at junit.framework.Assert.fail(Assert.java:50) at org.apache.hadoop.hive.cli.TestNegativeCliDriver.testNegativeCliDriver_script_broken_pipe1(TestNegativeCliDriver.java:10340) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at junit.framework.TestCase.runTest(TestCase.java:168) at junit.framework.TestCase.runBare(TestCase.java:134) at junit.framework.TestResult$1.protect(TestResult.java:110) at junit.framework.TestResult.runProtected(TestResult.java:128) at junit.framework.TestResult.run(TestResult.java:113) at junit.framework.TestCase.run(TestCase.java:124) at junit.framework.TestSuite.runTest(TestSuite.java:243) at junit.framework.TestSuite.run(TestSuite.java:238) at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:518) at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:1052) at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:906) The Apache Jenkins build system has built Hive-trunk-h0.21 (build #1322) Status: Failure Check console output at https://builds.apache.org/job/Hive-trunk-h0.21/1322/ to view the results.
[jira] [Updated] (HIVE-2764) Obtain delegation tokens for MR jobs in secure hbase setup
[ https://issues.apache.org/jira/browse/HIVE-2764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phabricator updated HIVE-2764: -- Attachment: HIVE-2764.D2205.2.patch enis updated the revision "HIVE-2764 [jira] Obtain delegation tokens for MR jobs in secure hbase setup". Reviewers: JIRA Realized that HiveHFileOutputFormat does not need delegation tokens. Duh! REVISION DETAIL https://reviews.facebook.net/D2205 AFFECTED FILES hbase-handler/src/java/org/apache/hadoop/hive/hbase/HiveHBaseTableInputFormat.java hbase-handler/src/java/org/apache/hadoop/hive/hbase/HiveHBaseTableOutputFormat.java hbase-handler/src/java/org/apache/hadoop/hive/hbase/HiveHFileOutputFormat.java ql/src/java/org/apache/hadoop/hive/ql/exec/ExecDriver.java ql/src/java/org/apache/hadoop/hive/ql/exec/FileSinkOperator.java ql/src/java/org/apache/hadoop/hive/ql/io/HiveNullValueSequenceFileOutputFormat.java ql/src/java/org/apache/hadoop/hive/ql/io/HiveOutputFormat.java ql/src/java/org/apache/hadoop/hive/ql/io/HiveOutputFormatImpl.java ql/src/java/org/apache/hadoop/hive/ql/io/HiveSequenceFileOutputFormat.java ql/src/java/org/apache/hadoop/hive/ql/io/RCFileOutputFormat.java ql/src/java/org/apache/hadoop/hive/ql/plan/MapredWork.java shims/src/test/org/apache/hadoop/hive/thrift/TestZooKeeperTokenStore.java > Obtain delegation tokens for MR jobs in secure hbase setup > > > Key: HIVE-2764 > URL: https://issues.apache.org/jira/browse/HIVE-2764 > Project: Hive > Issue Type: Improvement > Components: HBase Handler, Security >Reporter: Enis Soztutar >Assignee: Enis Soztutar > Attachments: HIVE-2764.D2205.1.patch, HIVE-2764.D2205.2.patch, > HIVE-2764_v0.patch > > > As discussed in HCATALOG-244, in a secure hbase setup with 0.92, we need to > obtain delegation tokens for hbase and save it in jobconf, so that tasks can > access region servers. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2864) If hive history file's directory doesn't exist don't crash
[ https://issues.apache.org/jira/browse/HIVE-2864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13233105#comment-13233105 ] Hudson commented on HIVE-2864: -- Integrated in Hive-trunk-h0.21 #1321 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1321/]) HIVE-2864 If hive history file's directory doesn't exist don't crash (Kevin Wilfong via namit) (Revision 1302550) Result = SUCCESS namit : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1302550 Files : * /hive/trunk/cli/src/java/org/apache/hadoop/hive/cli/CliDriver.java > If hive history file's directory doesn't exist don't crash > -- > > Key: HIVE-2864 > URL: https://issues.apache.org/jira/browse/HIVE-2864 > Project: Hive > Issue Type: Improvement >Reporter: Kevin Wilfong >Assignee: Kevin Wilfong > Fix For: 0.9.0 > > Attachments: HIVE-2864.D2265.1.patch, HIVE-2864.D2265.2.patch > > > Currently, if the history file's directory does not exist the Hive client > crashes. Instead, since this is not a vital feature, it should just display > a warning to the user and continue without it. > This will become more important once the directory becomes configurable, see: > https://issues.apache.org/jira/browse/HIVE-1708 -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2880) Fail to create temporary directory when execute bucket map join
[ https://issues.apache.org/jira/browse/HIVE-2880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] makiet updated HIVE-2880: - Description: I have 2 tables CREATE TABLE data(calling STRING COMMENT 'Calling number', volumn_download BIGINT COMMENT 'Volume download', volumn_upload BIGINT COMMENT 'Volume upload') PARTITIONED BY(ds STRING) CLUSTERED BY (calling) INTO 100 BUCKETS; CREATE TABLE sub(isdn STRING, sub_id STRING) CLUSTERED BY (isdn) INTO 100 BUCKETS; The DATA table has 15m records while SUB table only has 600k records. The following SQL script were executed successfully: select /*+ MAPJOIN(b) */ a.calling, b.sub_id from data a join sub b on a.calling=b.isdn; But when I used Bucket map join by setting: set hive.optimize.bucketmapjoin = true the above SQL script failed select /*+ MAPJOIN(b) */ a.calling, b.sub_id from data a join sub b on a.calling=b.isdn; hive> set hive.optimize.bucketmapjoin = true; hive> select /*+ MAPJOIN(b) */ a.calling, b.sub_id from ggsn_bucket a join sub_bucket b on a.calling=b.isdn; Total MapReduce jobs = 1 WARNING: org.apache.hadoop.metrics.jvm.EventCounter is deprecated. Please use org.apache.hadoop.log.metrics.EventCounter in all the log4j.properties files. Execution log at: /tmp/hduser/hduser_20120320080909_8e6a3419-4d2c-4148-a0c9-166d051c8274.log 2012-03-20 08:09:34 Starting to launch local task to process map join; maximum memory = 932118528 2012-03-20 08:09:34 End of local task; Time Taken: 0.072 sec. Execution completed successfully Mapred Local Task Succeeded . Convert the Join into MapJoin Mapred Local Task Succeeded . Convert the Join into MapJoin Launching Job 1 out of 1 Number of reduce tasks is set to 0 since there's no reduce operator org.apache.hadoop.util.Shell$ExitCodeException: bash: line 0: cd: /u01/app/hduser/hadoop-0.20.203.0/tempdir/hduser/hive_2012-03-20_08-09-27_810_1393729636696443501/-local-10002/HashTable-Stage-1: No such file or directory tar: Cowardly refusing to create an empty archive Try `tar --help' or `tar --usage' for more information. at org.apache.hadoop.util.Shell.runCommand(Shell.java:255) at org.apache.hadoop.util.Shell.run(Shell.java:182) at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java: 375) at org.apache.hadoop.hive.common.FileUtils.tar(FileUtils.java:260) at org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:407 ) at org.apache.hadoop.hive.ql.exec.MapRedTask.execute(MapRedTask.java:136 ) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:133) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.ja va:57) at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1332) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1123) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:931) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:2 55) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:212) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:403) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:671) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:554) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl. java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.hadoop.util.RunJar.main(RunJar.java:156) Job Submission failed with exception 'org.apache.hadoop.util.Shell$ExitCodeException(bash: line 0: cd: /u01/app/hduser/hadoop-0.20.203.0/tempdir/hduser/hive_2012-03-20_08-09-27_810_1393729636696443501/-local-10002/HashTable-Stage-1: No such file or directory tar: Cowardly refusing to create an empty archive Try `tar --help' or `tar --usage' for more information. )' java.lang.IllegalArgumentException: Can not create a Path from an empty string at org.apache.hadoop.fs.Path.checkPathArg(Path.java:82) at org.apache.hadoop.fs.Path.(Path.java:90) at org.apache.hadoop.hive.ql.exec.Utilities.getHiveJobID(Utilities.java: 379) at org.apache.hadoop.hive.ql.exec.Utilities.clearMapRedWork(Utilities.ja va:192) at org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:476 ) at org.apache.hadoop.hive.ql.exec.MapRedTask.execute(MapRedTask.java:136 ) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:133) at org.apache.hadoop.hive.ql.e
[jira] [Created] (HIVE-2880) Fail to create temporary directory when execute bucket map join
Fail to create temporary directory when execute bucket map join --- Key: HIVE-2880 URL: https://issues.apache.org/jira/browse/HIVE-2880 Project: Hive Issue Type: Bug Components: SQL Affects Versions: 0.8.1 Environment: Cluster with 4 PC: CPU Intel dual core 2.2Ghz, 2Gb ram, 80G hdd, cent OS 5.0, NIC 100Mbps 1 of them: Namenode + 2nd namenode + job tracker + hive server (also Datanode and Task tracker) 3 of them: only datanode + task tracker All of them could ssh password-less to each other and used the same user account: hduser Reporter: makiet I have 2 tables CREATE TABLE data(calling STRING COMMENT 'Calling number', volumn_download BIGINT COMMENT 'Volume download', volumn_upload BIGINT COMMENT 'Volume upload') PARTITIONED BY(ds STRING) CLUSTERED BY (calling) INTO 100 BUCKETS; CREATE TABLE sub(isdn STRING, sub_id STRING) CLUSTERED BY (isdn) INTO 100 BUCKETS; The DATA table has 15m records while SUB table only has 600k records. The following SQL script were executed successfully: select /*+ MAPJOIN(b) */ a.calling, b.sub_id from ggsn_bucket a join sub_bucket b on a.calling=b.isdn; But when I used Bucket map join by setting: set hive.optimize.bucketmapjoin = true the above SQL script failed select /*+ MAPJOIN(b) */ a.calling, b.sub_id from ggsn_bucket a join sub_bucket b on a.calling=b.isdn; hive> set hive.optimize.bucketmapjoin = true; hive> select /*+ MAPJOIN(b) */ a.calling, b.sub_id from ggsn_bucket a join sub_bucket b on a.calling=b.isdn; Total MapReduce jobs = 1 WARNING: org.apache.hadoop.metrics.jvm.EventCounter is deprecated. Please use org.apache.hadoop.log.metrics.EventCounter in all the log4j.properties files. Execution log at: /tmp/hduser/hduser_20120320080909_8e6a3419-4d2c-4148-a0c9-166d051c8274.log 2012-03-20 08:09:34 Starting to launch local task to process map join; maximum memory = 932118528 2012-03-20 08:09:34 End of local task; Time Taken: 0.072 sec. Execution completed successfully Mapred Local Task Succeeded . Convert the Join into MapJoin Mapred Local Task Succeeded . Convert the Join into MapJoin Launching Job 1 out of 1 Number of reduce tasks is set to 0 since there's no reduce operator org.apache.hadoop.util.Shell$ExitCodeException: bash: line 0: cd: /u01/app/hduser/hadoop-0.20.203.0/tempdir/hduser/hive_2012-03-20_08-09-27_810_1393729636696443501/-local-10002/HashTable-Stage-1: No such file or directory tar: Cowardly refusing to create an empty archive Try `tar --help' or `tar --usage' for more information. at org.apache.hadoop.util.Shell.runCommand(Shell.java:255) at org.apache.hadoop.util.Shell.run(Shell.java:182) at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java: 375) at org.apache.hadoop.hive.common.FileUtils.tar(FileUtils.java:260) at org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:407 ) at org.apache.hadoop.hive.ql.exec.MapRedTask.execute(MapRedTask.java:136 ) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:133) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.ja va:57) at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1332) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1123) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:931) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:2 55) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:212) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:403) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:671) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:554) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl. java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.hadoop.util.RunJar.main(RunJar.java:156) Job Submission failed with exception 'org.apache.hadoop.util.Shell$ExitCodeExcep tion(bash: line 0: cd: /u01/app/hduser/hadoop-0.20.203.0/tempdir/hduser/hive_201 2-03-20_08-09-27_810_1393729636696443501/-local-10002/HashTable-Stage-1: No such file or directory tar: Cowardly refusing to create an empty archive Try `tar --help' or `tar --usage' for more information. )' java.lang.IllegalArgumentException: Can not create a Path from an empty string at org.apache.hadoop.fs.Path.checkPathArg(Path.jav
[jira] [Updated] (HIVE-2471) Add timestamp column to the partition stats table.
[ https://issues.apache.org/jira/browse/HIVE-2471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2471: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Committed. Thanks Kevin > Add timestamp column to the partition stats table. > -- > > Key: HIVE-2471 > URL: https://issues.apache.org/jira/browse/HIVE-2471 > Project: Hive > Issue Type: Improvement >Reporter: Kevin Wilfong >Assignee: Kevin Wilfong > Attachments: HIVE-2471.1.patch.txt, HIVE-2471.D2367.1.patch, > HIVE-2471.D2367.2.patch, HIVE-2471.D2367.3.patch > > > Occasionally, when entries are added to the partition stats table the program > is halted before it can delete those entries, by an exception, keyboard > interrupt, etc. These build up to the point where the table gets very large, > and it hurts the performance of the update statement which is often called. > In order to fix this, I am adding a column to the table which is > auto-populated with the current timestamp. This will allow us to create > scripts that go through periodically and clean out old entries from the table. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2879) Add "rat" target to build to look for missing license headers
[ https://issues.apache.org/jira/browse/HIVE-2879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13233026#comment-13233026 ] Owen O'Malley commented on HIVE-2879: - I got the exclude patterns so that there are only 81 files being reported, most of which look like files that should have the header. > Add "rat" target to build to look for missing license headers > - > > Key: HIVE-2879 > URL: https://issues.apache.org/jira/browse/HIVE-2879 > Project: Hive > Issue Type: Improvement > Components: Build Infrastructure >Reporter: Owen O'Malley >Assignee: Owen O'Malley > Attachments: HIVE-2879.D2373.1.patch > > > We should have a "rat" target that can generate an Apache RAT report. RAT is > used for finding missing license headers. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2879) Add "rat" target to build to look for missing license headers
[ https://issues.apache.org/jira/browse/HIVE-2879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phabricator updated HIVE-2879: -- Attachment: HIVE-2879.D2373.1.patch omalley requested code review of "HIVE-2879 [jira] Add "rat" target to build to look for missing license headers". Reviewers: JIRA <> Add "rat" target to look for missing license headers. We should have a "rat" target that can generate an Apache RAT report. RAT is used for finding missing license headers. TEST PLAN EMPTY REVISION DETAIL https://reviews.facebook.net/D2373 AFFECTED FILES build.xml ivy.xml ivy/libraries.properties MANAGE HERALD DIFFERENTIAL RULES https://reviews.facebook.net/herald/view/differential/ WHY DID I GET THIS EMAIL? https://reviews.facebook.net/herald/transcript/5319/ Tip: use the X-Herald-Rules header to filter Herald messages in your client. > Add "rat" target to build to look for missing license headers > - > > Key: HIVE-2879 > URL: https://issues.apache.org/jira/browse/HIVE-2879 > Project: Hive > Issue Type: Improvement > Components: Build Infrastructure >Reporter: Owen O'Malley >Assignee: Owen O'Malley > Attachments: HIVE-2879.D2373.1.patch > > > We should have a "rat" target that can generate an Apache RAT report. RAT is > used for finding missing license headers. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HIVE-2879) Add "rat" target to build to look for missing license headers
Add "rat" target to build to look for missing license headers - Key: HIVE-2879 URL: https://issues.apache.org/jira/browse/HIVE-2879 Project: Hive Issue Type: Improvement Reporter: Owen O'Malley Assignee: Owen O'Malley We should have a "rat" target that can generate an Apache RAT report. RAT is used for finding missing license headers. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2879) Add "rat" target to build to look for missing license headers
[ https://issues.apache.org/jira/browse/HIVE-2879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-2879: Component/s: Build Infrastructure > Add "rat" target to build to look for missing license headers > - > > Key: HIVE-2879 > URL: https://issues.apache.org/jira/browse/HIVE-2879 > Project: Hive > Issue Type: Improvement > Components: Build Infrastructure >Reporter: Owen O'Malley >Assignee: Owen O'Malley > > We should have a "rat" target that can generate an Apache RAT report. RAT is > used for finding missing license headers. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2878) TestHBaseMinimrCliDriver hbase_bulk.m fails on 0.23
[ https://issues.apache.org/jira/browse/HIVE-2878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach updated HIVE-2878: - Attachment: HIVE-2878.br08.1.patch.txt > TestHBaseMinimrCliDriver hbase_bulk.m fails on 0.23 > --- > > Key: HIVE-2878 > URL: https://issues.apache.org/jira/browse/HIVE-2878 > Project: Hive > Issue Type: Bug > Components: Tests >Affects Versions: 0.8.1 >Reporter: Carl Steinbach >Assignee: Carl Steinbach > Attachments: HIVE-2878.br08.1.patch.txt > > -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2878) TestHBaseMinimrCliDriver hbase_bulk.m fails on 0.23
[ https://issues.apache.org/jira/browse/HIVE-2878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13232996#comment-13232996 ] Carl Steinbach commented on HIVE-2878: -- Note: This problem only affects the 0.8.x branch. Trunk already uses different code for masking test outputs that prevents this problem from occurring. > TestHBaseMinimrCliDriver hbase_bulk.m fails on 0.23 > --- > > Key: HIVE-2878 > URL: https://issues.apache.org/jira/browse/HIVE-2878 > Project: Hive > Issue Type: Bug > Components: Tests >Affects Versions: 0.8.1 >Reporter: Carl Steinbach >Assignee: Carl Steinbach > -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2878) TestHBaseMinimrCliDriver hbase_bulk.m fails on 0.23
[ https://issues.apache.org/jira/browse/HIVE-2878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach updated HIVE-2878: - Affects Version/s: 0.8.1 > TestHBaseMinimrCliDriver hbase_bulk.m fails on 0.23 > --- > > Key: HIVE-2878 > URL: https://issues.apache.org/jira/browse/HIVE-2878 > Project: Hive > Issue Type: Bug > Components: Tests >Affects Versions: 0.8.1 >Reporter: Carl Steinbach >Assignee: Carl Steinbach > -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2878) TestHBaseMinimrCliDriver hbase_bulk.m fails on 0.23
[
https://issues.apache.org/jira/browse/HIVE-2878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13232989#comment-13232989
]
Carl Steinbach commented on HIVE-2878:
--
On Hadoop 0.20 the 'dfs -count' command outputs a fully qualified file location:
{noformat}
dfs -count /build/ql/test/data/warehouse/hbpartition;
13 23380
hdfs://localhost.localdomain:37780/tmp/hbsort/cf
{noformat}
But on 0.23 the file location is not qualified:
{noformat}
dfs -count /build/ql/test/data/warehouse/hbpartition;
13 24792 /tmp/hbsort/cf
{noformat}
This is a causing a test failure in TestHBaseMinimrCliDriver.hbase_bulk.m
> TestHBaseMinimrCliDriver hbase_bulk.m fails on 0.23
> ---
>
> Key: HIVE-2878
> URL: https://issues.apache.org/jira/browse/HIVE-2878
> Project: Hive
> Issue Type: Bug
> Components: Tests
>Reporter: Carl Steinbach
>Assignee: Carl Steinbach
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HIVE-2878) TestHBaseMinimrCliDriver hbase_bulk.m fails on 0.23
TestHBaseMinimrCliDriver hbase_bulk.m fails on 0.23 --- Key: HIVE-2878 URL: https://issues.apache.org/jira/browse/HIVE-2878 Project: Hive Issue Type: Bug Components: Tests Reporter: Carl Steinbach Assignee: Carl Steinbach -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2471) Add timestamp column to the partition stats table.
[ https://issues.apache.org/jira/browse/HIVE-2471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13232764#comment-13232764 ] Phabricator commented on HIVE-2471: --- njain has accepted the revision "HIVE-2471 [jira] Add timestamp column with index to the partition stats table.". Running tests REVISION DETAIL https://reviews.facebook.net/D2367 BRANCH svn > Add timestamp column to the partition stats table. > -- > > Key: HIVE-2471 > URL: https://issues.apache.org/jira/browse/HIVE-2471 > Project: Hive > Issue Type: Improvement >Reporter: Kevin Wilfong >Assignee: Kevin Wilfong > Attachments: HIVE-2471.1.patch.txt, HIVE-2471.D2367.1.patch, > HIVE-2471.D2367.2.patch, HIVE-2471.D2367.3.patch > > > Occasionally, when entries are added to the partition stats table the program > is halted before it can delete those entries, by an exception, keyboard > interrupt, etc. These build up to the point where the table gets very large, > and it hurts the performance of the update statement which is often called. > In order to fix this, I am adding a column to the table which is > auto-populated with the current timestamp. This will allow us to create > scripts that go through periodically and clean out old entries from the table. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2864) If hive history file's directory doesn't exist don't crash
[ https://issues.apache.org/jira/browse/HIVE-2864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-2864: --- Fix Version/s: 0.9.0 > If hive history file's directory doesn't exist don't crash > -- > > Key: HIVE-2864 > URL: https://issues.apache.org/jira/browse/HIVE-2864 > Project: Hive > Issue Type: Improvement >Reporter: Kevin Wilfong >Assignee: Kevin Wilfong > Fix For: 0.9.0 > > Attachments: HIVE-2864.D2265.1.patch, HIVE-2864.D2265.2.patch > > > Currently, if the history file's directory does not exist the Hive client > crashes. Instead, since this is not a vital feature, it should just display > a warning to the user and continue without it. > This will become more important once the directory becomes configurable, see: > https://issues.apache.org/jira/browse/HIVE-1708 -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2864) If hive history file's directory doesn't exist don't crash
[ https://issues.apache.org/jira/browse/HIVE-2864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2864: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Committed. Thanks Kevin > If hive history file's directory doesn't exist don't crash > -- > > Key: HIVE-2864 > URL: https://issues.apache.org/jira/browse/HIVE-2864 > Project: Hive > Issue Type: Improvement >Reporter: Kevin Wilfong >Assignee: Kevin Wilfong > Attachments: HIVE-2864.D2265.1.patch, HIVE-2864.D2265.2.patch > > > Currently, if the history file's directory does not exist the Hive client > crashes. Instead, since this is not a vital feature, it should just display > a warning to the user and continue without it. > This will become more important once the directory becomes configurable, see: > https://issues.apache.org/jira/browse/HIVE-1708 -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2865) hive-config.sh should honor HIVE_HOME env
[ https://issues.apache.org/jira/browse/HIVE-2865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-2865: --- Resolution: Fixed Status: Resolved (was: Patch Available) > hive-config.sh should honor HIVE_HOME env > -- > > Key: HIVE-2865 > URL: https://issues.apache.org/jira/browse/HIVE-2865 > Project: Hive > Issue Type: Improvement >Affects Versions: 0.8.0 >Reporter: Giridharan Kesavan >Assignee: Giridharan Kesavan > Fix For: 0.9.0 > > Attachments: HIVE-2865.patch > > > hive-config.sh should honor HIVE_HOME env variable if set. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
