[jira] [Resolved] (HADOOP-8927) org.apache.hadoop.hive.jdbc.HiveDriver loads outside of Map Reduce but fails on Map reduce

2012-10-13 Thread Harsh J (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HADOOP-8927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Harsh J resolved HADOOP-8927.
-

Resolution: Not A Problem

> org.apache.hadoop.hive.jdbc.HiveDriver loads outside of Map Reduce but fails 
> on Map reduce
> --
>
> Key: HADOOP-8927
> URL: https://issues.apache.org/jira/browse/HADOOP-8927
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: conf, tools
>Affects Versions: 2.0.2-alpha
>Reporter: VJ
>Priority: Minor
>


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Created] (HADOOP-8927) org.apache.hadoop.hive.jdbc.HiveDriver loads ourside of Map Reduce but fails on Map reduce

2012-10-13 Thread VJ (JIRA) 
VJ created HADOOP-8927:
--

 Summary: org.apache.hadoop.hive.jdbc.HiveDriver loads ourside of 
Map Reduce but fails on Map reduce
 Key: HADOOP-8927
 URL: https://issues.apache.org/jira/browse/HADOOP-8927
 Project: Hadoop Common
  Issue Type: Bug
  Components: conf, tools
Affects Versions: 2.0.2-alpha
Reporter: VJ
Priority: Blocker




--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Re: [VOTE] Hadoop-1.1.0 release candidate 5

2012-10-13 Thread Jean-Baptiste Onofré 

+1 (non binding)

Regards
JB

On 10/12/2012 06:36 PM, Brandon Li wrote:

+1 (non-binding)

Ran Teragen/Terasort/Teravalidate and other a few other HDFS tests.
Everything worked fine.

Thanks,
Brandon

On Thu, Oct 11, 2012 at 10:21 PM, Chris Nauroth wrote:


+1 (non-binding)

I downloaded the bin tarball, verified the checksum, started single-node
HDFS and MR, and ran multiple test jobs.  Everything worked as expected.

Thank you,
--Chris

On Tue, Oct 9, 2012 at 8:57 AM, Arpit Gupta  wrote:


+1 (non-binding)

ran tests on multi node secure and un secure clusters and everything
worked as expected.

--
Arpit Gupta
Hortonworks Inc.
http://hortonworks.com/

On Oct 5, 2012, at 2:31 PM, Matt Foley  wrote:


Here at long last is a votable release candidate for Hadoop 1.1.0.
Please download and test Hadoop-1.1.0-rc5.

It is available at
http://people.apache.org/~mattf/hadoop-1.1.0-rc5/<

http://people.apache.org/~mattf/hadoop-1.1.0-rc05/>


or from the Nexus maven repo.

Release notes are at
http://people.apache.org/~mattf/hadoop-1.1.0-rc5/releasenotes.html

Vote will run for 1 week as usual, terminating at 2:30pm PDT, Fri 12

Oct

2012.

Thank you,
--Matt Foley
Release Manager











--
Jean-Baptiste Onofré
jbono...@apache.org
http://blog.nanthrax.net
Talend - http://www.talend.com

[jira] [Created] (HADOOP-8926) hadoop.util.PureJavaCrc32 cache hit-ratio is low for static data

2012-10-13 Thread Gopal V (JIRA) 
Gopal V created HADOOP-8926:
---

 Summary: hadoop.util.PureJavaCrc32 cache hit-ratio is low for 
static data
 Key: HADOOP-8926
 URL: https://issues.apache.org/jira/browse/HADOOP-8926
 Project: Hadoop Common
  Issue Type: Improvement
  Components: util
Affects Versions: 2.0.3-alpha
 Environment: Ubuntu 10.10 i386 
Reporter: Gopal V
Priority: Trivial


While running microbenchmarks for HDFS write codepath, a significant part of 
the CPU fraction was consumed by the DataChecksum.update(). 

The attached patch converts the static arrays in CRC32 into a single linear 
array for a performance boost in the inner loop.

milli-seconds for 1Gig (16400 loop over a 64kb chunk) 

|| platform || original || cache-aware || improvement ||
| x86 | 3894 | 2304 | 40.83 |
| x86_64 | 2131 | 1826 | 14 | 

The performance improvement on x86 is rather larger than the 64bit case, due to 
the extra register/stack pressure caused by the static arrays.

A closer analysis of the PureJavaCrc32 JIT code shows the following assembly 
fragment

{code}
  0x40f1e345: mov$0x184,%ecx
  0x40f1e34a: mov0x4415b560(%ecx),%ecx  ;*getstatic T8_5
; - PureJavaCrc32::update@95 (line 61)
;   {oop('PureJavaCrc32')}
  0x40f1e350: mov%ecx,0x2c(%esp)
{code}

Basically, the static variables T8_0 through to T8_7 are being spilled to the 
stack because of register pressure. The x86_64 case has a lower likelihood of 
such pessimistic JIT code due to the increased number of registers.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira