[jira] [Updated] (HIVE-2930) Add license to the Hive files

2012-04-17 Thread Owen O'Malley (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-2930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Owen O'Malley updated HIVE-2930:


Status: Patch Available  (was: Open)

This doesn't fix the sql files, but fixes the rest of them. It passes unit 
tests.

> Add license to the Hive files
> -
>
> Key: HIVE-2930
> URL: https://issues.apache.org/jira/browse/HIVE-2930
> Project: Hive
>  Issue Type: Improvement
>Reporter: Owen O'Malley
>Assignee: Owen O'Malley
>Priority: Blocker
> Attachments: HIVE-2930.D2835.1.patch
>
>
> We need to clean up the RAT report to 0. Apache projects aren't supposed to 
> release until they have shown that all of their files have proper headers.
> Note that although most of the files are just missing headers, some of them 
> explicitly say copyright by facebook and released under the Thrift (not 
> Apache) license. I'll generate a list of them, but I'd really appreciate it 
> if someone from facebook could in verify that they intend to license them to 
> Apache.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (HIVE-2930) Add license to the Hive files

2012-04-06 Thread Owen O'Malley (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-2930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Owen O'Malley updated HIVE-2930:


Summary: Add license to the Hive files  (was: Add license to the )

> Add license to the Hive files
> -
>
> Key: HIVE-2930
> URL: https://issues.apache.org/jira/browse/HIVE-2930
> Project: Hive
>  Issue Type: Improvement
>Reporter: Owen O'Malley
>Assignee: Owen O'Malley
>Priority: Blocker
>
> We need to clean up the RAT report to 0. Apache projects aren't supposed to 
> release until they have shown that all of their files have proper headers.
> Note that although most of the files are just missing headers, some of them 
> explicitly say copyright by facebook and released under the Thrift (not 
> Apache) license. I'll generate a list of them, but I'd really appreciate it 
> if someone from facebook could in verify that they intend to license them to 
> Apache.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (HIVE-2711) Make the header of RCFile unique

2012-04-05 Thread Owen O'Malley (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-2711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Owen O'Malley updated HIVE-2711:


Attachment: rc-file-v0.rc

Here's the binary file that arc didn't include in the patch.

> Make the header of RCFile unique
> 
>
> Key: HIVE-2711
> URL: https://issues.apache.org/jira/browse/HIVE-2711
> Project: Hive
>  Issue Type: Bug
>  Components: Serializers/Deserializers
>Reporter: Owen O'Malley
>Assignee: Owen O'Malley
> Attachments: HIVE-2711.D2115.1.patch, HIVE-2711.D2115.2.patch, 
> HIVE-2711.D2115.3.patch, HIVE-2711.D2571.1.patch, rc-file-v0.rc
>
>
> The RCFile implementation was copied from Hadoop's SequenceFile and copied 
> the 'magic' string in the header. This means that you can't use the header to 
> distinguish between RCFiles and SequenceFiles.
> I'd propose that we create a new header for RCFiles (RCF?) to replace the 
> current SEQ. To maintain compatibility, we'll need to continue to accept the 
> current 'SEQ\06' and just make new files contain the new header.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (HIVE-2711) Make the header of RCFile unique

2012-04-04 Thread Owen O'Malley (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-2711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Owen O'Malley updated HIVE-2711:


Status: Patch Available  (was: Open)

Sorry, I didn't re-run the test cases after removing the unused fields from the 
header. All of the unit tests pass now.

> Make the header of RCFile unique
> 
>
> Key: HIVE-2711
> URL: https://issues.apache.org/jira/browse/HIVE-2711
> Project: Hive
>  Issue Type: Bug
>  Components: Serializers/Deserializers
>Reporter: Owen O'Malley
>Assignee: Owen O'Malley
> Attachments: HIVE-2711.D2115.1.patch, HIVE-2711.D2115.2.patch, 
> HIVE-2711.D2115.3.patch, HIVE-2711.D2571.1.patch
>
>
> The RCFile implementation was copied from Hadoop's SequenceFile and copied 
> the 'magic' string in the header. This means that you can't use the header to 
> distinguish between RCFiles and SequenceFiles.
> I'd propose that we create a new header for RCFiles (RCF?) to replace the 
> current SEQ. To maintain compatibility, we'll need to continue to accept the 
> current 'SEQ\06' and just make new files contain the new header.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (HIVE-2911) Move global .hiverc file

2012-03-29 Thread Owen O'Malley (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-2911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Owen O'Malley updated HIVE-2911:


Status: Patch Available  (was: Open)

I tested this on a cluster and it worked as expected.

> Move global .hiverc file
> 
>
> Key: HIVE-2911
> URL: https://issues.apache.org/jira/browse/HIVE-2911
> Project: Hive
>  Issue Type: Improvement
>  Components: CLI
>Reporter: Owen O'Malley
>Assignee: Owen O'Malley
> Attachments: HIVE-2911.D2529.1.patch, HIVE-2911.D2529.2.patch
>
>
> Currently, the .hiverc files are loaded from:
> {code}
> $HIVE_HOME/bin/.hiverc
> ~/.hiverc
> {code}
> It seems more ops-friendly to have it in the config directory.
> {code}
> $HIVE_HOME/bin/.hiverc  <- for backwards compatibility
> $HIVE_CONF_DIR/.hiverc
> ~/.hiverc
> {code}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (HIVE-2898) Add nicer helper functions for adding and reading metadata from RCFiles

2012-03-26 Thread Owen O'Malley (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-2898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Owen O'Malley updated HIVE-2898:


Status: Patch Available  (was: Open)

I ran the unit tests and they passed.

> Add nicer helper functions for adding and reading metadata from RCFiles
> ---
>
> Key: HIVE-2898
> URL: https://issues.apache.org/jira/browse/HIVE-2898
> Project: Hive
>  Issue Type: New Feature
>  Components: Serializers/Deserializers
>Reporter: Owen O'Malley
>Assignee: Owen O'Malley
> Attachments: HIVE-2898.D2433.1.patch, HIVE-2898.D2433.2.patch, 
> HIVE-2898.D2433.3.patch, HIVE-2898.D2433.4.patch
>
>
> Currently, to use the metadata in RCFile, you need to manipulate it using 
> SequenceFile.Metadata. I'd like to add two helper functions that make it more 
> convenient.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (HIVE-2898) Add nicer helper functions for adding and reading metadata from RCFiles

2012-03-26 Thread Owen O'Malley (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-2898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Owen O'Malley updated HIVE-2898:


Attachment: (was: HIVE-2898.D2439.1.patch)

> Add nicer helper functions for adding and reading metadata from RCFiles
> ---
>
> Key: HIVE-2898
> URL: https://issues.apache.org/jira/browse/HIVE-2898
> Project: Hive
>  Issue Type: New Feature
>  Components: Serializers/Deserializers
>Reporter: Owen O'Malley
>Assignee: Owen O'Malley
> Attachments: HIVE-2898.D2433.1.patch, HIVE-2898.D2433.2.patch, 
> HIVE-2898.D2433.3.patch, HIVE-2898.D2433.4.patch
>
>
> Currently, to use the metadata in RCFile, you need to manipulate it using 
> SequenceFile.Metadata. I'd like to add two helper functions that make it more 
> convenient.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (HIVE-2879) Add "rat" target to build to look for missing license headers

2012-03-26 Thread Owen O'Malley (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-2879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Owen O'Malley updated HIVE-2879:


Status: Patch Available  (was: Open)

> Add "rat" target to build to look for missing license headers
> -
>
> Key: HIVE-2879
> URL: https://issues.apache.org/jira/browse/HIVE-2879
> Project: Hive
>  Issue Type: Improvement
>  Components: Build Infrastructure
>Reporter: Owen O'Malley
>Assignee: Owen O'Malley
> Attachments: HIVE-2879.D2373.1.patch, HIVE-2879.D2373.2.patch, 
> HIVE-2879.D2373.3.patch
>
>
> We should have a "rat" target that can generate an Apache RAT report. RAT is 
> used for finding missing license headers.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (HIVE-2879) Add "rat" target to build to look for missing license headers

2012-03-23 Thread Owen O'Malley (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-2879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Owen O'Malley updated HIVE-2879:


Status: Patch Available  (was: Open)

Unsurprisingly, tests pass.

> Add "rat" target to build to look for missing license headers
> -
>
> Key: HIVE-2879
> URL: https://issues.apache.org/jira/browse/HIVE-2879
> Project: Hive
>  Issue Type: Improvement
>  Components: Build Infrastructure
>Reporter: Owen O'Malley
>Assignee: Owen O'Malley
> Attachments: HIVE-2879.D2373.1.patch
>
>
> We should have a "rat" target that can generate an Apache RAT report. RAT is 
> used for finding missing license headers.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (HIVE-2894) RCFile Reader doesn't provide access to Metadata

2012-03-22 Thread Owen O'Malley (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-2894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Owen O'Malley updated HIVE-2894:


Status: Patch Available  (was: Open)

I ran the test cases and they pass.

> RCFile Reader doesn't provide access to Metadata
> 
>
> Key: HIVE-2894
> URL: https://issues.apache.org/jira/browse/HIVE-2894
> Project: Hive
>  Issue Type: New Feature
>Reporter: Owen O'Malley
>Assignee: Owen O'Malley
> Attachments: HIVE-2894.D2421.1.patch
>
>
> Currently the RCFile writer can add metadata to an RCFile, but the reader 
> doesn't provide an accessor. I'd like to add one.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (HIVE-2879) Add "rat" target to build to look for missing license headers

2012-03-19 Thread Owen O'Malley (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-2879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Owen O'Malley updated HIVE-2879:


Component/s: Build Infrastructure

> Add "rat" target to build to look for missing license headers
> -
>
> Key: HIVE-2879
> URL: https://issues.apache.org/jira/browse/HIVE-2879
> Project: Hive
>  Issue Type: Improvement
>  Components: Build Infrastructure
>Reporter: Owen O'Malley
>Assignee: Owen O'Malley
>
> We should have a "rat" target that can generate an Apache RAT report. RAT is 
> used for finding missing license headers.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (HIVE-2850) Remove zero length files

2012-03-16 Thread Owen O'Malley (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-2850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Owen O'Malley updated HIVE-2850:


Status: Patch Available  (was: Open)

Tests pass with files removed.

> Remove zero length files
> 
>
> Key: HIVE-2850
> URL: https://issues.apache.org/jira/browse/HIVE-2850
> Project: Hive
>  Issue Type: Improvement
>Reporter: Owen O'Malley
>Assignee: Owen O'Malley
> Attachments: HIVE-2850.D2163.1.patch
>
>
> There are also zero-length non-source files that need to be removed.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (HIVE-2841) Fix javadoc warnings

2012-03-07 Thread Owen O'Malley (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-2841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Owen O'Malley updated HIVE-2841:


Attachment: h-2841.patch

> Fix javadoc warnings
> 
>
> Key: HIVE-2841
> URL: https://issues.apache.org/jira/browse/HIVE-2841
> Project: Hive
>  Issue Type: Improvement
>Reporter: Owen O'Malley
>Assignee: Owen O'Malley
> Fix For: 0.9.0
>
> Attachments: HIVE-2841.D2139.1.patch, h-2841.patch
>
>
> We currently have 219 warnings out of Javadoc and I'd like to fix them all.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (HIVE-2835) Change default configuration for hive.exec.dynamic.partition

2012-03-06 Thread Owen O'Malley (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-2835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Owen O'Malley updated HIVE-2835:


Status: Patch Available  (was: Open)

> Change default configuration for hive.exec.dynamic.partition
> 
>
> Key: HIVE-2835
> URL: https://issues.apache.org/jira/browse/HIVE-2835
> Project: Hive
>  Issue Type: Improvement
>Reporter: Owen O'Malley
>Assignee: Owen O'Malley
> Attachments: HIVE-2835.D2157.1.patch
>
>
> I think we should enable dynamic partitions by default.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (HIVE-2841) Fix javadoc warnings

2012-03-06 Thread Owen O'Malley (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-2841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Owen O'Malley updated HIVE-2841:


Status: Patch Available  (was: Open)

> Fix javadoc warnings
> 
>
> Key: HIVE-2841
> URL: https://issues.apache.org/jira/browse/HIVE-2841
> Project: Hive
>  Issue Type: Improvement
>Reporter: Owen O'Malley
>Assignee: Owen O'Malley
> Attachments: HIVE-2841.D2139.1.patch
>
>
> We currently have 219 warnings out of Javadoc and I'd like to fix them all.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (HIVE-2711) Make the header of RCFile unique

2012-03-06 Thread Owen O'Malley (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-2711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Owen O'Malley updated HIVE-2711:


Status: Patch Available  (was: Open)

> Make the header of RCFile unique
> 
>
> Key: HIVE-2711
> URL: https://issues.apache.org/jira/browse/HIVE-2711
> Project: Hive
>  Issue Type: Bug
>  Components: Serializers/Deserializers
>Reporter: Owen O'Malley
>Assignee: Owen O'Malley
> Attachments: HIVE-2711.D2115.1.patch
>
>
> The RCFile implementation was copied from Hadoop's SequenceFile and copied 
> the 'magic' string in the header. This means that you can't use the header to 
> distinguish between RCFiles and SequenceFiles.
> I'd propose that we create a new header for RCFiles (RCF?) to replace the 
> current SEQ. To maintain compatibility, we'll need to continue to accept the 
> current 'SEQ\06' and just make new files contain the new header.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (HIVE-2753) Remove empty java files

2012-02-06 Thread Owen O'Malley (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-2753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Owen O'Malley updated HIVE-2753:


Status: Patch Available  (was: Open)

The unit tests run fine as expected.

> Remove empty java files
> ---
>
> Key: HIVE-2753
> URL: https://issues.apache.org/jira/browse/HIVE-2753
> Project: Hive
>  Issue Type: Bug
>Reporter: Owen O'Malley
>Assignee: Owen O'Malley
> Attachments: h-2753.patch
>
>
> When looking at the 0.8.1 rc1, I discovered there were a set of empty Java 
> files that were likely left over from using 'patch' without the -E.
> {quote}
> jdbc/src/java/org/apache/hadoop/hive/jdbc/JdbcSessionState.java
> ql/src/java/org/apache/hadoop/hive/ql/exec/ExprNodeIndexEvaluator.java
> ql/src/java/org/apache/hadoop/hive/ql/exec/MapJoinObject.java
> ql/src/java/org/apache/hadoop/hive/ql/exec/PathUtil.java
> ql/src/java/org/apache/hadoop/hive/ql/exec/TypedBytesRecordReader.java
> ql/src/java/org/apache/hadoop/hive/ql/plan/AlterPartitionProtectModeDesc.java
> ql/src/java/org/apache/hadoop/hive/ql/plan/TouchDesc.java
> ql/src/test/org/apache/hadoop/hive/ql/plan/TestAddPartition.java
> serde/src/gen-java/org/apache/hadoop/hive/serde/test/Constants.java
> shims/src/0.20/java/org/apache/hadoop/fs/ProxyFileSystem.java
> shims/src/0.20/java/org/apache/hadoop/fs/ProxyLocalFileSystem.java
> {quote}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (HIVE-2753) Remove empty java files

2012-01-26 Thread Owen O'Malley (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-2753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Owen O'Malley updated HIVE-2753:


Attachment: h-2753.patch

Here's the obvious patch. I'm running tests, but I can't imagine this breaks 
anything.

> Remove empty java files
> ---
>
> Key: HIVE-2753
> URL: https://issues.apache.org/jira/browse/HIVE-2753
> Project: Hive
>  Issue Type: Bug
>Reporter: Owen O'Malley
>Assignee: Owen O'Malley
> Attachments: h-2753.patch
>
>
> When looking at the 0.8.1 rc1, I discovered there were a set of empty Java 
> files that were likely left over from using 'patch' without the -E.
> {quote}
> jdbc/src/java/org/apache/hadoop/hive/jdbc/JdbcSessionState.java
> ql/src/java/org/apache/hadoop/hive/ql/exec/ExprNodeIndexEvaluator.java
> ql/src/java/org/apache/hadoop/hive/ql/exec/MapJoinObject.java
> ql/src/java/org/apache/hadoop/hive/ql/exec/PathUtil.java
> ql/src/java/org/apache/hadoop/hive/ql/exec/TypedBytesRecordReader.java
> ql/src/java/org/apache/hadoop/hive/ql/plan/AlterPartitionProtectModeDesc.java
> ql/src/java/org/apache/hadoop/hive/ql/plan/TouchDesc.java
> ql/src/test/org/apache/hadoop/hive/ql/plan/TestAddPartition.java
> serde/src/gen-java/org/apache/hadoop/hive/serde/test/Constants.java
> shims/src/0.20/java/org/apache/hadoop/fs/ProxyFileSystem.java
> shims/src/0.20/java/org/apache/hadoop/fs/ProxyLocalFileSystem.java
> {quote}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira