[jira] [Updated] (HIVE-2930) Add license to the Hive files
[ https://issues.apache.org/jira/browse/HIVE-2930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-2930: Status: Patch Available (was: Open) This doesn't fix the sql files, but fixes the rest of them. It passes unit tests. > Add license to the Hive files > - > > Key: HIVE-2930 > URL: https://issues.apache.org/jira/browse/HIVE-2930 > Project: Hive > Issue Type: Improvement >Reporter: Owen O'Malley >Assignee: Owen O'Malley >Priority: Blocker > Attachments: HIVE-2930.D2835.1.patch > > > We need to clean up the RAT report to 0. Apache projects aren't supposed to > release until they have shown that all of their files have proper headers. > Note that although most of the files are just missing headers, some of them > explicitly say copyright by facebook and released under the Thrift (not > Apache) license. I'll generate a list of them, but I'd really appreciate it > if someone from facebook could in verify that they intend to license them to > Apache. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2930) Add license to the Hive files
[ https://issues.apache.org/jira/browse/HIVE-2930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-2930: Summary: Add license to the Hive files (was: Add license to the ) > Add license to the Hive files > - > > Key: HIVE-2930 > URL: https://issues.apache.org/jira/browse/HIVE-2930 > Project: Hive > Issue Type: Improvement >Reporter: Owen O'Malley >Assignee: Owen O'Malley >Priority: Blocker > > We need to clean up the RAT report to 0. Apache projects aren't supposed to > release until they have shown that all of their files have proper headers. > Note that although most of the files are just missing headers, some of them > explicitly say copyright by facebook and released under the Thrift (not > Apache) license. I'll generate a list of them, but I'd really appreciate it > if someone from facebook could in verify that they intend to license them to > Apache. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2711) Make the header of RCFile unique
[ https://issues.apache.org/jira/browse/HIVE-2711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-2711: Attachment: rc-file-v0.rc Here's the binary file that arc didn't include in the patch. > Make the header of RCFile unique > > > Key: HIVE-2711 > URL: https://issues.apache.org/jira/browse/HIVE-2711 > Project: Hive > Issue Type: Bug > Components: Serializers/Deserializers >Reporter: Owen O'Malley >Assignee: Owen O'Malley > Attachments: HIVE-2711.D2115.1.patch, HIVE-2711.D2115.2.patch, > HIVE-2711.D2115.3.patch, HIVE-2711.D2571.1.patch, rc-file-v0.rc > > > The RCFile implementation was copied from Hadoop's SequenceFile and copied > the 'magic' string in the header. This means that you can't use the header to > distinguish between RCFiles and SequenceFiles. > I'd propose that we create a new header for RCFiles (RCF?) to replace the > current SEQ. To maintain compatibility, we'll need to continue to accept the > current 'SEQ\06' and just make new files contain the new header. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2711) Make the header of RCFile unique
[ https://issues.apache.org/jira/browse/HIVE-2711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-2711: Status: Patch Available (was: Open) Sorry, I didn't re-run the test cases after removing the unused fields from the header. All of the unit tests pass now. > Make the header of RCFile unique > > > Key: HIVE-2711 > URL: https://issues.apache.org/jira/browse/HIVE-2711 > Project: Hive > Issue Type: Bug > Components: Serializers/Deserializers >Reporter: Owen O'Malley >Assignee: Owen O'Malley > Attachments: HIVE-2711.D2115.1.patch, HIVE-2711.D2115.2.patch, > HIVE-2711.D2115.3.patch, HIVE-2711.D2571.1.patch > > > The RCFile implementation was copied from Hadoop's SequenceFile and copied > the 'magic' string in the header. This means that you can't use the header to > distinguish between RCFiles and SequenceFiles. > I'd propose that we create a new header for RCFiles (RCF?) to replace the > current SEQ. To maintain compatibility, we'll need to continue to accept the > current 'SEQ\06' and just make new files contain the new header. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2911) Move global .hiverc file
[ https://issues.apache.org/jira/browse/HIVE-2911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-2911: Status: Patch Available (was: Open) I tested this on a cluster and it worked as expected. > Move global .hiverc file > > > Key: HIVE-2911 > URL: https://issues.apache.org/jira/browse/HIVE-2911 > Project: Hive > Issue Type: Improvement > Components: CLI >Reporter: Owen O'Malley >Assignee: Owen O'Malley > Attachments: HIVE-2911.D2529.1.patch, HIVE-2911.D2529.2.patch > > > Currently, the .hiverc files are loaded from: > {code} > $HIVE_HOME/bin/.hiverc > ~/.hiverc > {code} > It seems more ops-friendly to have it in the config directory. > {code} > $HIVE_HOME/bin/.hiverc <- for backwards compatibility > $HIVE_CONF_DIR/.hiverc > ~/.hiverc > {code} -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2898) Add nicer helper functions for adding and reading metadata from RCFiles
[ https://issues.apache.org/jira/browse/HIVE-2898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-2898: Status: Patch Available (was: Open) I ran the unit tests and they passed. > Add nicer helper functions for adding and reading metadata from RCFiles > --- > > Key: HIVE-2898 > URL: https://issues.apache.org/jira/browse/HIVE-2898 > Project: Hive > Issue Type: New Feature > Components: Serializers/Deserializers >Reporter: Owen O'Malley >Assignee: Owen O'Malley > Attachments: HIVE-2898.D2433.1.patch, HIVE-2898.D2433.2.patch, > HIVE-2898.D2433.3.patch, HIVE-2898.D2433.4.patch > > > Currently, to use the metadata in RCFile, you need to manipulate it using > SequenceFile.Metadata. I'd like to add two helper functions that make it more > convenient. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2898) Add nicer helper functions for adding and reading metadata from RCFiles
[ https://issues.apache.org/jira/browse/HIVE-2898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-2898: Attachment: (was: HIVE-2898.D2439.1.patch) > Add nicer helper functions for adding and reading metadata from RCFiles > --- > > Key: HIVE-2898 > URL: https://issues.apache.org/jira/browse/HIVE-2898 > Project: Hive > Issue Type: New Feature > Components: Serializers/Deserializers >Reporter: Owen O'Malley >Assignee: Owen O'Malley > Attachments: HIVE-2898.D2433.1.patch, HIVE-2898.D2433.2.patch, > HIVE-2898.D2433.3.patch, HIVE-2898.D2433.4.patch > > > Currently, to use the metadata in RCFile, you need to manipulate it using > SequenceFile.Metadata. I'd like to add two helper functions that make it more > convenient. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2879) Add "rat" target to build to look for missing license headers
[ https://issues.apache.org/jira/browse/HIVE-2879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-2879: Status: Patch Available (was: Open) > Add "rat" target to build to look for missing license headers > - > > Key: HIVE-2879 > URL: https://issues.apache.org/jira/browse/HIVE-2879 > Project: Hive > Issue Type: Improvement > Components: Build Infrastructure >Reporter: Owen O'Malley >Assignee: Owen O'Malley > Attachments: HIVE-2879.D2373.1.patch, HIVE-2879.D2373.2.patch, > HIVE-2879.D2373.3.patch > > > We should have a "rat" target that can generate an Apache RAT report. RAT is > used for finding missing license headers. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2879) Add "rat" target to build to look for missing license headers
[ https://issues.apache.org/jira/browse/HIVE-2879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-2879: Status: Patch Available (was: Open) Unsurprisingly, tests pass. > Add "rat" target to build to look for missing license headers > - > > Key: HIVE-2879 > URL: https://issues.apache.org/jira/browse/HIVE-2879 > Project: Hive > Issue Type: Improvement > Components: Build Infrastructure >Reporter: Owen O'Malley >Assignee: Owen O'Malley > Attachments: HIVE-2879.D2373.1.patch > > > We should have a "rat" target that can generate an Apache RAT report. RAT is > used for finding missing license headers. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2894) RCFile Reader doesn't provide access to Metadata
[ https://issues.apache.org/jira/browse/HIVE-2894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-2894: Status: Patch Available (was: Open) I ran the test cases and they pass. > RCFile Reader doesn't provide access to Metadata > > > Key: HIVE-2894 > URL: https://issues.apache.org/jira/browse/HIVE-2894 > Project: Hive > Issue Type: New Feature >Reporter: Owen O'Malley >Assignee: Owen O'Malley > Attachments: HIVE-2894.D2421.1.patch > > > Currently the RCFile writer can add metadata to an RCFile, but the reader > doesn't provide an accessor. I'd like to add one. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2879) Add "rat" target to build to look for missing license headers
[ https://issues.apache.org/jira/browse/HIVE-2879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-2879: Component/s: Build Infrastructure > Add "rat" target to build to look for missing license headers > - > > Key: HIVE-2879 > URL: https://issues.apache.org/jira/browse/HIVE-2879 > Project: Hive > Issue Type: Improvement > Components: Build Infrastructure >Reporter: Owen O'Malley >Assignee: Owen O'Malley > > We should have a "rat" target that can generate an Apache RAT report. RAT is > used for finding missing license headers. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2850) Remove zero length files
[ https://issues.apache.org/jira/browse/HIVE-2850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-2850: Status: Patch Available (was: Open) Tests pass with files removed. > Remove zero length files > > > Key: HIVE-2850 > URL: https://issues.apache.org/jira/browse/HIVE-2850 > Project: Hive > Issue Type: Improvement >Reporter: Owen O'Malley >Assignee: Owen O'Malley > Attachments: HIVE-2850.D2163.1.patch > > > There are also zero-length non-source files that need to be removed. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2841) Fix javadoc warnings
[ https://issues.apache.org/jira/browse/HIVE-2841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-2841: Attachment: h-2841.patch > Fix javadoc warnings > > > Key: HIVE-2841 > URL: https://issues.apache.org/jira/browse/HIVE-2841 > Project: Hive > Issue Type: Improvement >Reporter: Owen O'Malley >Assignee: Owen O'Malley > Fix For: 0.9.0 > > Attachments: HIVE-2841.D2139.1.patch, h-2841.patch > > > We currently have 219 warnings out of Javadoc and I'd like to fix them all. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2835) Change default configuration for hive.exec.dynamic.partition
[ https://issues.apache.org/jira/browse/HIVE-2835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-2835: Status: Patch Available (was: Open) > Change default configuration for hive.exec.dynamic.partition > > > Key: HIVE-2835 > URL: https://issues.apache.org/jira/browse/HIVE-2835 > Project: Hive > Issue Type: Improvement >Reporter: Owen O'Malley >Assignee: Owen O'Malley > Attachments: HIVE-2835.D2157.1.patch > > > I think we should enable dynamic partitions by default. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2841) Fix javadoc warnings
[ https://issues.apache.org/jira/browse/HIVE-2841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-2841: Status: Patch Available (was: Open) > Fix javadoc warnings > > > Key: HIVE-2841 > URL: https://issues.apache.org/jira/browse/HIVE-2841 > Project: Hive > Issue Type: Improvement >Reporter: Owen O'Malley >Assignee: Owen O'Malley > Attachments: HIVE-2841.D2139.1.patch > > > We currently have 219 warnings out of Javadoc and I'd like to fix them all. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2711) Make the header of RCFile unique
[ https://issues.apache.org/jira/browse/HIVE-2711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-2711: Status: Patch Available (was: Open) > Make the header of RCFile unique > > > Key: HIVE-2711 > URL: https://issues.apache.org/jira/browse/HIVE-2711 > Project: Hive > Issue Type: Bug > Components: Serializers/Deserializers >Reporter: Owen O'Malley >Assignee: Owen O'Malley > Attachments: HIVE-2711.D2115.1.patch > > > The RCFile implementation was copied from Hadoop's SequenceFile and copied > the 'magic' string in the header. This means that you can't use the header to > distinguish between RCFiles and SequenceFiles. > I'd propose that we create a new header for RCFiles (RCF?) to replace the > current SEQ. To maintain compatibility, we'll need to continue to accept the > current 'SEQ\06' and just make new files contain the new header. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2753) Remove empty java files
[ https://issues.apache.org/jira/browse/HIVE-2753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-2753: Status: Patch Available (was: Open) The unit tests run fine as expected. > Remove empty java files > --- > > Key: HIVE-2753 > URL: https://issues.apache.org/jira/browse/HIVE-2753 > Project: Hive > Issue Type: Bug >Reporter: Owen O'Malley >Assignee: Owen O'Malley > Attachments: h-2753.patch > > > When looking at the 0.8.1 rc1, I discovered there were a set of empty Java > files that were likely left over from using 'patch' without the -E. > {quote} > jdbc/src/java/org/apache/hadoop/hive/jdbc/JdbcSessionState.java > ql/src/java/org/apache/hadoop/hive/ql/exec/ExprNodeIndexEvaluator.java > ql/src/java/org/apache/hadoop/hive/ql/exec/MapJoinObject.java > ql/src/java/org/apache/hadoop/hive/ql/exec/PathUtil.java > ql/src/java/org/apache/hadoop/hive/ql/exec/TypedBytesRecordReader.java > ql/src/java/org/apache/hadoop/hive/ql/plan/AlterPartitionProtectModeDesc.java > ql/src/java/org/apache/hadoop/hive/ql/plan/TouchDesc.java > ql/src/test/org/apache/hadoop/hive/ql/plan/TestAddPartition.java > serde/src/gen-java/org/apache/hadoop/hive/serde/test/Constants.java > shims/src/0.20/java/org/apache/hadoop/fs/ProxyFileSystem.java > shims/src/0.20/java/org/apache/hadoop/fs/ProxyLocalFileSystem.java > {quote} -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2753) Remove empty java files
[ https://issues.apache.org/jira/browse/HIVE-2753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-2753: Attachment: h-2753.patch Here's the obvious patch. I'm running tests, but I can't imagine this breaks anything. > Remove empty java files > --- > > Key: HIVE-2753 > URL: https://issues.apache.org/jira/browse/HIVE-2753 > Project: Hive > Issue Type: Bug >Reporter: Owen O'Malley >Assignee: Owen O'Malley > Attachments: h-2753.patch > > > When looking at the 0.8.1 rc1, I discovered there were a set of empty Java > files that were likely left over from using 'patch' without the -E. > {quote} > jdbc/src/java/org/apache/hadoop/hive/jdbc/JdbcSessionState.java > ql/src/java/org/apache/hadoop/hive/ql/exec/ExprNodeIndexEvaluator.java > ql/src/java/org/apache/hadoop/hive/ql/exec/MapJoinObject.java > ql/src/java/org/apache/hadoop/hive/ql/exec/PathUtil.java > ql/src/java/org/apache/hadoop/hive/ql/exec/TypedBytesRecordReader.java > ql/src/java/org/apache/hadoop/hive/ql/plan/AlterPartitionProtectModeDesc.java > ql/src/java/org/apache/hadoop/hive/ql/plan/TouchDesc.java > ql/src/test/org/apache/hadoop/hive/ql/plan/TestAddPartition.java > serde/src/gen-java/org/apache/hadoop/hive/serde/test/Constants.java > shims/src/0.20/java/org/apache/hadoop/fs/ProxyFileSystem.java > shims/src/0.20/java/org/apache/hadoop/fs/ProxyLocalFileSystem.java > {quote} -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira