[jira] Updated: (HIVE-91) Allow external tables with different partition directory structure
[ https://issues.apache.org/jira/browse/HIVE-91?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach updated HIVE-91: --- Fix Version/s: 0.3.0 (was: 0.4.0) Allow external tables with different partition directory structure -- Key: HIVE-91 URL: https://issues.apache.org/jira/browse/HIVE-91 Project: Hadoop Hive Issue Type: Improvement Components: Metastore Reporter: Johan Oskarsson Assignee: Johan Oskarsson Priority: Minor Fix For: 0.3.0 Attachments: HIVE-91.patch, HIVE-91.patch, HIVE-91.patch, HIVE-91.patch A lot of users have datasets in a directory structures similar to this in hdfs: /dataset//MM/dd/one or more files Instead of loading these into Hive the normal way it would be useful to create an external table with the /dataset location and then one partition per /mm/dd. This would require the partition naming to directory-function to be made more flexible. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-91) Allow external tables with different partition directory structure
[ https://issues.apache.org/jira/browse/HIVE-91?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach updated HIVE-91: --- Fix Version/s: (was: 0.6.0) 0.4.0 Allow external tables with different partition directory structure -- Key: HIVE-91 URL: https://issues.apache.org/jira/browse/HIVE-91 Project: Hadoop Hive Issue Type: Improvement Components: Metastore Reporter: Johan Oskarsson Assignee: Johan Oskarsson Priority: Minor Fix For: 0.4.0 Attachments: HIVE-91.patch, HIVE-91.patch, HIVE-91.patch, HIVE-91.patch A lot of users have datasets in a directory structures similar to this in hdfs: /dataset//MM/dd/one or more files Instead of loading these into Hive the normal way it would be useful to create an external table with the /dataset location and then one partition per /mm/dd. This would require the partition naming to directory-function to be made more flexible. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-91) Allow external tables with different partition directory structure
[ https://issues.apache.org/jira/browse/HIVE-91?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johan Oskarsson updated HIVE-91: Attachment: HIVE-91.patch Updated patch to include clipositive tests, I have left the rest of the patch as is. I left the code TestAddPartition.java:53 there because I get an NPE if I remove it. Allow external tables with different partition directory structure -- Key: HIVE-91 URL: https://issues.apache.org/jira/browse/HIVE-91 Project: Hadoop Hive Issue Type: Improvement Components: Metastore Reporter: Johan Oskarsson Assignee: Johan Oskarsson Priority: Minor Attachments: HIVE-91.patch, HIVE-91.patch, HIVE-91.patch A lot of users have datasets in a directory structures similar to this in hdfs: /dataset//MM/dd/one or more files Instead of loading these into Hive the normal way it would be useful to create an external table with the /dataset location and then one partition per /mm/dd. This would require the partition naming to directory-function to be made more flexible. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-91) Allow external tables with different partition directory structure
[ https://issues.apache.org/jira/browse/HIVE-91?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johan Oskarsson updated HIVE-91: Attachment: HIVE-91.patch Updated patch with the suggestions mentioned. Prasad, can you have a look and make sure I got everything right? Also removed the constraint that it has to be an external table. Allow external tables with different partition directory structure -- Key: HIVE-91 URL: https://issues.apache.org/jira/browse/HIVE-91 Project: Hadoop Hive Issue Type: Improvement Components: Metastore Reporter: Johan Oskarsson Assignee: Johan Oskarsson Priority: Minor Attachments: HIVE-91.patch, HIVE-91.patch A lot of users have datasets in a directory structures similar to this in hdfs: /dataset//MM/dd/one or more files Instead of loading these into Hive the normal way it would be useful to create an external table with the /dataset location and then one partition per /mm/dd. This would require the partition naming to directory-function to be made more flexible. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-91) Allow external tables with different partition directory structure
[ https://issues.apache.org/jira/browse/HIVE-91?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johan Oskarsson updated HIVE-91: Attachment: HIVE-91.patch This patch allows a user to specify a location when adding a partition as seen in the example query above. The location is relative to the table location. There's also a unit test included. Allow external tables with different partition directory structure -- Key: HIVE-91 URL: https://issues.apache.org/jira/browse/HIVE-91 Project: Hadoop Hive Issue Type: Improvement Components: Metastore Reporter: Johan Oskarsson Assignee: Johan Oskarsson Priority: Minor Attachments: HIVE-91.patch A lot of users have datasets in a directory structures similar to this in hdfs: /dataset//MM/dd/one or more files Instead of loading these into Hive the normal way it would be useful to create an external table with the /dataset location and then one partition per /mm/dd. This would require the partition naming to directory-function to be made more flexible. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.