[jira] [Updated] (HIVE-7231) Improve ORC padding

2014-06-13 Thread Prasanth J (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-7231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Prasanth J updated HIVE-7231:
-

Status: Patch Available  (was: Open)

> Improve ORC padding
> ---
>
> Key: HIVE-7231
> URL: https://issues.apache.org/jira/browse/HIVE-7231
> Project: Hive
>  Issue Type: Improvement
>  Components: File Formats
>Affects Versions: 0.14.0
>Reporter: Prasanth J
>Assignee: Prasanth J
>  Labels: orcfile
> Attachments: HIVE-7231.1.patch
>
>
> Current ORC padding is not optimal because of fixed stripe sizes within 
> block. The padding overhead will be significant in some cases. Also padding 
> percentage relative to stripe size is not configurable.



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Updated] (HIVE-7231) Improve ORC padding

2014-06-13 Thread Prasanth J (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-7231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Prasanth J updated HIVE-7231:
-

Attachment: HIVE-7231.1.patch

> Improve ORC padding
> ---
>
> Key: HIVE-7231
> URL: https://issues.apache.org/jira/browse/HIVE-7231
> Project: Hive
>  Issue Type: Improvement
>  Components: File Formats
>Affects Versions: 0.14.0
>Reporter: Prasanth J
>Assignee: Prasanth J
>  Labels: orcfile
> Attachments: HIVE-7231.1.patch
>
>
> Current ORC padding is not optimal because of fixed stripe sizes within 
> block. The padding overhead will be significant in some cases. Also padding 
> percentage relative to stripe size is not configurable.



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Updated] (HIVE-7231) Improve ORC padding

2014-06-16 Thread Prasanth J (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-7231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Prasanth J updated HIVE-7231:
-

Attachment: HIVE-7231.2.patch

Fixed failed test cases.

> Improve ORC padding
> ---
>
> Key: HIVE-7231
> URL: https://issues.apache.org/jira/browse/HIVE-7231
> Project: Hive
>  Issue Type: Improvement
>  Components: File Formats
>Affects Versions: 0.14.0
>Reporter: Prasanth J
>Assignee: Prasanth J
>  Labels: orcfile
> Attachments: HIVE-7231.1.patch, HIVE-7231.2.patch
>
>
> Current ORC padding is not optimal because of fixed stripe sizes within 
> block. The padding overhead will be significant in some cases. Also padding 
> percentage relative to stripe size is not configurable.



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Updated] (HIVE-7231) Improve ORC padding

2014-06-19 Thread Prasanth J (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-7231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Prasanth J updated HIVE-7231:
-

Attachment: HIVE-7231.3.patch

> Improve ORC padding
> ---
>
> Key: HIVE-7231
> URL: https://issues.apache.org/jira/browse/HIVE-7231
> Project: Hive
>  Issue Type: Improvement
>  Components: File Formats
>Affects Versions: 0.14.0
>Reporter: Prasanth J
>Assignee: Prasanth J
>  Labels: orcfile
> Attachments: HIVE-7231.1.patch, HIVE-7231.2.patch, HIVE-7231.3.patch
>
>
> Current ORC padding is not optimal because of fixed stripe sizes within 
> block. The padding overhead will be significant in some cases. Also padding 
> percentage relative to stripe size is not configurable.



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Updated] (HIVE-7231) Improve ORC padding

2014-06-28 Thread Gopal V (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-7231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Gopal V updated HIVE-7231:
--

Attachment: HIVE-7231.4.patch

Rebase to trunk

> Improve ORC padding
> ---
>
> Key: HIVE-7231
> URL: https://issues.apache.org/jira/browse/HIVE-7231
> Project: Hive
>  Issue Type: Improvement
>  Components: File Formats
>Affects Versions: 0.14.0
>Reporter: Prasanth J
>Assignee: Prasanth J
>  Labels: orcfile
> Attachments: HIVE-7231.1.patch, HIVE-7231.2.patch, HIVE-7231.3.patch, 
> HIVE-7231.4.patch
>
>
> Current ORC padding is not optimal because of fixed stripe sizes within 
> block. The padding overhead will be significant in some cases. Also padding 
> percentage relative to stripe size is not configurable.



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Updated] (HIVE-7231) Improve ORC padding

2014-06-28 Thread Gopal V (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-7231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Gopal V updated HIVE-7231:
--

Status: Patch Available  (was: Open)

> Improve ORC padding
> ---
>
> Key: HIVE-7231
> URL: https://issues.apache.org/jira/browse/HIVE-7231
> Project: Hive
>  Issue Type: Improvement
>  Components: File Formats
>Affects Versions: 0.14.0
>Reporter: Prasanth J
>Assignee: Prasanth J
>  Labels: orcfile
> Attachments: HIVE-7231.1.patch, HIVE-7231.2.patch, HIVE-7231.3.patch, 
> HIVE-7231.4.patch
>
>
> Current ORC padding is not optimal because of fixed stripe sizes within 
> block. The padding overhead will be significant in some cases. Also padding 
> percentage relative to stripe size is not configurable.



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Updated] (HIVE-7231) Improve ORC padding

2014-06-28 Thread Gopal V (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-7231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Gopal V updated HIVE-7231:
--

Status: Open  (was: Patch Available)

> Improve ORC padding
> ---
>
> Key: HIVE-7231
> URL: https://issues.apache.org/jira/browse/HIVE-7231
> Project: Hive
>  Issue Type: Improvement
>  Components: File Formats
>Affects Versions: 0.14.0
>Reporter: Prasanth J
>Assignee: Prasanth J
>  Labels: orcfile
> Attachments: HIVE-7231.1.patch, HIVE-7231.2.patch, HIVE-7231.3.patch, 
> HIVE-7231.4.patch
>
>
> Current ORC padding is not optimal because of fixed stripe sizes within 
> block. The padding overhead will be significant in some cases. Also padding 
> percentage relative to stripe size is not configurable.



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Updated] (HIVE-7231) Improve ORC padding

2014-06-30 Thread Gopal V (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-7231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Gopal V updated HIVE-7231:
--

Attachment: HIVE-7231.5.patch

Update docs in patch to match [~leftylev]'s RB comments.

> Improve ORC padding
> ---
>
> Key: HIVE-7231
> URL: https://issues.apache.org/jira/browse/HIVE-7231
> Project: Hive
>  Issue Type: Improvement
>  Components: File Formats
>Affects Versions: 0.14.0
>Reporter: Prasanth J
>Assignee: Prasanth J
>  Labels: orcfile
> Attachments: HIVE-7231.1.patch, HIVE-7231.2.patch, HIVE-7231.3.patch, 
> HIVE-7231.4.patch, HIVE-7231.5.patch
>
>
> Current ORC padding is not optimal because of fixed stripe sizes within 
> block. The padding overhead will be significant in some cases. Also padding 
> percentage relative to stripe size is not configurable.



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Updated] (HIVE-7231) Improve ORC padding

2014-06-30 Thread Gopal V (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-7231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Gopal V updated HIVE-7231:
--

Attachment: HIVE-7231.6.patch

Removed the tez-0.4.1 reference and the "&" from the documentation XML.

> Improve ORC padding
> ---
>
> Key: HIVE-7231
> URL: https://issues.apache.org/jira/browse/HIVE-7231
> Project: Hive
>  Issue Type: Improvement
>  Components: File Formats
>Affects Versions: 0.14.0
>Reporter: Prasanth J
>Assignee: Prasanth J
>  Labels: orcfile
> Attachments: HIVE-7231.1.patch, HIVE-7231.2.patch, HIVE-7231.3.patch, 
> HIVE-7231.4.patch, HIVE-7231.5.patch, HIVE-7231.6.patch
>
>
> Current ORC padding is not optimal because of fixed stripe sizes within 
> block. The padding overhead will be significant in some cases. Also padding 
> percentage relative to stripe size is not configurable.



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Updated] (HIVE-7231) Improve ORC padding

2014-07-02 Thread Gopal V (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-7231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Gopal V updated HIVE-7231:
--

Attachment: HIVE-7231.7.patch

Rebase to trunk and update size correction code to reset all corrections to 
stripe sizes made when crossing a block boundary even for the unpadded insert 
case.

> Improve ORC padding
> ---
>
> Key: HIVE-7231
> URL: https://issues.apache.org/jira/browse/HIVE-7231
> Project: Hive
>  Issue Type: Improvement
>  Components: File Formats
>Affects Versions: 0.14.0
>Reporter: Prasanth J
>Assignee: Prasanth J
>  Labels: orcfile
> Attachments: HIVE-7231.1.patch, HIVE-7231.2.patch, HIVE-7231.3.patch, 
> HIVE-7231.4.patch, HIVE-7231.5.patch, HIVE-7231.6.patch, HIVE-7231.7.patch
>
>
> Current ORC padding is not optimal because of fixed stripe sizes within 
> block. The padding overhead will be significant in some cases. Also padding 
> percentage relative to stripe size is not configurable.



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Updated] (HIVE-7231) Improve ORC padding

2014-07-06 Thread Gopal V (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-7231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Gopal V updated HIVE-7231:
--

Attachment: HIVE-7231.8.patch

> Improve ORC padding
> ---
>
> Key: HIVE-7231
> URL: https://issues.apache.org/jira/browse/HIVE-7231
> Project: Hive
>  Issue Type: Improvement
>  Components: File Formats
>Affects Versions: 0.14.0
>Reporter: Prasanth J
>Assignee: Prasanth J
>  Labels: orcfile
> Attachments: HIVE-7231.1.patch, HIVE-7231.2.patch, HIVE-7231.3.patch, 
> HIVE-7231.4.patch, HIVE-7231.5.patch, HIVE-7231.6.patch, HIVE-7231.7.patch, 
> HIVE-7231.8.patch
>
>
> Current ORC padding is not optimal because of fixed stripe sizes within 
> block. The padding overhead will be significant in some cases. Also padding 
> percentage relative to stripe size is not configurable.



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Updated] (HIVE-7231) Improve ORC padding

2014-07-06 Thread Gopal V (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-7231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Gopal V updated HIVE-7231:
--

   Resolution: Fixed
Fix Version/s: 0.14.0
 Release Note: HIVE-7231 : Improve ORC padding (Prasanth J, reviewed by 
Gopal V)
 Hadoop Flags: Reviewed
   Status: Resolved  (was: Patch Available)

Committed to trunk, thanks [~prasanth_j]!

> Improve ORC padding
> ---
>
> Key: HIVE-7231
> URL: https://issues.apache.org/jira/browse/HIVE-7231
> Project: Hive
>  Issue Type: Improvement
>  Components: File Formats
>Affects Versions: 0.14.0
>Reporter: Prasanth J
>Assignee: Prasanth J
>  Labels: orcfile
> Fix For: 0.14.0
>
> Attachments: HIVE-7231.1.patch, HIVE-7231.2.patch, HIVE-7231.3.patch, 
> HIVE-7231.4.patch, HIVE-7231.5.patch, HIVE-7231.6.patch, HIVE-7231.7.patch, 
> HIVE-7231.8.patch
>
>
> Current ORC padding is not optimal because of fixed stripe sizes within 
> block. The padding overhead will be significant in some cases. Also padding 
> percentage relative to stripe size is not configurable.



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Updated] (HIVE-7231) Improve ORC padding

2014-07-07 Thread Lefty Leverenz (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-7231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lefty Leverenz updated HIVE-7231:
-

Labels: TODOC14 orcfile  (was: orcfile)

> Improve ORC padding
> ---
>
> Key: HIVE-7231
> URL: https://issues.apache.org/jira/browse/HIVE-7231
> Project: Hive
>  Issue Type: Improvement
>  Components: File Formats
>Affects Versions: 0.14.0
>Reporter: Prasanth J
>Assignee: Prasanth J
>  Labels: TODOC14, orcfile
> Fix For: 0.14.0
>
> Attachments: HIVE-7231.1.patch, HIVE-7231.2.patch, HIVE-7231.3.patch, 
> HIVE-7231.4.patch, HIVE-7231.5.patch, HIVE-7231.6.patch, HIVE-7231.7.patch, 
> HIVE-7231.8.patch
>
>
> Current ORC padding is not optimal because of fixed stripe sizes within 
> block. The padding overhead will be significant in some cases. Also padding 
> percentage relative to stripe size is not configurable.



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Updated] (HIVE-7231) Improve ORC padding

2014-08-07 Thread Lefty Leverenz (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-7231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lefty Leverenz updated HIVE-7231:
-

Labels: orcfile  (was: TODOC14 orcfile)

> Improve ORC padding
> ---
>
> Key: HIVE-7231
> URL: https://issues.apache.org/jira/browse/HIVE-7231
> Project: Hive
>  Issue Type: Improvement
>  Components: File Formats
>Affects Versions: 0.14.0
>Reporter: Prasanth J
>Assignee: Prasanth J
>  Labels: orcfile
> Fix For: 0.14.0
>
> Attachments: HIVE-7231.1.patch, HIVE-7231.2.patch, HIVE-7231.3.patch, 
> HIVE-7231.4.patch, HIVE-7231.5.patch, HIVE-7231.6.patch, HIVE-7231.7.patch, 
> HIVE-7231.8.patch
>
>
> Current ORC padding is not optimal because of fixed stripe sizes within 
> block. The padding overhead will be significant in some cases. Also padding 
> percentage relative to stripe size is not configurable.



--
This message was sent by Atlassian JIRA
(v6.2#6252)