[jira] Commented: (HIVE-207) Change SerDe API to allow skipping unused columns

2009-01-08 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12662175#action_12662175 ] Joydeep Sen Sarma commented on HIVE-207: I like Zheng's proposal. The only thing tha

[jira] Commented: (HIVE-207) Change SerDe API to allow skipping unused columns

2009-01-08 Thread Prasad Chakka (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12662133#action_12662133 ] Prasad Chakka commented on HIVE-207: i thought we could pull some code from DynamicSerDe

[jira] Commented: (HIVE-207) Change SerDe API to allow skipping unused columns

2009-01-08 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12662130#action_12662130 ] Zheng Shao commented on HIVE-207: - It's not trivial to write a thrift DDL to ColumnInfo/TypeI

[jira] Commented: (HIVE-207) Change SerDe API to allow skipping unused columns

2009-01-08 Thread Prasad Chakka (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12662106#action_12662106 ] Prasad Chakka commented on HIVE-207: another way of doing this is add a new function to

[jira] Commented: (HIVE-207) Change SerDe API to allow skipping unused columns

2009-01-08 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12662103#action_12662103 ] Zheng Shao commented on HIVE-207: - @Jeff: see http://wiki.apache.org/hadoop/Hive/DeveloperGu

[jira] Commented: (HIVE-207) Change SerDe API to allow skipping unused columns

2009-01-07 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12661859#action_12661859 ] Joydeep Sen Sarma commented on HIVE-207: @Zheng - i finally grokked at the Dynamic Se

[jira] Commented: (HIVE-207) Change SerDe API to allow skipping unused columns

2009-01-06 Thread Prasad Chakka (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12661462#action_12661462 ] Prasad Chakka commented on HIVE-207: may be make DDL available to serde through TypeInfo

[jira] Commented: (HIVE-207) Change SerDe API to allow skipping unused columns

2009-01-06 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12661424#action_12661424 ] Zheng Shao commented on HIVE-207: - @Joydeep - Yes DynamicSerDe is just a parser for thrift DD

[jira] Commented: (HIVE-207) Change SerDe API to allow skipping unused columns

2009-01-06 Thread Jeff Hammerbacher (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12661380#action_12661380 ] Jeff Hammerbacher commented on HIVE-207: I learned a lot, too. Could someone with a h

[jira] Commented: (HIVE-207) Change SerDe API to allow skipping unused columns

2009-01-06 Thread David Phillips (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12661371#action_12661371 ] David Phillips commented on HIVE-207: - Thank you for the detailed explanations. I now ha

[jira] Commented: (HIVE-207) Change SerDe API to allow skipping unused columns

2009-01-05 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12660987#action_12660987 ] Joydeep Sen Sarma commented on HIVE-207: @Zheng - can we get lazy deserialization usi

[jira] Commented: (HIVE-207) Change SerDe API to allow skipping unused columns

2009-01-05 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12660963#action_12660963 ] Zheng Shao commented on HIVE-207: - Our current SerDe framework is designed for allowing lazy

[jira] Commented: (HIVE-207) Change SerDe API to allow skipping unused columns

2009-01-05 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12660950#action_12660950 ] Joydeep Sen Sarma commented on HIVE-207: one thing about the SerDe/Objectinspector st

[jira] Commented: (HIVE-207) Change SerDe API to allow skipping unused columns

2009-01-05 Thread David Phillips (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12660922#action_12660922 ] David Phillips commented on HIVE-207: - Thanks, I'll give that a try. I haven't dug into

[jira] Commented: (HIVE-207) Change SerDe API to allow skipping unused columns

2009-01-05 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12660832#action_12660832 ] Joydeep Sen Sarma commented on HIVE-207: the deserializer api does get one column at