Re: writing your own custom map-reduce to scan a table

How about using HCatalogue? I heard it's made for that kind of works. 2012/8/18 Mahsa Mofidpoor mofidp...@gmail.com Hi all, Does anybody know how you can write your own custom mapReduce to scan a table? Thank you in advance for your response. Mahsa

Re: writing your own custom map-reduce to scan a table

Hi, I am not sure to understand why this question is asked in the dev mailing list of hive. You will have more answer using common hadoop or hbase mailing lists. The answer is that you have to use a custom InputFormat for HBase like TableInputFormat

[jira] [Updated] (HIVE-3394) Refactor a few classes' constructors with creational patterns

[ https://issues.apache.org/jira/browse/HIVE-3394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach updated HIVE-3394: - Status: Open (was: Patch Available) Refactor a few classes' constructors with creational

[jira] [Commented] (HIVE-3394) Refactor a few classes' constructors with creational patterns

[ https://issues.apache.org/jira/browse/HIVE-3394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13437715#comment-13437715 ] Carl Steinbach commented on HIVE-3394: -- @Tim: Thanks for taking time to look into

[jira] [Updated] (HIVE-3072) Hive List Bucketing - DDL support

[ https://issues.apache.org/jira/browse/HIVE-3072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach updated HIVE-3072: - Status: Open (was: Patch Available) @Tim: please see my comments on phabricator. Thanks.

[jira] [Updated] (HIVE-2419) CREATE TABLE AS SELECT should create warehouse directory

[ https://issues.apache.org/jira/browse/HIVE-2419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhuoluo (Clark) Yang updated HIVE-2419: --- Attachment: HIVE-2419.1.patch This is an annoying problem, especially for new hive

Build failed in Jenkins: Hive-0.9.1-SNAPSHOT-h0.21-keepgoing=false #111

See https://builds.apache.org/job/Hive-0.9.1-SNAPSHOT-h0.21-keepgoing=false/111/ -- [...truncated 10116 lines...] [echo] Project: odbc [copy] Warning:

[jira] [Commented] (HIVE-3394) Refactor a few classes' constructors with creational patterns

[ https://issues.apache.org/jira/browse/HIVE-3394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13438007#comment-13438007 ] Gang Tim Liu commented on HIVE-3394: @Carl, great! will address them and have a patch

[jira] [Work started] (HIVE-3394) Refactor a few classes' constructors with creational patterns

[ https://issues.apache.org/jira/browse/HIVE-3394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HIVE-3394 started by Gang Tim Liu. Refactor a few classes' constructors with creational patterns -

[jira] [Commented] (HIVE-775) Hive to support Set type

[ https://issues.apache.org/jira/browse/HIVE-775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13438057#comment-13438057 ] Feng Peng commented on HIVE-775: Is there any objection to supporting Set type? If no, I

[jira] [Created] (HIVE-3398) Hive serde should support empty struct

Feng Peng created HIVE-3398: --- Summary: Hive serde should support empty struct Key: HIVE-3398 URL: https://issues.apache.org/jira/browse/HIVE-3398 Project: Hive Issue Type: Bug

[jira] [Updated] (HIVE-3394) Refactor a few classes' constructors with creational patterns

[ https://issues.apache.org/jira/browse/HIVE-3394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gang Tim Liu updated HIVE-3394: --- Status: Patch Available (was: In Progress) Patch is available in both jira and phabricator. Some

[jira] [Updated] (HIVE-3394) Refactor a few classes' constructors with creational patterns

[ https://issues.apache.org/jira/browse/HIVE-3394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gang Tim Liu updated HIVE-3394: --- Attachment: HIVE-3394.patch.2 Refactor a few classes' constructors with creational patterns

Jenkins build is back to normal : Hive-0.9.1-SNAPSHOT-h0.21 #111

See https://builds.apache.org/job/Hive-0.9.1-SNAPSHOT-h0.21/111/

Hive-trunk-h0.21 - Build # 1618 - Fixed

Changes for Build #1615 [namit] HIVE-2925 - Support non-MR fetching for simple queries with select/limit/filter operations only (Navis via namit) Changes for Build #1616 Changes for Build #1617 Changes for Build #1618 All tests passed The Apache Jenkins build system has built

[jira] [Updated] (HIVE-2049) Push down partition pruning to JDO filtering for a subset of partition predicates

[ https://issues.apache.org/jira/browse/HIVE-2049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach updated HIVE-2049: - Labels: JDO PartitionPruner (was: ) Push down partition pruning to JDO filtering for a

[jira] [Updated] (HIVE-2050) batch processing partition pruning process

[ https://issues.apache.org/jira/browse/HIVE-2050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach updated HIVE-2050: - Labels: PartitionPruner (was: ) batch processing partition pruning process

[jira] [Updated] (HIVE-1609) Support partition filtering in metastore

[ https://issues.apache.org/jira/browse/HIVE-1609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach updated HIVE-1609: - Labels: JDO PartitionPruner (was: ) Support partition filtering in metastore

[jira] [Updated] (HIVE-1862) Revive partition filtering in the Hive MetaStore

[ https://issues.apache.org/jira/browse/HIVE-1862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach updated HIVE-1862: - Labels: JDO PartitionPruner (was: ) Revive partition filtering in the Hive MetaStore

[jira] [Updated] (HIVE-2048) Expedite Partition Pruning

[ https://issues.apache.org/jira/browse/HIVE-2048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach updated HIVE-2048: - Component/s: Query Processor Expedite Partition Pruning --

[jira] [Updated] (HIVE-2048) Expedite Partition Pruning

[ https://issues.apache.org/jira/browse/HIVE-2048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach updated HIVE-2048: - Labels: JDO PartitionPruner (was: ) Expedite Partition Pruning --

[jira] [Updated] (HIVE-3397) PartitionPruner should log why it is not pushing the filter down to JDO

[ https://issues.apache.org/jira/browse/HIVE-3397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach updated HIVE-3397: - Issue Type: Sub-task (was: Bug) Parent: HIVE-2048 PartitionPruner should log why it

[jira] [Updated] (HIVE-1609) Support partition filtering in metastore

[ https://issues.apache.org/jira/browse/HIVE-1609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach updated HIVE-1609: - Description: h1. WARNING: This patch was subsequently disabled in HIVE-1853 due to stability

[jira] [Resolved] (HIVE-3321) 0.23 compatibility: portions of Hive code uses mapred.job.tracker which should be changed to yarn properties

[ https://issues.apache.org/jira/browse/HIVE-3321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Francis Liu resolved HIVE-3321. --- Resolution: Duplicate 0.23 compatibility: portions of Hive code uses mapred.job.tracker which

[jira] [Updated] (HIVE-3242) Fix cascade_dbdrop.q when building hive on hadoop0.23

[ https://issues.apache.org/jira/browse/HIVE-3242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach updated HIVE-3242: - Resolution: Fixed Fix Version/s: 0.10.0 Hadoop Flags: Reviewed Status:

[jira] [Updated] (HIVE-3395) 0.23 compatibility: shim job.tracker.address

[ https://issues.apache.org/jira/browse/HIVE-3395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Francis Liu updated HIVE-3395: -- Status: Patch Available (was: Open) patch is built against trunk 0.23 compatibility:

[jira] [Updated] (HIVE-3056) Ability to bulk update location field in Db/Table/Partition records

[ https://issues.apache.org/jira/browse/HIVE-3056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shreepadma Venugopalan updated HIVE-3056: - Assignee: Shreepadma Venugopalan (was: Carl Steinbach) Status: Patch

[jira] [Updated] (HIVE-3056) Ability to bulk update location field in Db/Table/Partition records

[ https://issues.apache.org/jira/browse/HIVE-3056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shreepadma Venugopalan updated HIVE-3056: - Attachment: HIVE-3056.patch Ability to bulk update location field in

[jira] [Commented] (HIVE-2702) listPartitionsByFilter only supports string partitions

[ https://issues.apache.org/jira/browse/HIVE-2702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13438357#comment-13438357 ] Jakob Homan commented on HIVE-2702: --- This is very limiting for HCat as it means HCat

[jira] [Created] (HIVE-3399) Support getPos() for hbase record reader

Navis created HIVE-3399: --- Summary: Support getPos() for hbase record reader Key: HIVE-3399 URL: https://issues.apache.org/jira/browse/HIVE-3399 Project: Hive Issue Type: Improvement

[jira] [Commented] (HIVE-2623) Add Integer type compressors

[ https://issues.apache.org/jira/browse/HIVE-2623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13438434#comment-13438434 ] Krishna Kumar commented on HIVE-2623: - Hi Rao, I have not been able to do much

[jira] [Work started] (HIVE-3072) Hive List Bucketing - DDL support

[ https://issues.apache.org/jira/browse/HIVE-3072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HIVE-3072 started by Gang Tim Liu. Hive List Bucketing - DDL support - Key: HIVE-3072 URL:

[jira] [Updated] (HIVE-3072) Hive List Bucketing - DDL support

[ https://issues.apache.org/jira/browse/HIVE-3072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gang Tim Liu updated HIVE-3072: --- Attachment: HIVE-3072.patch.3 Hive List Bucketing - DDL support

[jira] [Updated] (HIVE-3072) Hive List Bucketing - DDL support

[ https://issues.apache.org/jira/browse/HIVE-3072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gang Tim Liu updated HIVE-3072: --- Status: Patch Available (was: In Progress) Patch is available on both jira and phabricator.

[jira] [Updated] (HIVE-3072) Hive List Bucketing - DDL support

[ https://issues.apache.org/jira/browse/HIVE-3072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach updated HIVE-3072: - Status: Open (was: Patch Available) @Tim: Please see my comments on phabricator. Thanks.

[jira] [Commented] (HIVE-3072) Hive List Bucketing - DDL support

[ https://issues.apache.org/jira/browse/HIVE-3072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13438451#comment-13438451 ] Gang Tim Liu commented on HIVE-3072: @Carl, thank you very much for quick review. will

[jira] [Commented] (HIVE-775) Hive to support Set type

[ https://issues.apache.org/jira/browse/HIVE-775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13438459#comment-13438459 ] Zheng Shao commented on HIVE-775: - +1 on implementing this data type! Hive

[jira] [Commented] (HIVE-3242) Fix cascade_dbdrop.q when building hive on hadoop0.23

[ https://issues.apache.org/jira/browse/HIVE-3242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13438469#comment-13438469 ] Hudson commented on HIVE-3242: -- Integrated in Hive-trunk-h0.21 #1619 (See

Hive-trunk-h0.21 - Build # 1619 - Failure

Changes for Build #1619 [cws] HIVE-3242. Fix cascade_dbdrop.q when building hive on hadoop0.23 (Zhenxiao Luo via cws) 1 tests failed. REGRESSION: org.apache.hadoop.hive.metastore.TestMetaStoreEventListener.testListener Error Message: java.net.SocketException: Connection reset Stack Trace: