[jira] [Created] (HIVE-17278) Incorrect output timestamp from from_utc_timestamp()/to_utc_timestamp when local timezone has DST

2017-08-08 Thread Leela Krishna (JIRA)
Leela Krishna created HIVE-17278: Summary: Incorrect output timestamp from from_utc_timestamp()/to_utc_timestamp when local timezone has DST Key: HIVE-17278 URL: https://issues.apache.org/jira/browse/HIVE-17278

What more Hive can do when compared to PIG

2014-12-16 Thread Mohan Krishna
*Hello all* *Can somebody help me in getting the answer for the below question* *Its regarding PIG vs HIVE:* We knew that PIG for large data sets analysis and Hive is good at data summrization and adhoc queries. But,I want to know , an usecase where Hive can handle it and the same can not be ach

Re: [ANNOUNCE] New Hive PMC Member - Prasad Mujumdar

2014-12-10 Thread Mohan Krishna
Congrats Prasad On Wed, Dec 10, 2014 at 3:47 AM, Carl Steinbach wrote: > I am pleased to announce that Prasad Mujumdar has been elected to the Hive > Project Management Committee. Please join me in congratulating Prasad! > > Thanks. > > - Carl >

Re: dev-ow...@hive.apache.org.

2014-12-04 Thread Mohan Krishna
CI| EPM | MDM > > -Original Message- > From: Mohan Krishna [mailto:mohan.25fe...@gmail.com] > Sent: Thursday, December 04, 2014 1:09 PM > To: dev@hive.apache.org > Subject: Re: dev-ow...@hive.apache.org. > > Thanks alan for the answer/ > So, can i conclude that Hi

Re: dev-ow...@hive.apache.org.

2014-12-04 Thread Mohan Krishna
; set the schema for the table or partition you are reading based on the data > in the file. > > Alan. > > Mohan Krishna > December 3, 2014 at 17:01 > Can Hive handles Unstructured data o it handles only structured data? > Please confirm > > > Thanks

dev-ow...@hive.apache.org.

2014-12-04 Thread Mohan Krishna
Can Hive handles Unstructured data o it handles only structured data? Please confirm Thanks Mohan

[jira] [Created] (HIVE-7290) BoneCP Connection Pooling throwing JDODataStoreException with Hive 0.13.1

2014-06-25 Thread Bala Krishna (JIRA)
Bala Krishna created HIVE-7290: -- Summary: BoneCP Connection Pooling throwing JDODataStoreException with Hive 0.13.1 Key: HIVE-7290 URL: https://issues.apache.org/jira/browse/HIVE-7290 Project: Hive

hive pull request: Kk wb 1228

2013-08-28 Thread krishna-verticloud
Github user krishna-verticloud closed the pull request at: https://github.com/apache/hive/pull/11

hive pull request: Kk wb 1228

2013-08-28 Thread krishna-verticloud
GitHub user krishna-verticloud opened a pull request: https://github.com/apache/hive/pull/11 Kk wb 1228 You can merge this pull request into a Git repository by running: $ git pull https://github.com/VertiPub/hive kk-WB-1228 Alternatively you can review and apply these

[jira] [Updated] (HIVE-4053) Add support for phonetic algorithms in Hive

2013-03-02 Thread Krishna (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna updated HIVE-4053: -- Status: Open (was: Patch Available) I will re-submit the patch > Add support for phone

[jira] [Commented] (HIVE-4053) Add support for phonetic algorithms in Hive

2013-02-26 Thread Krishna (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13587827#comment-13587827 ] Krishna commented on HIVE-4053: --- There are 6 popular phonetic algorithms (as mentione

[jira] [Updated] (HIVE-4053) Add support for phonetic algorithms in Hive

2013-02-26 Thread Krishna (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna updated HIVE-4053: -- Description: Following phonetic algorithms should be considered, which are very useful in search: Soundex

[jira] [Updated] (HIVE-4053) Add support for phonetic algorithms in Hive

2013-02-26 Thread Krishna (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna updated HIVE-4053: -- Description: Following phonetic algorithms should be considered, which are very useful in search: Soundex

[jira] [Updated] (HIVE-4053) Add support for phonetic algorithms in Hive

2013-02-26 Thread Krishna (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna updated HIVE-4053: -- Description: Following phonetic algorithms should be considered, which are very useful in search: Soundex

[jira] [Updated] (HIVE-4053) Add support for phonetic algorithms in Hive

2013-02-26 Thread Krishna (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna updated HIVE-4053: -- Description: Following phonetic algorithms should be considered, which are very useful in search: Soundex

[jira] [Updated] (HIVE-4053) Add support for phonetic algorithms in Hive

2013-02-26 Thread Krishna (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna updated HIVE-4053: -- Description: Following phonetic algorithms should be considered, which are very useful in search: Soundex

[jira] [Updated] (HIVE-4053) Add support for phonetic algorithms in Hive

2013-02-26 Thread Krishna (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna updated HIVE-4053: -- Description: Following phonetic algorithms should be considered, which are very useful in search: Soundex: ttp

[jira] [Commented] (HIVE-4053) Add support for phonetic algorithms in Hive

2013-02-25 Thread Krishna (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13586499#comment-13586499 ] Krishna commented on HIVE-4053: --- I have submitted the patch; please review the

[jira] [Updated] (HIVE-4053) Add support for phonetic algorithms in Hive

2013-02-25 Thread Krishna (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna updated HIVE-4053: -- Fix Version/s: 0.10.0 Labels: patch (was: ) Affects Version/s: 0.10.0 Release

[jira] [Commented] (HIVE-4053) Add support for phonetic algorithms in Hive

2013-02-25 Thread Krishna (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13586422#comment-13586422 ] Krishna commented on HIVE-4053: --- I've attached the patch to JIRA. How do I po

[jira] [Updated] (HIVE-4053) Add support for phonetic algorithms in Hive

2013-02-25 Thread Krishna (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna updated HIVE-4053: -- Attachment: HIVE-4053.1.patch.txt > Add support for phonetic algorithms in H

[jira] [Updated] (HIVE-4053) Add support for phonetic algorithms in Hive

2013-02-22 Thread Krishna (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna updated HIVE-4053: -- Attachment: GenericUDFRefinedSoundex.java FunctionRegistry.java > Add support for phone

[jira] [Commented] (HIVE-4053) Add support for phonetic algorithms in Hive

2013-02-22 Thread Krishna (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13585025#comment-13585025 ] Krishna commented on HIVE-4053: --- I've implemented 'Refined Soundex'

HIVE-4053 | Review request

2013-02-22 Thread Krishna
; 6 * L => 7 * M, N => 8 * R => 9 * Other letters => 0 Consecutive letters belonging to the same group are replaced by one letter Example: > SELECT soundex_ref('Carren') FROM src LIMIT 1; > C30908 Thanks, Krishna

[jira] [Updated] (HIVE-4053) Add support for phonetic algorithms in Hive

2013-02-22 Thread Krishna (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna updated HIVE-4053: -- Description: Following phonetic algorithms should be considered, which are very useful in search: Soundex

[jira] [Updated] (HIVE-4053) Add support for phonetic algorithms in Hive

2013-02-21 Thread Krishna (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna updated HIVE-4053: -- Affects Version/s: (was: 0.10.0) > Add support for phonetic algorithms in H

[jira] [Commented] (HIVE-4053) Add support for phonetic algorithms in Hive

2013-02-21 Thread Krishna (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13583819#comment-13583819 ] Krishna commented on HIVE-4053: --- Soundex: http://en.wikipedia.org/wiki/Soundex Da

[jira] [Commented] (HIVE-2623) Add Integer type compressors

2012-08-20 Thread Krishna Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13438434#comment-13438434 ] Krishna Kumar commented on HIVE-2623: - Hi Rao, I have not been able to do

[jira] [Updated] (HIVE-2097) Explore mechanisms for better compression with RC Files

2012-05-14 Thread Krishna Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2097: Attachment: datacomp.tar.gz unrefactored source for all the implemented compression codecs

[jira] [Commented] (HIVE-2623) Add Integer type compressors

2012-02-13 Thread Krishna Kumar (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13206967#comment-13206967 ] Krishna Kumar commented on HIVE-2623: - I will attach cpu usage information

[jira] [Created] (HIVE-2692) Add compressors for qualitative data types

2012-01-04 Thread Krishna Kumar (Created) (JIRA)
Reporter: Krishna Kumar Assignee: Krishna Kumar Priority: Minor Any data type (int, string et al) for which the frequency of occurrences can be counted (a.k.a. categorical or enumeration types), can be compressed via methods such as huffman, arithmetic and ppm compressors

[jira] [Updated] (HIVE-2623) Add Integer type compressors

2011-12-22 Thread Krishna Kumar (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2623: Status: Patch Available (was: Open) > Add Integer type compress

[jira] [Commented] (HIVE-2623) Add Integer type compressors

2011-12-22 Thread Krishna Kumar (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13174824#comment-13174824 ] Krishna Kumar commented on HIVE-2623: - Compression efficiency stats (unary is opt

[jira] [Updated] (HIVE-2623) Add Integer type compressors

2011-12-22 Thread Krishna Kumar (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2623: Attachment: (was: steppedpowerlawTimestamp.gz) > Add Integer type compress

[jira] [Updated] (HIVE-2623) Add Integer type compressors

2011-12-22 Thread Krishna Kumar (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2623: Attachment: data.tar.gz Artificial data sets for the 8 integer compressors. >

[jira] [Updated] (HIVE-2623) Add Integer type compressors

2011-12-22 Thread Krishna Kumar (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2623: Attachment: (was: steppedpowerlaw1S.gz) > Add Integer type compress

[jira] [Updated] (HIVE-2623) Add Integer type compressors

2011-12-22 Thread Krishna Kumar (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2623: Attachment: (was: steppedpowerlaw2S.gz) > Add Integer type compress

[jira] [Updated] (HIVE-2623) Add Integer type compressors

2011-12-22 Thread Krishna Kumar (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2623: Attachment: (was: steppedpowerlawIQ.gz) > Add Integer type compress

[jira] [Updated] (HIVE-2623) Add Integer type compressors

2011-12-22 Thread Krishna Kumar (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2623: Attachment: HIVE-2623.v2.patch Added another simple integer coder (unary) and the four variants of

[jira] [Updated] (HIVE-2604) Add UberCompressor Serde/Codec to contrib which allows per-column compression strategies

2011-12-22 Thread Krishna Kumar (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2604: Component/s: (was: Query Processor) (was: Serializers/Deserializers

[jira] [Updated] (HIVE-2623) Add Integer type compressors

2011-12-22 Thread Krishna Kumar (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2623: Component/s: (was: Query Processor) (was: Serializers/Deserializers

[jira] [Updated] (HIVE-2604) Add UberCompressor Serde/Codec to contrib which allows per-column compression strategies

2011-12-17 Thread Krishna Kumar (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2604: Attachment: HIVE-2604.v2.patch > Add UberCompressor Serde/Codec to contrib which allows

Re: Review Request: Add UberCompressor Serde/Codec to contrib which allows per-column compression strategies

2011-12-17 Thread Krishna
/clientpositive/ubercompressor.q PRE-CREATION contrib/src/test/results/clientpositive/ubercompressor.q.out PRE-CREATION Diff: https://reviews.apache.org/r/3075/diff Testing --- test added Thanks, Krishna

[jira] [Commented] (HIVE-2604) Add UberCompressor Serde/Codec to contrib which allows per-column compression strategies

2011-12-08 Thread Krishna Kumar (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13165815#comment-13165815 ] Krishna Kumar commented on HIVE-2604: - :) I used the word Uber, not in the sens

[jira] [Updated] (HIVE-2600) Enable/Add type-specific compression for rcfile

2011-12-08 Thread Krishna Kumar (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2600: Status: Patch Available (was: Open) > Enable/Add type-specific compression for rcf

[jira] [Updated] (HIVE-2604) Add UberCompressor Serde/Codec to contrib which allows per-column compression strategies

2011-12-08 Thread Krishna Kumar (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2604: Status: Patch Available (was: Open) > Add UberCompressor Serde/Codec to contrib which all

Review Request: Add UberCompressor Serde/Codec to contrib which allows per-column compression strategies

2011-12-08 Thread Krishna
/ubercompressor/TypeSpecificCompressor.java PRE-CREATION contrib/src/java/org/apache/hadoop/hive/contrib/ubercompressor/UberCompressionCodec.java PRE-CREATION Diff: https://reviews.apache.org/r/3075/diff Testing --- test added Thanks, Krishna

[jira] [Updated] (HIVE-2604) Add UberCompressor Serde/Codec to contrib which allows per-column compression strategies

2011-12-08 Thread Krishna Kumar (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2604: Attachment: HIVE-2604.v1.patch Serde wraps lazysimpleserde to make it more similar to columnarserde

Review Request: Adding two interfaces for schema-aware codecs and their invocations from appropriate places in rcfile

2011-12-07 Thread Krishna
-CREATION ql/src/java/org/apache/hadoop/hive/ql/io/SchemaAwareCompressionOutputStream.java PRE-CREATION ql/src/java/org/apache/hadoop/hive/ql/io/RCFile.java b15fdb8 Diff: https://reviews.apache.org/r/3051/diff Testing --- Thanks, Krishna

[jira] [Commented] (HIVE-2623) Add Integer type compressors

2011-12-06 Thread Krishna Kumar (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13163437#comment-13163437 ] Krishna Kumar commented on HIVE-2623: - RCFile size stats: gzip/bzip2/

[jira] [Updated] (HIVE-2623) Add Integer type compressors

2011-12-06 Thread Krishna Kumar (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2623: Attachment: HIVE-2623.v1.patch Added 3 three more elias gamma compressors - so now supporting one

[jira] [Updated] (HIVE-2623) Add Integer type compressors

2011-12-06 Thread Krishna Kumar (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2623: Attachment: steppedpowerlawTimestamp.gz steppedpowerlawIQ.gz

[jira] [Updated] (HIVE-2623) Add Integer type compressors

2011-12-06 Thread Krishna Kumar (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2623: Attachment: (was: steppedpowerlaw.gz) > Add Integer type compress

[jira] [Commented] (HIVE-2604) Add UberCompressor Serde/Codec to contrib which allows per-column compression strategies

2011-12-05 Thread Krishna Kumar (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13162709#comment-13162709 ] Krishna Kumar commented on HIVE-2604: - The current implementation works as fol

[jira] [Commented] (HIVE-2600) Enable/Add type-specific compression for rcfile

2011-12-05 Thread Krishna Kumar (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13162705#comment-13162705 ] Krishna Kumar commented on HIVE-2600: - He Yongqiang, In UberCompressor, I have

[jira] [Updated] (HIVE-2623) Add Integer type compressors

2011-12-05 Thread Krishna Kumar (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2623: Attachment: steppedpowerlaw.gz Synthetic data for elias gamma. Storage size when stored as rc

[jira] [Updated] (HIVE-2623) Add Integer type compressors

2011-12-05 Thread Krishna Kumar (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2623: Attachment: HIVE-2623.v0.patch Elias gamma for a two-sided distribution. Draft only - tests and one

[jira] [Created] (HIVE-2623) Add Integer type compressors

2011-12-05 Thread Krishna Kumar (Created) (JIRA)
Add Integer type compressors Key: HIVE-2623 URL: https://issues.apache.org/jira/browse/HIVE-2623 Project: Hive Issue Type: Sub-task Reporter: Krishna Kumar Assignee: Krishna Kumar

[jira] [Commented] (HIVE-2600) Enable/Add type-specific compression for rcfile

2011-11-29 Thread Krishna Kumar (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13159734#comment-13159734 ] Krishna Kumar commented on HIVE-2600: - That is part of the compression codec

[jira] [Commented] (HIVE-2600) Enable/Add type-specific compression for rcfile

2011-11-28 Thread Krishna Kumar (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13159122#comment-13159122 ] Krishna Kumar commented on HIVE-2600: - I have chosen to record that information in

[jira] [Updated] (HIVE-2600) Enable/Add type-specific compression for rcfile

2011-11-28 Thread Krishna Kumar (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2600: Attachment: HIVE-2600.v1.patch Added logging to report every column's total le

[jira] [Commented] (HIVE-2097) Explore mechanisms for better compression with RC Files

2011-11-28 Thread Krishna Kumar (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13158484#comment-13158484 ] Krishna Kumar commented on HIVE-2097: - Thanks Alex for the suggestions. Just t

[jira] [Commented] (HIVE-2604) Add UberCompressor Serde/Codec to contrib which allows per-column compression strategies

2011-11-24 Thread Krishna Kumar (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13156758#comment-13156758 ] Krishna Kumar commented on HIVE-2604: - Sure. I'll add some of the compressors

[jira] [Assigned] (HIVE-2604) Add UberCompressor Serde/Codec to contrib which allows per-column compression strategies

2011-11-23 Thread Krishna Kumar (Assigned) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar reassigned HIVE-2604: --- Assignee: Krishna Kumar > Add UberCompressor Serde/Codec to contrib which allows

[jira] [Commented] (HIVE-2600) Enable/Add type-specific compression for rcfile

2011-11-23 Thread Krishna Kumar (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13156006#comment-13156006 ] Krishna Kumar commented on HIVE-2600: - Added the code for uber codec/serde to

[jira] [Updated] (HIVE-2604) Add UberCompressor Serde/Codec to contrib which allows per-column compression strategies

2011-11-23 Thread Krishna Kumar (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2604: Attachment: HIVE-2604.v0.patch initial version of the patch. > Add UberCompres

[jira] [Created] (HIVE-2604) Add UberCompressor Serde/Codec to contrib which allows per-column compression strategies

2011-11-23 Thread Krishna Kumar (Created) (JIRA)
Project: Hive Issue Type: Sub-task Reporter: Krishna Kumar The strategies supported are 1. using a specified codec on the column 2. using a specific codec on the column which is serialized via a specific serde 3. using a specific "TypeSpecificCompressor" instanc

[jira] [Commented] (HIVE-2600) Enable/Add type-specific compression for rcfile

2011-11-22 Thread Krishna Kumar (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13155228#comment-13155228 ] Krishna Kumar commented on HIVE-2600: - This should be usable for any rcfile data.

[jira] [Updated] (HIVE-2600) Enable/Add type-specific compression for rcfile

2011-11-20 Thread Krishna Kumar (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2600: Status: Patch Available (was: Open) > Enable/Add type-specific compression for rcf

[jira] [Updated] (HIVE-2600) Enable/Add type-specific compression for rcfile

2011-11-20 Thread Krishna Kumar (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2600: Attachment: HIVE-2600.v0.patch Added two interfaces and invocations at appropriate places

[jira] [Updated] (HIVE-2600) Enable/Add type-specific compression for rcfile

2011-11-20 Thread Krishna Kumar (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2600: Description: Enable schema-aware compression codecs which can perform type-specific compression on

[jira] [Created] (HIVE-2600) Enable/Add type-specific compression for rcfile

2011-11-20 Thread Krishna Kumar (Created) (JIRA)
, Serializers/Deserializers Reporter: Krishna Kumar Assignee: Krishna Kumar Priority: Minor Enable schema-aware compression codecs which can perform type-specific compression on a per-column basis. I see this as in three-parts 1. Add interfaces for the rcfile to

[jira] [Updated] (HIVE-2413) BlockMergeTask ignores client-specified jars

2011-09-01 Thread Krishna Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2413: Attachment: HIVE-2413.v1.patch Empty string not handled correctly in JC so handling it here

[jira] [Updated] (HIVE-2417) Merging of compressed rcfiles fails to write the valuebuffer part correctly

2011-08-30 Thread Krishna Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2417: Attachment: HIVE-2417.v1.patch Test changed after review comments - default codec instead of bzip2

[jira] [Commented] (HIVE-2417) Merging of compressed rcfiles fails to write the valuebuffer part correctly

2011-08-30 Thread Krishna Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13094294#comment-13094294 ] Krishna Kumar commented on HIVE-2417: - Yes, the test is designed to produce the e

[jira] [Updated] (HIVE-2413) BlockMergeTask ignores client-specified jars

2011-08-29 Thread Krishna Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2413: Assignee: Krishna Kumar Status: Patch Available (was: Open) > BlockMergeTask ignores cli

[jira] [Updated] (HIVE-2417) Merging of compressed rcfiles fails to write the valuebuffer part correctly

2011-08-29 Thread Krishna Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2417: Status: Patch Available (was: Open) > Merging of compressed rcfiles fails to write the valuebuf

[jira] [Updated] (HIVE-2417) Merging of compressed rcfiles fails to write the valuebuffer part correctly

2011-08-29 Thread Krishna Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2417: Attachment: HIVE-2417.v0.patch Test added > Merging of compressed rcfiles fails to write

[jira] [Created] (HIVE-2417) Merging of compressed rcfiles fails to write the valuebuffer part correctly

2011-08-29 Thread Krishna Kumar (JIRA)
Type: Bug Components: Query Processor Reporter: Krishna Kumar Assignee: Krishna Kumar Attachments: HIVE-2417.v0.patch The blockmerge task does not create proper rc files when merging compressed rc files as the valuebuffer writing is incorrect. -- This

[jira] [Updated] (HIVE-2413) BlockMergeTask ignores client-specified jars

2011-08-25 Thread Krishna Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2413: Attachment: HIVE-2413.v0.patch Here is a simple fix which works for me, though there may be better

[jira] [Created] (HIVE-2413) BlockMergeTask ignores client-specified jars

2011-08-25 Thread Krishna Kumar (JIRA)
Reporter: Krishna Kumar Priority: Minor User-specified jars are not added to the hadoop tasks while executing a BlockMergeTask resulting in a ClassNotFoundException. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software

[jira] [Updated] (HIVE-2384) import of multiple partitions from a partitioned table with external location overwrites files

2011-08-17 Thread Krishna Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2384: Attachment: HIVE-2384.v0.patch Patch with tests > import of multiple partitions from a partitio

[jira] [Updated] (HIVE-2384) import of multiple partitions from a partitioned table with external location overwrites files

2011-08-17 Thread Krishna Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2384: Assignee: Krishna Kumar Status: Patch Available (was: Open) > import of multiple partiti

[jira] [Created] (HIVE-2384) import of multiple partitions from a partitioned table with external location overwrites files

2011-08-17 Thread Krishna Kumar (JIRA)
Project: Hive Issue Type: Bug Components: Query Processor Reporter: Krishna Kumar when we import multiple partitions from an exported partitioned table, if we import it with a specified external location, then the partitions end up overwriting. -- This

Re: Review Request: Patch for Hive-2209, extending ObjectInspectorUtils.compare with some map comparison implementations

2011-07-19 Thread Krishna
/apache/hadoop/hive/serde2/objectinspector/TestSimpleMapEqualComparer.java PRE-CREATION Diff: https://reviews.apache.org/r/879/diff Testing --- Tests added Thanks, Krishna

[jira] [Commented] (HIVE-956) Add support of columnar binary serde

2011-07-19 Thread Krishna Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13067588#comment-13067588 ] Krishna Kumar commented on HIVE-956: Common code moved to a base class to

[jira] [Updated] (HIVE-956) Add support of columnar binary serde

2011-07-19 Thread Krishna Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-956: --- Attachment: HIVE-956v4.patch Please note that HIVE-2209 is a pre-requisite for this patch. >

Re Stats Publishing /Aggregation

2011-06-20 Thread Krishna Kumar
Any reason why persistent stores such as jdbc and hbase are supported for temporary stats storage IIUC, but hadoop counters were not used for the tasks to 'publish' their stats for the aggregation task to pick it up from? Cheers, Krishna

[jira] [Updated] (HIVE-956) Add support of columnar binary serde

2011-06-20 Thread Krishna Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-956: --- Status: Patch Available (was: Open) I have tested the setting of rawDataSize with a "ANALYZE

[jira] [Updated] (HIVE-956) Add support of columnar binary serde

2011-06-20 Thread Krishna Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-956: --- Attachment: HIVE-956v3.patch After separating mapcomparer changes to its own jira/patch - HIVE-2209

Re: Review Request: Add LazyBinaryColumnarSerDe

2011-06-20 Thread Krishna
/TestLazyBinaryColumnarSerDe.java PRE-CREATION Diff: https://reviews.apache.org/r/806/diff Testing --- Tests added Thanks, Krishna

[jira] [Updated] (HIVE-2209) Provide a way by which ObjectInspectorUtils.compare can be extended by the caller for comparing maps which are part of the object

2011-06-20 Thread Krishna Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2209: Attachment: HIVE-2209v2.patch Fixed a lowercase/uppercase typo in the test classes > Provide a

Re: Review Request: Patch for Hive-2209, extending ObjectInspectorUtils.compare with some map comparison implementations

2011-06-20 Thread Krishna
/apache/hadoop/hive/serde2/objectinspector/TestSimpleMapEqualComparer.java PRE-CREATION Diff: https://reviews.apache.org/r/879/diff Testing --- Tests added Thanks, Krishna

[jira] [Updated] (HIVE-2209) Provide a way by which ObjectInspectorUtils.compare can be extended by the caller for comparing maps which are part of the object

2011-06-17 Thread Krishna Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2209: Attachment: HIVE2209v1.patch Added another implementation with sorting of the keys > Provide a

Re: Review Request: Patch for Hive-2209, extending ObjectInspectorUtils.compare with some map comparison implementations

2011-06-17 Thread Krishna
/src/test/org/apache/hadoop/hive/serde2/objectinspector/TestSimpleMapEqualcomparer.java PRE-CREATION Diff: https://reviews.apache.org/r/879/diff Testing --- Tests added Thanks, Krishna

[jira] [Commented] (HIVE-2209) Provide a way by which ObjectInspectorUtils.compare can be extended by the caller for comparing maps which are part of the object

2011-06-14 Thread Krishna Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13049297#comment-13049297 ] Krishna Kumar commented on HIVE-2209: - He Yongqiang, Can you take a look at this

Review Request: Patch for Hive-2209, extending ObjectInspectorUtils.compare with some map comparison implementations

2011-06-10 Thread Krishna
/objectinspector/TestSimpleMapEqualcomparer.java PRE-CREATION Diff: https://reviews.apache.org/r/879/diff Testing --- Tests added Thanks, Krishna

[jira] [Updated] (HIVE-2209) Provide a way by which ObjectInspectorUtils.compare can be extended by the caller for comparing maps which are part of the object

2011-06-10 Thread Krishna Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2209: Status: Patch Available (was: Open) For review by He Yongqiang > Provide a way by wh

[jira] [Updated] (HIVE-2209) Provide a way by which ObjectInspectorUtils.compare can be extended by the caller for comparing maps which are part of the object

2011-06-10 Thread Krishna Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2209: Attachment: HIVE-2209v0.patch Patch, with tests, added. > Provide a way by wh

[jira] [Updated] (HIVE-2209) Provide a way by which ObjectInspectorUtils.compare can be extended by the caller for comparing maps which are part of the object

2011-06-09 Thread Krishna Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2209: Issue Type: Improvement (was: Sub-task) Parent: (was: HIVE-956) > Provide a way

  1   2   >