[jira] Updated: (HIVE-270) Add a lazy-deserialized SerDe for space and cpu efficient serialization of rows with primitive types

2009-02-10 Thread Zheng Shao (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Zheng Shao updated HIVE-270:


Attachment: HIVE-270.3.patch

Added the code to parse byte, short, int, long without doing UTF-8 decoding.
Added test cases (all passed).

Does not include the fix to existing testcase output. The only change is the 
name of the SerDe and that part can be automatically generated by "ant test 
-Doverwrite=true".


> Add a lazy-deserialized SerDe for space and cpu efficient serialization of 
> rows with primitive types
> 
>
> Key: HIVE-270
> URL: https://issues.apache.org/jira/browse/HIVE-270
> Project: Hadoop Hive
>  Issue Type: New Feature
>  Components: Serializers/Deserializers
>Reporter: Zheng Shao
>Assignee: Zheng Shao
> Attachments: HIVE-270.1.patch, HIVE-270.3.patch
>
>
> We want to add a lazy-deserialized SerDe for space and cpu efficient 
> serialization of rows with primitive types.
> This SerDe will share the same format as 
> MetadataTypedColumnsetSerDe/TCTLSeparatedProtocol to be backward compatible.
> This SerDe will be used to replace the default table SerDe, and the SerDe 
> used to communicate with user scripts.
> For simplicity, we don't plan to support nested structure with this SerDe.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



RE: Implementing Timestamp (HIVE-192)

2009-02-10 Thread Shyam Sarkar
Thank you all. I am looking forward to your help to solve various issues.

Regards,
Shyam



--- On Tue, 2/10/09, Ashish Thusoo  wrote:

> From: Ashish Thusoo 
> Subject: RE: Implementing Timestamp (HIVE-192)
> To: "hive-dev@hadoop.apache.org" 
> Date: Tuesday, February 10, 2009, 11:01 AM
> Go for it Shyam...
> 
> All of us are available for help on this mailing list and
> we do hop onto the irc channel from time to time
> 
> Ashish 
> 
> -Original Message-
> From: Johan Oskarsson [mailto:jo...@oskarsson.nu] 
> Sent: Tuesday, February 10, 2009 2:06 AM
> To: hive-dev@hadoop.apache.org
> Subject: Re: Implementing Timestamp (HIVE-192)
> 
> The ticket hasn't been commented on so I'm going to
> assume that nobody is working on it, so please do go ahead
> and have a go at it.
> 
> As for who you should talk to, someone on this list should
> probably jump in, but the committers are a good start:
> http://hadoop.apache.org/hive/credits.html
> 
> There's also an IRC channel where some of them pop in
> now and again:
> ##hive at irc.freenode.net
> 
> I haven't worked with serde much so can't give any
> pointers where to start.
> 
> /Johan
> 
> Shyam Sarkar wrote:
> > Hello,
> > 
> > I like to go deeper into Hive code (starting from
> parser all the way to file system) by implementing a small
> feature first. I like to add code for timestamp
> implementation (HIVE-192). Is that ok to implement? Is there
> any suggestion?
> > 
> > Also I like to know who should I talk to for new
> feature suggestions for implementations in future (Is
> someone the main architect!!)? What is the process involved?
> > 
> > Please let me know.
> > 
> > Regards,
> > shyam_sar...@yahoo.com
> > Shyam Sundar Sarkar,Ph.D.
> > Founder
> > AyushNet
> > 650-962-0900
> > 
> > 
> > 
> >


  


*UNIT TEST FAILURE for apache HIVE* Hadoop.Version=0.17.1 based on SVN Rev# 743092.50

2009-02-10 Thread Murli Varadachari
[junit] Test org.apache.hadoop.hive.cli.TestCliDriver FAILED
BUILD FAILED
[junit] Test org.apache.hadoop.hive.cli.TestCliDriver FAILED
BUILD FAILED


[jira] Updated: (HIVE-273) regression: avg always returns NULL

2009-02-10 Thread Ashish Thusoo (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ashish Thusoo updated HIVE-273:
---

   Resolution: Fixed
Fix Version/s: 0.2.0
 Hadoop Flags: [Reviewed]
   Status: Resolved  (was: Patch Available)

committed.

> regression: avg always returns NULL
> ---
>
> Key: HIVE-273
> URL: https://issues.apache.org/jira/browse/HIVE-273
> Project: Hadoop Hive
>  Issue Type: Bug
>  Components: Query Processor
>Affects Versions: 0.2.0
>Reporter: Ashish Thusoo
>Assignee: Ashish Thusoo
>Priority: Blocker
> Fix For: 0.2.0
>
> Attachments: patch-273.txt, patch-273_2.txt
>
>
> Due to recent checkin for implict type conversion, avg broke and it always 
> returns NULLs.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



RE: Implementing Timestamp (HIVE-192)

2009-02-10 Thread Ashish Thusoo
Will add them once they get the apache accounts and can actually commit code... 
I guess at that point they can add themselves in as well :)

Ashish 

-Original Message-
From: Jeff Hammerbacher [mailto:ham...@cloudera.com] 
Sent: Tuesday, February 10, 2009 3:08 AM
To: hive-dev@hadoop.apache.org
Subject: Re: Implementing Timestamp (HIVE-192)

We should add Namit and Prasad to that page...

On Tue, Feb 10, 2009 at 2:06 AM, Johan Oskarsson  wrote:

> The ticket hasn't been commented on so I'm going to assume that nobody 
> is working on it, so please do go ahead and have a go at it.
>
> As for who you should talk to, someone on this list should probably 
> jump in, but the committers are a good start:
> http://hadoop.apache.org/hive/credits.html
>
> There's also an IRC channel where some of them pop in now and again:
> ##hive at irc.freenode.net
>
> I haven't worked with serde much so can't give any pointers where to start.
>
> /Johan
>
> Shyam Sarkar wrote:
> > Hello,
> >
> > I like to go deeper into Hive code (starting from parser all the way 
> > to
> file system) by implementing a small feature first. I like to add code 
> for timestamp implementation (HIVE-192). Is that ok to implement? Is 
> there any suggestion?
> >
> > Also I like to know who should I talk to for new feature suggestions 
> > for
> implementations in future (Is someone the main architect!!)? What is 
> the process involved?
> >
> > Please let me know.
> >
> > Regards,
> > shyam_sar...@yahoo.com
> > Shyam Sundar Sarkar,Ph.D.
> > Founder
> > AyushNet
> > 650-962-0900
> >
> >
> >
> >
>
>


RE: Implementing Timestamp (HIVE-192)

2009-02-10 Thread Ashish Thusoo
Go for it Shyam...

All of us are available for help on this mailing list and we do hop onto the 
irc channel from time to time

Ashish 

-Original Message-
From: Johan Oskarsson [mailto:jo...@oskarsson.nu] 
Sent: Tuesday, February 10, 2009 2:06 AM
To: hive-dev@hadoop.apache.org
Subject: Re: Implementing Timestamp (HIVE-192)

The ticket hasn't been commented on so I'm going to assume that nobody is 
working on it, so please do go ahead and have a go at it.

As for who you should talk to, someone on this list should probably jump in, 
but the committers are a good start:
http://hadoop.apache.org/hive/credits.html

There's also an IRC channel where some of them pop in now and again:
##hive at irc.freenode.net

I haven't worked with serde much so can't give any pointers where to start.

/Johan

Shyam Sarkar wrote:
> Hello,
> 
> I like to go deeper into Hive code (starting from parser all the way to file 
> system) by implementing a small feature first. I like to add code for 
> timestamp implementation (HIVE-192). Is that ok to implement? Is there any 
> suggestion?
> 
> Also I like to know who should I talk to for new feature suggestions for 
> implementations in future (Is someone the main architect!!)? What is the 
> process involved?
> 
> Please let me know.
> 
> Regards,
> shyam_sar...@yahoo.com
> Shyam Sundar Sarkar,Ph.D.
> Founder
> AyushNet
> 650-962-0900
> 
> 
> 
>   



Re: Implementing Timestamp (HIVE-192)

2009-02-10 Thread Jeff Hammerbacher
We should add Namit and Prasad to that page...

On Tue, Feb 10, 2009 at 2:06 AM, Johan Oskarsson  wrote:

> The ticket hasn't been commented on so I'm going to assume that nobody
> is working on it, so please do go ahead and have a go at it.
>
> As for who you should talk to, someone on this list should probably jump
> in, but the committers are a good start:
> http://hadoop.apache.org/hive/credits.html
>
> There's also an IRC channel where some of them pop in now and again:
> ##hive at irc.freenode.net
>
> I haven't worked with serde much so can't give any pointers where to start.
>
> /Johan
>
> Shyam Sarkar wrote:
> > Hello,
> >
> > I like to go deeper into Hive code (starting from parser all the way to
> file system) by implementing a small feature first. I like to add code for
> timestamp implementation (HIVE-192). Is that ok to implement? Is there any
> suggestion?
> >
> > Also I like to know who should I talk to for new feature suggestions for
> implementations in future (Is someone the main architect!!)? What is the
> process involved?
> >
> > Please let me know.
> >
> > Regards,
> > shyam_sar...@yahoo.com
> > Shyam Sundar Sarkar,Ph.D.
> > Founder
> > AyushNet
> > 650-962-0900
> >
> >
> >
> >
>
>


Re: Implementing Timestamp (HIVE-192)

2009-02-10 Thread Johan Oskarsson
The ticket hasn't been commented on so I'm going to assume that nobody
is working on it, so please do go ahead and have a go at it.

As for who you should talk to, someone on this list should probably jump
in, but the committers are a good start:
http://hadoop.apache.org/hive/credits.html

There's also an IRC channel where some of them pop in now and again:
##hive at irc.freenode.net

I haven't worked with serde much so can't give any pointers where to start.

/Johan

Shyam Sarkar wrote:
> Hello,
> 
> I like to go deeper into Hive code (starting from parser all the way to file 
> system) by implementing a small feature first. I like to add code for 
> timestamp implementation (HIVE-192). Is that ok to implement? Is there any 
> suggestion?
> 
> Also I like to know who should I talk to for new feature suggestions for 
> implementations in future (Is someone the main architect!!)? What is the 
> process involved?
> 
> Please let me know.
> 
> Regards,
> shyam_sar...@yahoo.com
> Shyam Sundar Sarkar,Ph.D.
> Founder
> AyushNet
> 650-962-0900
> 
> 
> 
>   



[jira] Updated: (HIVE-272) Eliminate @Override directives for classes in Eclipse 3.4.1

2009-02-10 Thread Raghotham Murthy (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Raghotham Murthy updated HIVE-272:
--

Resolution: Invalid
Status: Resolved  (was: Patch Available)

There seems to be quite a bit of confusion about changing the meaning of 
@Override between 1.5 and 1.6.
See: http://blogs.sun.com/ahe/?entry=override

But, the conclusion is that its ok in 1.6 to specify @Override to methods 
inherited from interfaces. So, this jira can be closed.

We do need to make a change to our eclipse-templates to make sure that eclipse 
has java compiler compliance level set to 1.6.

> Eliminate @Override directives for classes in Eclipse 3.4.1
> ---
>
> Key: HIVE-272
> URL: https://issues.apache.org/jira/browse/HIVE-272
> Project: Hadoop Hive
>  Issue Type: Improvement
>  Components: Build Infrastructure
>Affects Versions: 0.2.0
> Environment: Eclipse 3.4.1
>Reporter: Shyam Sundar Sarkar
>Assignee: Raghotham Murthy
> Fix For: 0.3.0
>
> Attachments: hive-272.1.patch
>
>
> Eclipse Versions prior to 3.4.1 actually add @Override to classes which
> implement interfaces. Version 3.4.1 correctly complains that @Override
> should not be present for methods from interfaces.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.