Re: Caching metastore objects

2015-05-26 Thread Sivaramakrishnan Narayanan
47 But there was a resistance > from a community for it. May be now community is ready for it : ) > > Ashutosh > > On Tue, May 26, 2015 at 10:12 PM, Sivaramakrishnan Narayanan < > tarb...@gmail.com> wrote: > > > Thanks for the replies. > > > > @Ashutosh

Re: Caching metastore objects

2015-05-26 Thread Sivaramakrishnan Narayanan
che.org/jira/browse/HIVE-4051 should > alleviate some of your problems. > > > On Mon, May 25, 2015 at 8:19 PM, Sivaramakrishnan Narayanan < > tarb...@gmail.com> wrote: > > > Apologies if this has been discussed in the past - my searches did not > pull > > up an

Caching metastore objects

2015-05-25 Thread Sivaramakrishnan Narayanan
Apologies if this has been discussed in the past - my searches did not pull up any relevant threads. If there are better solutions available out of the box, please let me know! Problem statement -- We have a setup where a single metastoredb is used by Hive, Presto and Spar

Re: Window function possible perf improvement

2015-05-09 Thread Sivaramakrishnan Narayanan
ng on > https://issues.apache.org/jira/browse/HIVE-7062 which are available from > 0.14 onwards. Will that be useful in your scenario? Or, are you targeting > non-windowing PTFs? > > Thanks, > Ashutosh > > On Thu, May 7, 2015 at 6:43 AM, Sivaramakrishnan Narayanan < > tarb...@gmail.

Window function possible perf improvement

2015-05-07 Thread Sivaramakrishnan Narayanan
Hi, I was reading through the PTFOperator and related code and was wondering if there is an opportunity to optimize this function in WindowingTableFunction.java public void execute(PTFPartitionIterator pItr, PTFPartition outP) throws HiveException { This guy iterates over the input partition

Vectorized group-by on strings is super slow in hive 0.13

2015-03-29 Thread Sivaramakrishnan Narayanan
Apologies if this has already been addressed / discussed - my searching of jiras and mailing list did not find anything on this topic. Pointers welcome. Been experimenting a little with vectorized execution in hive 0.13 and found that group-by is super slow on string columns. This simple query is

[jira] [Commented] (HIVE-784) Support uncorrelated subqueries in the WHERE clause

2013-11-06 Thread Sivaramakrishnan Narayanan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13815110#comment-13815110 ] Sivaramakrishnan Narayanan commented on HIVE-784: - Another comment on

[jira] [Commented] (HIVE-784) Support uncorrelated subqueries in the WHERE clause

2013-11-06 Thread Sivaramakrishnan Narayanan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13815095#comment-13815095 ] Sivaramakrishnan Narayanan commented on HIVE-784: - Haven't look

[jira] [Commented] (HIVE-3969) Session state for hive server should be cleanup

2013-09-02 Thread Sivaramakrishnan Narayanan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13755999#comment-13755999 ] Sivaramakrishnan Narayanan commented on HIVE-3969: -- [~navis] please

[jira] [Commented] (HIVE-3562) Some limit can be pushed down to map stage

2013-08-28 Thread Sivaramakrishnan Narayanan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13752543#comment-13752543 ] Sivaramakrishnan Narayanan commented on HIVE-3562: -- Good stuff, N

[jira] [Commented] (HIVE-4226) Cleanup non-threadsafe code in Hive

2013-07-16 Thread Sivaramakrishnan Narayanan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13709762#comment-13709762 ] Sivaramakrishnan Narayanan commented on HIVE-4226: -- Also, the blog

[jira] [Commented] (HIVE-4226) Cleanup non-threadsafe code in Hive

2013-07-16 Thread Sivaramakrishnan Narayanan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13709761#comment-13709761 ] Sivaramakrishnan Narayanan commented on HIVE-4226: -- FYI - I ran

[jira] [Commented] (HIVE-4226) Cleanup non-threadsafe code in Hive

2013-07-15 Thread Sivaramakrishnan Narayanan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13709482#comment-13709482 ] Sivaramakrishnan Narayanan commented on HIVE-4226: -- I found the g

[jira] [Commented] (HIVE-4226) Cleanup non-threadsafe code in Hive

2013-07-15 Thread Sivaramakrishnan Narayanan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13709481#comment-13709481 ] Sivaramakrishnan Narayanan commented on HIVE-4226: -- I'm not sure

[jira] [Updated] (HIVE-4226) Cleanup non-threadsafe code in Hive

2013-07-10 Thread Sivaramakrishnan Narayanan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sivaramakrishnan Narayanan updated HIVE-4226: - Attachment: HIVE-4226.2.patch.txt Attaching new version (HIVE-4226.2

[jira] [Commented] (HIVE-4226) Cleanup non-threadsafe code in Hive

2013-07-10 Thread Sivaramakrishnan Narayanan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13704825#comment-13704825 ] Sivaramakrishnan Narayanan commented on HIVE-4226: -- Patch doesn

[jira] [Updated] (HIVE-4226) Cleanup non-threadsafe code in Hive

2013-07-10 Thread Sivaramakrishnan Narayanan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sivaramakrishnan Narayanan updated HIVE-4226: - Attachment: HIVE-4226.1.patch.txt Attaching a patch I created against

[jira] [Commented] (HIVE-4226) Cleanup non-threadsafe code in Hive

2013-03-25 Thread Sivaramakrishnan Narayanan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13612900#comment-13612900 ] Sivaramakrishnan Narayanan commented on HIVE-4226: -- [~shreepadma] QHS

[jira] [Created] (HIVE-4226) Cleanup non-threadsafe code in Hive

2013-03-25 Thread Sivaramakrishnan Narayanan (JIRA)
Sivaramakrishnan Narayanan created HIVE-4226: Summary: Cleanup non-threadsafe code in Hive Key: HIVE-4226 URL: https://issues.apache.org/jira/browse/HIVE-4226 Project: Hive Issue

[jira] [Commented] (HIVE-3562) Some limit can be pushed down to map stage

2013-01-02 Thread Sivaramakrishnan Narayanan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13542689#comment-13542689 ] Sivaramakrishnan Narayanan commented on HIVE-3562: -- Looks good to me

[jira] [Commented] (HIVE-3562) Some limit can be pushed down to map stage

2012-12-06 Thread Sivaramakrishnan Narayanan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13511482#comment-13511482 ] Sivaramakrishnan Narayanan commented on HIVE-3562: -- Added my comment

[jira] [Commented] (HIVE-3562) Some limit can be pushed down to map stage

2012-12-06 Thread Sivaramakrishnan Narayanan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13511418#comment-13511418 ] Sivaramakrishnan Narayanan commented on HIVE-3562: -- Hive-only chang

[jira] [Commented] (HIVE-3562) Some limit can be pushed down to map stage

2012-11-19 Thread Sivaramakrishnan Narayanan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13500165#comment-13500165 ] Sivaramakrishnan Narayanan commented on HIVE-3562: -- Apologies, you

[jira] [Commented] (HIVE-3562) Some limit can be pushed down to map stage

2012-11-19 Thread Sivaramakrishnan Narayanan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13500118#comment-13500118 ] Sivaramakrishnan Narayanan commented on HIVE-3562: -- I'm inte

Top-K Optimization

2012-11-19 Thread Sivaramakrishnan Narayanan
Hi All, I'm a developer at Qubole (http://www.qubole.com) looking at Hadoop and Hive. In my past life, I was on the optimizer team of Greenplum Parallel Database. I'm a newbie to the Hive mailing list, so apologies for any missteps. I've done some searching in the Hive mailing list and JIRA and

Top-K optimization

2012-11-19 Thread Sivaramakrishnan Narayanan
Hi All, I'm a developer at Qubole (http://www.qubole.com) looking at Hadoop and Hive. In my past life, I was on the optimizer team of Greenplum Parallel Database. I'm a newbie to the Hive mailing list, so apologies for any missteps. I've done some searching in the Hive mailing list and JIRA and