How does indexes work in hive? I thought file formats like ORC have indexes
in each block. But not a separate index that can help query performance.
Thanks,
Chandra
On Fri, Aug 1, 2014 at 9:10 AM, Devopam Mittra wrote:
> Please try the following approach and let me know if you are not getting
>
Would probably have to see the whole code of your evaluate() function.
Is this while trying to use treat the arguments to the UDF as a String object?
It was probably passed into the GenericUDF as a Text object (Hadoop Writable
version of string type), not a String object. It would have to be conv
Hi,
I am trying to test some optimizations that Partitioning and Clustering tables
can do, but I have a dude on how works the SORT BY clause in a table.
The case is the following:
I create a simple bucketed table as :
CREATE TABLE USERS(ID INT,NAME STRING, OTHER INT)
CLUSTERED BY (ID) SORTED BY(
Hi Dan,
Take a look at this:
http://javarevisited.blogspot.com/2012/12/how-to-solve-javalangclasscastexception-java.html
__Birm
Ricardo Birmele, CISSP
Security Data Scientist
Microsoft IT Security Operations
* | | *
[Microsoft Logo]
From: Dan Fan [mailto:d...@appnexus.com]
Sent: Friday, 1
Hi team
Quick question.
I am writing a hive generic UDF.
In which, I wanna have this:
HashMap vpDefinition = new HashMap() ;
vpDefinition.push(“auction_id”,”22”) ;
The second line always give me FAILED: ClassCastException
org.apache.hadoop.io.Text cannot be cast to java.lang.String
When I ru
Hi team
Quick question.
I am writing a hive generic UDF.
In which, I wanna have this:
HashMap vpDefinition = new HashMap() ;
vpDefinition.push(“auction_id”,”22”) ;
The second line always give me FAILED: ClassCastException
org.apache.hadoop.io.Text cannot be cast to java.lang.String
When I ru
Hi team
Quick question.
I am writing a hive generic UDF.
In which, I wanna have this:
HashMap vpDefinition = new HashMap() ;
vpDefinition.push(“auction_id”,”22”) ;
The second line always give me FAILED: ClassCastException
org.apache.hadoop.io.Text cannot be cast to java.lang.String
When I run
Hi,
I want to pass different configuration variables for different users in
hive. I have tested this by putting hive-site.xmls in user's home directory
and for that user it grabs the hive-site.xml from his home directory and
executes hive accordingly.
This works for CLI but it doesn't from JDBC/OD
I am already using tez as the execution engine and used hdfs cacheadmin to pin a
file to memroy. However querying that file through Hive still goes to disk.
Any ideas?
> On 01 August 2014 at 11:46 Nitin Pawar wrote:
>
> Please take a look at hive with tez as execution engine on hadoop 2.3.
>
Please take a look at hive with tez as execution engine on hadoop 2.3.
it may help you compare it with what you want to achieve
On Fri, Aug 1, 2014 at 4:13 PM, Uli Bethke wrote:
> Hi.
>
> in Hive can I make use of the centralized cache management introduced in
> Hadoop 2.3 (
> http://hadoop
Hi.
in Hive can I make use of the centralized cache management introduced in Hadoop
2.3
(http://hadoop.apache.org/docs/r2.3.0/hadoop-project-dist/hadoop-hdfs/CentralizedCacheManagement.html)?
If not implemented yet, is this on the roadmap?
My use case is that I want to pin a fact table that needs
Hi,
I am having a usecase to read files from hdfs and local file system
depending on a configuration parameter. I found that apache commons-vfs
supports various file systems and the latest developer release has an
implementation for hdfs also (though only read support is provided
currently). I fin
thanks
在 2014年08月01日 12:00, Devopam Mittra 写道:
If you have mySQL as your metastore , you may use something similar to
below:
SELECT tbl.TBL_NAME,COUNT(DISTINCT part.PART_NAME) AS partition_count
FROM metastore_db.TBLS tbl, metastore_db.PARTITIONS part
WHERE tbl.TBL_ID = part.TBL_ID
AND tbl.TBL
13 matches
Mail list logo