Add Hive AUX Jars across the cluster

add the hive.aux.jars.path to Hive is described here https://github.com/delta-io/connectors/issues/84 Need some help with what I am doing wrong and the correct way to add 3rd party Jars so that they are available in the classpath across the entire cluster. Thanks, Abhishek

Re: Read Hive ACID tables in Spark or Pig

> the delta files are valid and which are not. > > Theoretically all this is possible, as outside clients could get the valid > transaction list from the metastore and then read the files, but no one has > done this work. > > Alan. > > On Wed, Mar 6, 2019 at 8:28 AM Abhi

Read Hive ACID tables in Spark or Pig

Hi, Does Hive ACID tables for Hive version 1.2 posses the capability of being read into Apache Pig using HCatLoader or Spark using SQLContext. For Spark, it seems it is only possible to read ACID tables if the table is fully compacted i.e no delta folders exist in any partition. Details in the fol

Re: Hive2 Interactive LLAP fails to start

Gentle reminder. On Thu, Jan 17, 2019 at 3:45 PM Abhishek Gupta wrote: > One error that is striking is the error by NetUtil.py failing to connect > with Slide agent service as the OS Python version 2.7.6 where module ssl > doesn’t have the attribute `_create_unverified_context`

Re: Hive2 Interactive LLAP fails to start

eping for 10 seconds... On Thu, Jan 17, 2019 at 1:05 PM Abhishek Gupta wrote: > I have been trying to start Hive2 Interactive on HDP 2.6.5 that ships with > Hive 2.1.0. I have followed the guidelines mentioned in the following > articles about how to size and tune LLAP with Yarn > >

Hive2 Interactive LLAP fails to start

I have been trying to start Hive2 Interactive on HDP 2.6.5 that ships with Hive 2.1.0. I have followed the guidelines mentioned in the following articles about how to size and tune LLAP with Yarn https://community.hortonworks.com/articles/149486/llap-sizing-and-setup.html But LLAP daemon fails to

Re: Hive storm streaming with s3 file system

n 12 June 2018 at 17:50, Abhishek Raj wrote: > >> Hi. I'm using HiveBolt from Apache Storm to stream >> <https://cwiki.apache.org/confluence/display/Hive/Streaming+Data+Ingest#StreamingDataIngest-StreamingRequirements> >> data into a transactional hive table. It wor

Re: Hive storm streaming with s3 file system

Hi. I'm using HiveBolt from Apache Storm to stream data into a transactional hive table. It works great when the table is backed by hdfs, but starts throwing error when the location is

Re: I delete my table in hive,but the file in HDFS not be deleted

How did you define your table - external or hive managed ? If it's defined as external then table and when you drop the table , metadata will be delete but the data will still be in hdfs. Sent from my iPhone > On Dec 6, 2016, at 6:08 PM, "446463...@qq.com" <446463...@qq.com> wrote: > > I meet

Doubt on Hive Partitioning.

query will ignore the partitioning and do a complete table scan to fetch output. Thanks & Regards, Abhishek Dubey

Re: LINES TERMINATED BY only supports newline '\n' right now

Did you try defining the table with hive In built SerDe. 'Stored as ORC' This should resolve your issue. Plz try and let me know if it works. Abhi Sent from my iPhone > On Jun 3, 2016, at 3:33 AM, Markovitz, Dudu wrote: > > Here is an example, but first – some warnings: > > · You s

RE: Unable to pick data from subdirectories into hive table in CDH 5.3.3

/configure-apache-hive-to-recursively-search-directories-for-files/ Solution given in the above posts is to set the two properties mentioned above which I am already setting. But these properties are not working on CDH 5.3.3 cluster, I’m yet to try on other CDH versions. Thanks & Regards, Abhi

Unable to pick data from subdirectories into hive table in CDH 5.3.3

from subdirectories into hive table? Thanks in advance. Abhishek Dubey

Hive UDF to fetch value from distributed cache not working with outer queries

ry 2 and 3 in place of 'NA' it was zero. I am puzzled why outer select or create table is not able to fetch coutryMap() value and why the size of Map becomes zero. Thanks in advance, Abhishek Dubey

Re: DB2 DDL to Hive DDL conversion **Need Help**

e-sqoop-for-importing-data-from-a-relational-db-to-sandbox-hive > >> On Fri, Feb 19, 2016 at 1:04 PM, Abhishek Singh >> wrote: >> Hi, >> >> We have almost 1000 DB2 RDBMS tables and for those we have the DDLs (script) >> available. >> We are lookin

Re: DB2 DDL to Hive DDL conversion **Need Help**

_importing_data_into_hive >>> >>> http://stackoverflow.com/questions/17064144/how-do-i-use-sqoop-for-importing-data-from-a-relational-db-to-sandbox-hive >>> >>> On Fri, Feb 19, 2016 at 1:04 PM, Abhishek Singh >>> wrote: >>> >>>> Hi

DB2 DDL to Hive DDL conversion **Need Help**

Hi, We have almost 1000 DB2 RDBMS tables and for those we have the DDLs (script) available. We are looking for a way to convert all these DB2 DDLs into Hive DDL without writing Hive DDL statements for each and every table. Means, is there an automated tool available to do this? If not, then can s

RE: How to find hive version using hive editor in hue ?

Thanks Bennie, It worked ! Would you like to tell us what else this command means, like what exactly it's setting ? Thanks & Regards, Abhishek Dubey From: Bennie Schut [mailto:bennie.sc...@booking.com] Sent: Thursday, February 18, 2016 5:12 PM To: user@hive.apache.org; Abhishek Dubey

RE: Difference between RC file format & Parquet file format

/#!topic/parquet-dev/0IdtSLdIINQ Thanks & Regards, Abhishek Dubey From: Ravi Prasad [mailto:raviprasa...@gmail.com] Sent: Thursday, February 18, 2016 9:06 AM To: user@hive.apache.org Subject: Difference between RC file format & Parquet file format Hi all, Can you please let me know, How the

How to find hive version using hive editor in hue ?

Thanks in advance.. Warm Regards, Abhishek Dubey

RE: How can we find Hive version from Hive CLI or Hive shell?

Well thanks for the reply but it didn’t seems to work at my side. [cid:image003.png@01D1697A.2245C760] To be more precise, I want to determine hive version while hive is running like by querying or something… Thanks & Regards, Abhishek Dubey From: Amrit Jangid [mailto:amrit.jan...@goibibo

How can we find Hive version from Hive CLI or Hive shell?

Hi, How can we find Hive version from Hive CLI or Hive shell? Thanks & Regards, Abhishek Dubey

Re: Hive being slow

0.14.0 -- Abhishek On Thu, Jan 15, 2015 at 10:43 PM, Ashutosh Chauhan wrote: > which hive version you are using ? > > On Thu, Jan 15, 2015 at 12:44 AM, Abhishek kumar > wrote: > >> Hi, >> >> Thanks for the reply. >> >> I tried that, but no luck. T

Re: Hive being slow

*Scanner*) is not happening to Hbase. If the push-down happens, then Hbase will resolve this Scanner very fast and no matter MR job runs or not, the query resolution will be very fast. -- Abhishek On Thu, Jan 15, 2015 at 1:59 AM, Ashutosh Chauhan wrote: > Can you run your query with follow

Re: Hive being slow

y simple query. * Since this query can only be resolved from HBase, will Hive launch map tasks (last time, I guess I observed no map task getting launched) -- Abhishek On Sat, Jan 10, 2015 at 4:14 AM, Ashutosh Chauhan wrote: > Hi Abhishek, > > How are you determining its resulting in

Hive being slow

is getting pushed to Hbase scanner as 'startKey'. Now given there are no such rows-keys (id) which satisfies this criteria, this query should be extremely fast. But hive is taking a lot of time, looks like full hbase table scan. Can someone let me know where am I wrong in understanding the whole thing? -- Abhishek

Re: Nested types in ORC

s point, schema 2 will make you enable predicate pushdown. The > performance difference depends mainly on the data layout/if column is > sorted or not. > > Thanks > Prasanth Jayachandran > > On Sep 8, 2014, at 6:16 AM, Abhishek Agarwal wrote: > > Hi all, > I have few ques

Nested types in ORC

access nested columns? In general, is there a significant performance difference in following schemas with regards to query execution and storage? Schema1: { string a; struct b { string b1; string b2; } } Schema 2: { string a; string b.b1; string b.b2; } -- Regards, Abhishek Agarwal

Re: Using Parquet and Thrift in Hive

+ Re-sending as delivery of earlier mail failed. On Fri, Jul 25, 2014 at 5:14 PM, Abhishek Agarwal wrote: > Hi All, > Is it possible to create a table with Parquet as storage mechanism, with > schema being supplied from thrift IDL rather than metastore? > > Something like be

HIVE 0.12 SUM() returning NULL for decimal values

_0' looks like 24687329978.000156909543021743116491818900326715 246873303113.06617408356827568833561026591436615 246873314156.00031381908604348623298363780065343 2468733246.8943049855440756796081014881223248771 2468733280 Please let me know what is going wrong here. Thanks Abhishek

Re: OrcOutputFormat

Hi, AFAIK, you would need to use HCatalog APIs to read-from/write-to an ORCFile. Please refer to https://cwiki.apache.org/confluence/display/Hive/HCatalog+InputOutput -Abhishek On Tue, Apr 29, 2014 at 6:40 AM, Seema Datar wrote: > Hi, > > I am trying to run an MR job to write fil

Re: subscribe

Hi Nivedita, Please send an email to user-subscr...@hive.apache.org to subscribe. -Abhishek On Mon, Apr 28, 2014 at 8:15 AM, Nivedhita Sathyamurthy < nivedhitasat...@gmail.com> wrote: > >

Help - Hadoop jar null org.apache.hadoop.hive.ql.exec.ExecDriver

, return code 1 from org.apache.hadoop.hive.ql.exec.MapRedTask Can someone please let me know what could be wrong? I was unable to find any details online. -Abhishek

Re: Writing to an ORCFile using MapReduce + HCatalog APIs

stored as ORC and then use HCatalog to load data into it? Is there no way to directly create an ORCFile programmatically and write data into it? Thanks again! Regards, Abhishek On Mon, Apr 7, 2014 at 1:47 PM, Eugene Koifman wrote: > If you are writing from Pig using HCatStorer you don't

Writing to an ORCFile using MapReduce + HCatalog APIs

or ORCFile or Sequence File etc..). I would then need to work on reading from these ORCFiles and reconstruct the records. Any pointers would be appreciated. Thanks in advance. Regards, Abhishek

Re: Wrapping an analytical function

@[129:7: ( ( ( KW_AS )? identifier ) | ( KW_AS LPAREN identifier ( COMMA identifier )* RPAREN ) )?]) FAILED: ParseException line 3:120 cannot recognize input near '+' 'lag' '(' in selection target were you able to fine any fix or workaround for this problem? Thanks Abhishek On

Hive views

Hi all, We had created views in hive, but when we restart the cluster then the views created in the hive are deleted automatically. I know hive view doesn't persist after cluster restart, but I want figure it out a way to persist it. Can someone help me how to do that? Regards Abhishek

Hive struct

hi all, Please share your view on how can I do this i have query in hive where one column is struct(1 to n strings),second column is string i want to compare struct of first and last element with second column string, if first element matches i should get output first or last element matches w

Re: Error while table creation

amp...@thinkbiganalytics.com> wrote: > If you upgrade Hive, you have to do a upgrade/migration on the metastore > database. There are scripts that come with hive distributions for this. If > you're starting from scratch, you could just drop the old database. > > > On Sun, Mar 10, 2013

Re: Error while table creation

TABLE IF NOT EXISTS my_table ( > > ... > ... > ... > ) > > > > On Sun, Mar 10, 2013 at 2:34 AM, Viral Bajaria wrote: > >> Is this is a new installation of Hive or did you upgrade ? How many >> tables do you already have ? >> >> >> On Sat, Mar

Error while table creation

.hive.metastore.ObjectStore.createTable(ObjectStore.java:617) ... 43 more Caused by: com.mysql.jdbc.exceptions.jdbc4.MySQLIntegrityConstraintViolationException: Duplicate entry 'X' for key 'PRIMARY' Thanks, Abhishek

Fwd: Help to solve UDAF errors!

able to take optimal partial decisions. Any ideas to address this issue regarding optimization/approximation techniques so that I need not keep all the elements to avoid scalability issues? Thanks, Abhishek -- Forwarded message -- From: Abhishek Bhattacharya Date: Wed, Feb 13

Re: Help to solve UDAF errors!

/UDAFTopNPercent.java Let me know if you face any other issues! Thanks, Abhishek On Wed, Feb 13, 2013 at 7:02 PM, Robin Morris wrote: > Hi, > > You might well have found the error yourself by now, but if not, the > problem is that you missed the "static" keyword off the declaration of

Fwd: Help to solve UDAF errors!

:14,049 INFO org.apache.hadoop.mapred.Task: Runnning cleanup for the task -- Thanks, Abhishek -- Forwarded message -- From: Abhishek Bhattacharya Date: Tue, Feb 12, 2013 at 12:48 PM Subject: Re: Help to solve UDAF errors! To: user@hive.apache.org Hi

Re: Help to solve UDAF errors!

., similar to my case of computing the top-n-percent of a column attribute and output the entire set of filtered rows with all other columns from the table? Thanks, Abhishek On Sun, Feb 10, 2013 at 12:36 PM, Mark Grover wrote: > Hi Abhishek, > The code looks incomplete. > > See th

Re: Help to solve UDAF errors!

to return a ArrayList of doubles from the final terminate() function but I have seen other working UDAF's where the ArrayList of different types can be returned. So how do I return a ArrayList of Doubles? Thanks, Abhishek On Sun, Feb 10, 2013 at 12:36 PM, Mark Grover wrote: > Hi Abhishe

Re: Help to solve UDAF errors!

Thanks for the response. The link to the code is: https://github.com/Abhishek2301/Hive/blob/master/src/UDAFTopNPercent.java Please let me know to fix it! Thanks, Abhishek On Fri, Feb 8, 2013 at 5:02 PM, Mark Grover wrote: > Abhishek, > The code doesn't seem to be complete. > >

Help to solve UDAF errors!

dge$GenericUDAFBridgeEvaluator.init(GenericUDAFBridge.java:129) Please help me to debug this! Is it throwing from returning ArrayList in terminate()? How should I return a List from UDAF? Thanks, Abhishek

Re: Automating the partition creation process

Sadananda, Look at Oozie workflow. Regards Abhishek On Jan 28, 2013, at 11:05 PM, Sadananda Hegde wrote: > Hello, > > My hive table is partitioned by year, month and day. I have defined it as > external table. The M/R job correctly loads the files into the daily > subfo

Re: CREATE DATABASE WITH LOCATION

Thanks Thiruvel Sent from my iPhone On Dec 4, 2012, at 10:09 AM, Thiruvel Thirumoolan wrote: > This feature (HIVE-1537) was added in Hive 0.8. > > On 12/4/12 7:37 PM, "abhishek" wrote: > >> hi all, >> >> I am trying the below query >> >

CREATE DATABASE WITH LOCATION

hi all, I am trying the below query Create database Location '/my/preferred/directory' But getting the below error FAILED: Parse Error : line 2:0 mismatched input 'LOCATION' excepting EOF near '' I am using hive 0.7 Regards Abhi

Re: Need Help in Hive storage format

Hi Yogesh, Try this PigStorage(' \u0001'); Thanks Abhi Sent from my iPhone On Oct 12, 2012, at 5:50 AM, MiaoMiao wrote: > Hi Yogesh: > > I think this may help. > > https://pig.apache.org/docs/r0.10.0/api/org/apache/pig/builtin/PigStorage.html > > Miao > > On Fri, Oct 12, 2012 at 5:27 PM

Re: best way to load millions of gzip files in hdfs to one table in hive?

Hi Edward, I am kind of interested in this, for crush to work do we need install any thing?? How can it be used in a cluster. Regards Abhi Sent from my iPhone On Oct 2, 2012, at 5:45 PM, Edward Capriolo wrote: > You may want to use: > > https://github.com/edwardcapriolo/filecrush > > We

Re: Cartesian Product in HIVE

> hive>SELECT t2.col1,t3.col1FROM table2 t2JOIN table3 t3; -- This also does not work It is only showing me as map = 0%, reduce = 0% map = 0%, reduce = 0% map = 0%, reduce = 0% map = 0%, reduce = 0% For 10 min Regards Abhi > > --Original Message-- > From: Abhishe

Re: Cartesian Product in HIVE

t; Regards > > abhi > > > > > > > > > > > > > > > > On Fri, Sep 28, 2012 at 10:15 PM, Bejoy KS wrote: > > > Hi Abshiek > > > > > > What is the data size of the 20k rows? If it is lesser then you can go in > &g

Re: Cartesian Product in HIVE

single >> moment or per second >> -- Any other techniques to optimize the query >> >> Thanks for response and your time Bejoy. >> >> Regards >> abhi >> >> >> >> >> >> >> >> On Fri, Sep 28, 2012 at 10

Re: Cartesian Product in HIVE

t from handheld, please excuse typos. > > From: Abhishek > Date: Fri, 28 Sep 2012 23:56:16 -0400 > To: Hive > ReplyTo: user@hive.apache.org > Cc: Bejoy Ks > Subject: Cartesian Product in HIVE > > Hi all, > > I have use case where we

Cartesian Product in HIVE

Hi all, I have use case where we are doing Cartesian product of two tables with One table with 990k rows Second table 20k rows Query is Cartesian product of just two columns. So it comes around 20 billion rows For one hour it is processing like around 5 billion rows. So the process takes ar

Re: Performance tuning in hive

nforce.bucketing , after that use Select > statement from the parent table to load data into the bucketed one. > > Regards > Bejoy KS > > Sent from handheld, please excuse typos. > From: Abhishek > Date: Fri, 28 Sep 2012 11:14:56 -0400 > To: Bejoy Ks > ReplyTo

Re: Performance tuning in hive

s > your data set. > > Regards, > Bejoy KS > > From: Abhishek > To: "user@hive.apache.org" > Cc: "user@hive.apache.org" > Sent: Friday, September 28, 2012 5:16 AM > Subject: Re: Performance tuning in hive > > Hi Bejoy, > > Th

Bucketing

Hi all, How to use CTAS with Clustered By.Can any one help me on this I am getting following error when doing CTAS does not support partitioning in the target table. Regards Abhi Sent from my iPhone

Re: Performance tuning in hive

o bucket and > index them to get better performance. From a birds eye point of view, > bucketing + indexing + map joins would be a good combination if those suits > your data set. > > Regards, > Bejoy KS > > From: Abhishek > To: "user@hive.apache.org"

Re: Performance tuning in hive

then RC files gives you a performance > edge but if the queries are spanned across pretty much all columns then use > the more generalized Sequence Files. > > > Regards, > Bejoy KS > > From: Abhishek > To: Hive > Sent: Thursday, September 27, 2012 7:03 PM >

Reduce phase initialization

Hi all, In some of my hive scripts, reduce phase is not starting until map finishes 100%.What would be the reason for this. Regards Abhi Sent from my iPhone

Performance tuning in hive

Hi all, I am trying to increase the performance of some queries in hive, all queries mostly contain left outer join , group by and conditional checks, union all. I have over riden some properities in hive shell Set io.sort.mb=512 Set io.sort.factor=100 Set mapred.child.jvm.opts=-Xmx2048mb Set

Re: Hive configuration property

ill be used. If the one specified in the > configuration parameter mapred.reduce.tasks is negative, hive will use this > one as the max number of reducers when automatically determine number of > reducers. > > Thanks > Ashok S. > > From: Abhishek [mailto:abhishek.dod...@gm

Re: How to optimize a group by query

> subset of sorted bucked columns. This optimization is enabled using > 'hive.optimize.groupby' which is true by default > > Regards, > Bejoy KS > > From: Abhishek > To: "user@hive.apache.org" > Cc: "user@hive.apache.org" > Sent:

Re: How to optimize a group by query

t is enabled by default > SET hive.map.aggr = true; > > 2)Is there a data skew observed in some of the reducers? > If so a better performance can be yielded by setting the following property > SET hive.groupby.skewindata=true; > > > Regards, > Bejoy KS > > F

How to optimize a group by query

Hi all, I have written a query with group by clause, it is consuming lot of time is there any way to optimize this any configuration property or some thing. Regards Abhi Sent from my iPhone

Re: Hive configuration property

can always provide the number of reduce tasks > (mapred.reduce.tasks) based on the data volume your query handles. It can > yield you better performance numbers. > > Regards, > Bejoy KS > > From: Abhishek > To: "user@hive.apache.org" > Cc: "user@hive.apache

Re: Hive configuration property

> yield you better performance numbers. > > Regards, > Bejoy KS > > From: Abhishek > To: "user@hive.apache.org" > Cc: "user@hive.apache.org" > Sent: Wednesday, September 26, 2012 7:04 PM > Subject: Re: Hive configuration prop

Re: Hive configuration property

ers are completed in a single wave. (This may or maynot work for > you, worth giving a try). > > > On Wed, Sep 26, 2012 at 5:58 PM, Abhishek wrote: >> >> Hi all, >> >> I have doubt regarding below properties, is it a good practice to override

Re: How connect to hive server without using jdbc

essarily need to run the thrift service to use JDBC. Please > see: > http://csgrad.blogspot.in/2010/04/to-use-language-other-than-java-say.html. > > Dilip > > On Tue, Sep 25, 2012 at 11:01 AM, Abhishek wrote: >> Hi Zhou, >> >> Thanks for the reply, we are

Hive configuration property

Hi all, I have doubt regarding below properties, is it a good practice to override below properties in hive. If yes, what is the optimal values for the following properties? set hive.exec.reducers.bytes.per.reducer= In order to limit the maximum number of reducers: set hive.exec.reducers.m

Re: How connect to hive server without using jdbc

inal Message ----- > From: "Abhishek" > To: user@hive.apache.org > Cc: user@hive.apache.org > Sent: Tuesday, September 25, 2012 1:44:41 PM > Subject: Re: How connect to hive server without using jdbc > > > Hi Zhou, > > > But Iam looking to connect to

Re: How connect to hive server without using jdbc

oes it. > > - Original Message ----- > From: "Abhishek" > To: user@hive.apache.org > Cc: user@hive.apache.org > Sent: Tuesday, September 25, 2012 1:44:41 PM > Subject: Re: How connect to hive server without using jdbc > > > Hi Zhou, > > > But I

Re: How connect to hive server without using jdbc

Hi Zhou, But Iam looking to connect to hive server without jdbc. Some other way through API Regards Abhi Sent from my iPhone On Sep 25, 2012, at 1:15 PM, Haijia Zhou wrote: > https://cwiki.apache.org/Hive/hiveclient.html#HiveClient-JDBC > > On Tue, Sep 25, 2012 at 1:13 PM, Abhish

How connect to hive server without using jdbc

Hi all, Is there any way to connect to hive server through API?? Regards Abhi Sent from my iPhone

Re: Map side join and Serde jar in distributed cache missing

i m using hive-0.7.1 On Mon, Sep 24, 2012 at 5:10 PM, Edward Capriolo wrote: > I have noticed this as well with hive 0.7.0. Not sure what CDH is > based on but newer versions could suffer as well. What version of hive > do you have? > > On Mon, Sep 24, 2012 at 7:30 PM, Abhish

Map side join and Serde jar in distributed cache missing

thrown. But if I disable map side join, it works perfectly fine which showcase that the distributed cache is working and serde jar is available. Any idea what is happening in Map side join? I m using CDH3 Regards, Abhishek

Re: How to load csv data into HIVE

So are you trying get rid of double quotes and pipe symbol?? Regards Abhi Sent from my iPhone On Sep 7, 2012, at 10:18 AM, Sandeep Reddy P wrote: > Hi, > Here is the sample data > "174969274","14-mar-2006"," > 3522876","","14-mar-2006","50308","65","1"| > "174969275","19-jul-2006","352315

Re: HIVE AND HBASE

uilt a > development machine (1 node) with everything I need for HDFS, MapReduce, > Hive, HBase, Oozie, Zookeeper... > > Chuck > > ____ > From: Abhishek [abhishek.dod...@gmail.com] > Sent: Friday, July 27, 2012 6:53 PM > To:

Re: High availability with hive

Thanks for the reply Bejoy. Backing up metastore.db stored in mysql is the only to provide HA in hive? Regards Abhishek Sent from my iPhone On Jul 27, 2012, at 3:02 PM, Bejoy Ks wrote: > Hi Abshiek > > Hadoop 2.0/CDH4 has HA on hdfs level so this HA would be available to all >

Re: High availability with hive

Hi Edward, Thanks for the reply, but Iam trying to install hive with hbase Regards Abhishek Sent from my iPhone On Jul 27, 2012, at 3:15 PM, Edward Capriolo wrote: > Datastax backends the hive metastore into Cassandra making it highly > available, an open sourced Brisk did this orig

Re: HIVE AND HBASE

Hi artem, Thanks for the reply. Can you please elaborate bit more on this. Regards Abhishek Sent from my iPhone On Jul 27, 2012, at 4:47 PM, "Artem Ervits" wrote: > Look at Apache Bigtop project. > > > > > Artem Ervits > Data Analyst > New York Presbyt

Re: HIVE AND HBASE

Hi chuck, Thanks for the reply.Can you elaborate bit more on this auto install tool Regards Abhishek Sent from my iPhone On Jul 27, 2012, at 3:26 PM, "Connell, Chuck" wrote: > I recommend the Cloudera CDH release of Hadoop and their auto-install tool. > It saves a lot of

Fwd: High availability with hive

> > Hi all, > > I am trying to install CDH4, I have a doubt can hive manage HIGH AVALIABILITY? > > Regards > abhishek

Re: Hive query optimization

; > set io.sort.mb=512; > set io.sort.factor=100; > set mapred.reduce.parallel.copies=40; > set hive.map.aggr =true; > set hive.exec.parallel=true; > set hive.groupby.skewindata=true; > set mapred.job.reuse.jvm.num.tasks=-1; > > default values were > > io.sort.mb=256; > io.sort.factor=10; > mapred.reduce.parallel.copies=10; > > Thanks > Abhishek >

Performance tuning a hive query

Apart from partitions and buckets how to improve of hive queries Regards Abhi Sent from my iPhone

Re: Find TOP 10 using HiveQL

Raihan, Andes suggests you use 'limit' after 'desc' ie Hive with sort your query results in descending order and then chop off any more than first 10 records. However, Hive will still run the full scan on data since it has to find the sorted list of records for you. On Tue, Jul 10, 2012 at 8:36 A

Hive insert into

Hi all, Will hive support INSERT INTO ? and It is nothing but, appending new data to the existing data.Can any one please tell me how does it happen and which version of hive supports this? Regards Abhi Sent from my iPhone

Re: How to override a property with in a hive query

Hi Tim, Is this the only way, or if we have any other ways. Sent from my iPhone On Jul 2, 2012, at 8:49 PM, Tim Havens wrote: > Before your query type SET = ; > > On Mon, Jul 2, 2012 at 7:13 PM, Abhishek wrote: > Hi all, > > Can I know, how to override a property of

Fwd: How to override a property with in a hive query

Hi all, Can I know, how to override a property of mapred-site.xml in Hive join query. Suppose for map reduce job we override using -D , how to do it with in hive query. Regards Abhishek. Begin forwarded message: > From: Abhishek > Date: July 2, 2012 8:10:47 PM EDT >

How to a property in hive query

Hi all, Can I know, how to override a property of mapred-site.xml in Hive join query. Suppose for map reduce job we override using -D , how to do it with in hive query. Regards Abhishek Sent from my iPhone

Map side join

Hi all, How map side join in hive, can be used to join multiple tables(suppose 5 tables). Regards Abhishek Sent from my iPhone

Re: Hive Mapside join with Distributed cache

thank you. On Mon, Jun 11, 2012 at 9:03 AM, Bejoy KS wrote: > You just need to enable map joins before executing your join query. > hive> Set hive.auto.convert.join=true > > Regards > Bejoy KS > > Sent from handheld, please excuse typos. > > -Original Messa

Re: Error in Hive execution on cluster : Wrong FS: hdfs

Can you check the configuration in your Hadoop's core-site.xml file. Also are you able to fire fs command from hadoop successfully by using the fully qualified directory structure? Seems a problem in your file system config. Regards, Abhishek On Thu, May 31, 2012 at 1:35 AM, Puneet K

Re: Job Scheduling in Hadoop-Hive

Try Oozie. Regards, Abhishek On Sat, May 26, 2012 at 7:48 AM, Ronak Bhatt wrote: > Hello - > > For those users whose setup is somewhat production, what do you use for > job scheduling and dependency management? > > *thanks, ronak* > * > * > * > * > >

Re: how to create index on hbase?

Does Hbase support secondary indexes? I don't think so!!! I m not sure you can create indexes in Hbase even if it is integrated with hive. Regards, Abhishek On Sun, May 13, 2012 at 7:10 PM, Hezhiqiang (Ransom) < ransom.hezhiqi...@huawei.com> wrote: > Hi all > I want to crea

Re: Reduce operation stuck

Can you paste the logs here? Abhishek On Sun, May 20, 2012 at 9:36 AM, Balaji Rao wrote: > There is only one task attempt that is lurking around and that never > completes. It probably times out or fails after a long time. > > -Balaji > > On Fri, May 18, 2012 at 11:50 PM

  1   2   >