-
65957 [uber-SubtaskRunner] INFO org.apache.hadoop.hive.ql.log.PerfLogger -
66040 [uber-SubtaskRunner] INFO org.apache.hadoop.hive.ql.log.PerfLogger -
66041 [uber-SubtaskRunner] INFO org.apache.hadoop.hive.ql.log.PerfLogger -
r7raul1...@163.com
Place the file on the hiveserver2 host local filesystem . Then try load
data local inpath
r7raul1...@163.com
From: Vineet Mishra
Date: 2015-10-21 03:05
To: user
CC: cdh-user
Subject: Re: HiveServer2 load data inpath fails
Any update around this?
0: jdbc:hive2://hadoop-hs2:1> l
will decrease the number of output files.
r7raul1...@163.com
From: Jagat Singh
Date: 2015-10-21 08:49
To: user
Subject: Hive ORC file execption serious problem
We are using Hive 0.14
Our input file size is around 100 GB uncompressed
We are using insering this data to hive which is ORC based table , ZLIB
Or you can use --verbose=[true/false] when use jdbc client.
Show verbose error messages and debug information (true) or do not show
(false). Default is false.
Usage: beeline --verbose=true
r7raul1...@163.com
From: r7raul1...@163.com
Date: 2015-10-20 13:07
To: user
Subject: Re: Re
/false]
Display nested errors. Default is false.
Usage: beeline --showNestedErrs=true
r7raul1...@163.com
From: Jerrick Hoang
Date: 2015-10-20 11:55
To: user
Subject: Re: Hiveserver2 client stdout
That would just increase the log level on the server side right? I want the
stdout log sent
)
4 UDFToDouble(attr_detl_id) (type: double)
r7raul1...@163.com
From: Gopal Vijayaraghavan
Date: 2015-08-29 01:45
To: user
Subject: Re: sql mapjoin very slow
I have a question. I use hive 1.1.0 ,so hive.stats.dbclass default value
is fs. Mean store statistics
in local filesystem
statistics in local filesystem. Any one can tell what is the file
path to store statistics ?
r7raul1...@163.com
From: r7raul1...@163.com
Date: 2015-08-28 13:03
To: user
Subject: Re: Re: sql mapjoin very slow
I increase hive.hashtable.initialCapacity to 100 and decrease
I increase hive.hashtable.initialCapacity to 100 and decrease
hive.hashtable.loadfactor to 0.5 . The query run faster.
r7raul1...@163.com
From: Sergey Shelukhin
Date: 2015-08-28 09:56
To: user
Subject: Re: sql mapjoin very slow
Is the small-side table large, does it have a lot of rows
I use MR.
My mapjoin config as showed in follow picture:
r7raul1...@163.com
From: Sergey Shelukhin
Date: 2015-08-28 09:21
To: user
Subject: Re: sql mapjoin very slow
Are you using MR and Tez? You could try optimized hash table in case of Tez,
although it’s supposed to improve memory
BTW , my hadoop version is 2.3.0-cdh5.0.2
r7raul1...@163.com
From: Jeff Zhang
Date: 2015-06-29 13:23
To: user
Subject: Re: hive -e run tez query error
But keeping that client cache disabled when running against trunk generally
kills queries all the time with occasional errors like
Sorry , I made a mistake,
use hivecli to execute same query on tez ,throw the same exception.
r7raul1...@163.com
From: r7raul1...@163.com
Date: 2015-06-23 13:53
To: user
Subject: hive -e run tez query error
When I use hive 1.1.0 on tez 0.53 in hadoop 2.3.0:
hive -v -e set
My hive version is 1.1.0
r7raul1...@163.com
From: Alan Gates
Date: 2015-06-18 23:25
To: user
Subject: Re: delta file compact take no effect
Which version of Hive are you running? A number of deadlock issues were
resolved in HIVE-10500 which was released in Hive 1.2. Based on your log
query on mr ,no exeception throw
r7raul1...@163.com
r7raul1...@163.com
From: r7raul1...@163.com
Date: 2015-06-18 08:37
To: user
Subject: Re: Re: delta file compact take no effect
Thank you! I will try
r7raul1...@163.com
From: Alan Gates
Date: 2015-06-18 08:33
To: user
Subject: Re: delta file compact take no effect
See
https://cwiki.apache.org
My config is on my client. What is metastore config?
r7raul1...@163.com
From: Alan Gates
Date: 2015-06-17 13:42
To: user
Subject: Re: delta file compact take no effect
Is the config you give on your metastore or your client? The worker thread and
initiator must be started on the metastore
Any help?
r7raul1...@163.com
From: r7raul1...@163.com
Date: 2015-06-11 15:53
To: user
Subject: Re: Re: delta file compact take no effect
SHOW COMPACTIONS;
I can see some info
Database Table Partition Type State Worker Start Time
default u_data_txn NULL MAJOR initiated NULL 0
Time taken
SHOW COMPACTIONS;
I can see some info
Database Table Partition Type State Worker Start Time
default u_data_txn NULL MAJOR initiated NULL 0
Time taken: 0.024 seconds, Fetched: 2 row(s)
But after that I still see many delta file.
r7raul1...@163.com
From: Elliot West
Date: 2015-06-11 15:25
/property
property
namehive.txn.manager/name
valueorg.apache.hadoop.hive.ql.lockmgr.DbTxnManager/value
/property
property
namehive.compactor.initiator.on/name
valuetrue/value
/property
property
namehive.compactor.worker.threads/name
value4/value
/property
r7raul1...@163.com
hive -hiveconf hive.root.logger=DEBUG,consoleTo See some debug log
r7raul1...@163.com
From: Sateesh Karuturi
Date: 2015-06-08 16:15
To: user
Subject: hive tez error
getting FAILED: Execution Error, return code 1 from
org.apache.hadoop.hive.ql.exec.tez.TezTask
error... when iam trying
) {
if ( left == null ) {
return right;
} else if ( right == null ) {
return left;
} else {
ASTNode and = new ASTNode(new CommonToken(AND,and));
and.addChild(left);
and.addChild(right);
return and;
}
}
}
r7raul1...@163.com
From: Amitosh Anand, IDD M Tech, Computer Sci. Engg., IIT (BHU
You can refer to the cursor columns using cur_name.col_name syntax
Great job!
r7raul1...@163.com
From: Dmitry Tolpeko
Date: 2015-05-01 03:43
To: user
Subject: Re: PL/HQL - Procedural SQL-on-Hadoop
Hi everyone,
PL/HQL 0.3.1 released today. There are some features I hope you find
config hdfs acl
http://zh.hortonworks.com/blog/hdfs-acls-fine-grained-permissions-hdfs-files-hadoop/
r7raul1...@163.com
From: Anupam sinha
Date: 2015-05-21 12:44
To: user
Subject: Re: upgrade of Hadoop cluster from 5.1.2 to 5.2.1.
Hello everyone,
i am a member of nested group which has
I want to pring lineage info of sql. I found this jira
https://issues.apache.org/jira/browse/HIVE-1131 . How to use it?
r7raul1...@163.com
r7raul1...@163.com
11, 2015 at 12:35 PM, r7raul1...@163.com r7raul1...@163.com wrote:
Status: Running (Executing on YARN cluster with App id
application_1419300485749_1493279)
VERTICES STATUS TOTAL COMPLETED RUNNING PENDING FAILED
I see only 1 reduce run forerver. Skew join?
r7raul1...@163.com
From: Eugene Koifman
Date: 2015-05-12 01:43
To: user
CC: r7raul1...@163.com
Subject: Re: hive sql on tez run forever
This isn’t a valid rewrite.
if a(x,y) has 1 row (1,2) and b(x,z) has 1 row (1,1) then the 1st query
), comb_prod_id (type: bigint)
r7raul1...@163.com
Thank you!
r7raul1...@163.com
From: Gerald-G
Date: 2015-05-06 10:35
To: user
Subject: Re: How to config hive when using namenode HA
Upgrading the Hive Metastore to Use HDFS HA Using the Command Line
To configure the Hive metastore to use HDFS HA, change the records to reflect
the location
VERTICES: 11/13 [==] 55% ELAPSED TIME: 307.54 s
What is the root cause ?
r7raul1...@163.com
sql.txt
Description: Binary data
queryplan.TXT
Description: Binary data
I want to turn my single namenode to namenode HA. How to config hive ?
r7raul1...@163.com
SELECT
FROM A LEFT SEMI JOIN B
ON (A.col1 = B.col2)
WHERE ...
If A.col1 is of DOUBLE type, but B.col2 is of BIGINT, will print WARNING:
Comparing a bigint and a double may result in a loss of precision. Why can't
cast col2 to double automatically?
r7raul1...@163.com
14837289 NULL
Y49EY895ACABHS95DRQEE8DVFEB8JSE12360853052224 111501191426280023
115883224 NULL
r7raul1...@163.com
115883224 2015-01-19 14:26:28
Why ? I attach my log. Also in my log I found 2015-04-01 09:55:38,409 WARN
[main] org.apache.hadoop.hive.serde2.lazy.LazyStruct: Extra bytes detected at
the end of the row! Ignoring similar problems.
r7raul1...@163.com
log.TXT
Description: Binary data
I fix it . Need also replace the Hadoop23Shims.class in hive-exe.jar
r7raul1...@163.com
From: r7raul1...@163.com
Date: 2015-03-19 10:34
To: user
Subject: Hive 1.1.0 not compatible with Hadoop 2.3.0
I follow this jira https://issues.apache.org/jira/browse/HIVE-9957 ,then build
a new hive
)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
r7raul1...@163.com
My hive version is hive 0.14.0 , type SHOW COMPACTIONS in cli return exception.
But I type sql in the cli ,the sql run successful on mr.
r7raul1...@163.com
From: Alan Gates
Date: 2015-03-19 00:17
To: user
Subject: Re: SHOW COMPACTIONS fail with remote metastore
When you say but run sql
)
at org.apache.hadoop.hive.ql.metadata.Hive.showCompactions(Hive.java:2848)
... 20 more
FAILED: Execution Error, return code 1 from
org.apache.hadoop.hive.ql.exec.DDLTask.
org.apache.thrift.transport.TTransportException
but run sql the job is ok.
r7raul1...@163.com
read this article
http://www.philippeadjiman.com/blog/2009/12/20/hadoop-tutorial-series-issue-2-getting-started-with-customized-partitioning/
then read
https://cwiki.apache.org/confluence/display/Hive/LanguageManual+SortBy
r7raul1...@163.com
From: max scalf
Date: 2015-03-08 07:02
I type plhql --version but meet error bash: /usr/plhql/plhql:
/bin/bash^M: bad interpreter: No such file or directory
r7raul1...@163.com
From: Dmitry Tolpeko
Date: 2015-02-28 04:36
To: user
Subject: PL/HQL - Procedural SQL-on-Hadoop
Let me introduce PL/HQL, an open source tool
Use yarn logs -applicationId appId to see detail log.
r7raul1...@163.com
From: Jadhav Shweta
Date: 2015-02-26 15:00
To: user
Subject: Re: ERROR OutOfMemoryError: Java heap space
Hi,
I tried running same query from Simple JDBC Client instead of Spring Batch
framework its was working fine
Try select * from table limit 1;
r7raul1...@163.com
From: Jadhav Shweta
Date: 2015-02-25 17:38
To: user
Subject: Re: ERROR OutOfMemoryError: Java heap space
Hi
I have installed apache hive 0.13.0.
I have configured metastore as postgres db.
Query is working fine in beeline command line
image object. It would be wasteful to actually invoke
thumbnail on each reference to an image.
Question:
1 Hive support udf cache ?
2 How hive implement udf cache?
r7raul1...@163.com
Thank you ~
r7raul1...@163.com
From: Devopam Mittra
Date: 2015-02-24 20:15
To: user@hive.apache.org
Subject: Re: Re: How to query data by page in Hive?
Apologies for the extended delay in providing response. I totally forgot about
this one and got stuck in other things.
Please find below
Hello,
How to query data by page in Hive?
hive select * from u_data a limit 1,2;
FAILED: ParseException line 1:31 missing EOF at ',' near '1'
r7raul1...@163.com
Thank you Devopam! Could you show me a example?
r7raul1...@163.com
From: Devopam Mittra
Date: 2015-02-05 18:05
To: user@hive.apache.org
Subject: Re: How to query data by page in Hive?
You may want to use a ROW_NUMBER OR RANK / DENSE RANK in the inner query and
then select only a subset
/1
Map 1: 0/1
Map 1: 0/1
Map 1: 0/1
Map 1: 0/1
Map 1: 0/1
Map 1: 0/1
Map 1: 0/1
Map 1: 0/1
Map 1: 0/1
Map 1: 0/1
Map 1: 0/1
Map 1: 0/1
r7raul1...@163.com
applog_hivetez.txt
Description: Binary data
46 matches
Mail list logo
