Re: PlanUtils.java use correct classloader when calling Class.forName()

2015-01-27 Thread Navis류승우
Booked on https://issues.apache.org/jira/browse/HIVE-9486. Thanks, Navis 2015-01-27 18:05 GMT+09:00 德明 施 deming@outlook.com: Hi All, I am not having some hive classpath issue. I think this is a bug. I wrote my own SerDe com.stanley.MySerde, which is a simple json serializer; It is

Re: To be included as a Hive contributor

2015-01-13 Thread Navis류승우
We've been failing to add new contributor to HIVE JIRA for months. to PMCs : Should't we fix it? Maybe Carl knows how to do that. 2015-01-13 15:59 GMT+09:00 赵海明 zhao...@asiainfo.com: Admins, I’m a Hive user from Beijing.China, I want to be included as a Hive contributor, and my JIRA

Re: Is there any property for don't deleting scratch dir

2014-12-23 Thread Navis류승우
I think once there was a configuration for it. But cannot find recent releases. Thanks, Navis 2014-12-24 10:46 GMT+09:00 Jeff Zhang zjf...@gmail.com: Hi, Is there any property for don't deleting scratch dir ? I'd like check the intermediate data to know the internal of hive better. --

Re: What's the status of AccessServer?

2014-12-18 Thread Navis류승우
The proposal suggested by Carl. It's once referenced in HIVE-4569 ( https://issues.apache.org/jira/browse/HIVE-4569?focusedCommentId=13691935page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13691935), but seemed not have issue for it. @Carl Steinbach, could you say

Re: How to find Optimize query plan for given Query?

2014-12-15 Thread Navis류승우
You can see the optimized logical operator tree by explain logical your query. And partial operator tree in stages are all optimized one. Thanks, Navis 2014-12-11 22:09 GMT+09:00 Akash Mishra akash.mishr...@gmail.com: Hi All, I am trying to understand the details of how query is optimize in

Re: Request to add to contributor list

2014-12-15 Thread Navis류승우
Strange.. I can remove name in contributor list (I tried with mine) but cannot add name to it. Is there anyone knows about this? Thanks, Navis 2014-12-11 17:33 GMT+09:00 Binglin Chang decst...@gmail.com: Hi, I fire some jira related to hiveserver2(HIVE-9005, HIVE-9006, HIVE-9013), please

Re: [ANNOUNCE] New Hive PMC Member - Prasad Mujumdar

2014-12-09 Thread Navis류승우
Congratulations! 2014-12-10 8:35 GMT+09:00 Jason Dere jd...@hortonworks.com: Congrats! On Dec 9, 2014, at 3:02 PM, Venkat V venka...@gmail.com wrote: Congrats Prasad! On Tue, Dec 9, 2014 at 2:32 PM, Brock Noland br...@cloudera.com wrote: Congratulations Prasad!! On Tue, Dec 9,

Re: 3 configs: hive.added.files.path, hive.added.jars.path, hive.added.archives.path

2014-10-13 Thread Navis류승우
Looks like HIVEADDEDFILES/JARS/ARCHIVES are just internal variables to carry values in HiveConf, which should not be configured by user. We can exclude them from generation of xml. HIVEAUXJARS is a public configuration for user to specify jars to be added to classpath of all jobs. Seemed need a

Re: Restarting hadoop-1 builds

2014-09-25 Thread Navis류승우
Hi, I've booked current build failure problem on HIVE-8265. It seemed this kind of things will happen again. Thanks, Navis 2014-09-26 10:40 GMT+09:00 Szehon Ho sze...@cloudera.com: Hi all, There's been no build coverage of hadoop-1 on hive-trunk since 0.13 release. I'm planning to

Re: Please include me as Hive contributor

2014-09-15 Thread Navis류승우
Done! Thanks, Navis 2014-09-15 18:19 GMT+09:00 Rajat Ratewal rajatrate...@gmail.com: Hi All, Trust you are doing well. Can you please add me as a Hive contributor. My JIRA username is ratewar. Cheers, Rajat Ratewal

Re: Timeline for release of Hive 0.14

2014-09-12 Thread Navis류승우
Hi, I'll really appreciate if HIVE-5690 can be included, which becomes harder and harder to rebase. Other 79 patches I've assigned to can be held on. Thanks, Navis 2014-09-11 19:54 GMT+09:00 Vaibhav Gumashta vgumas...@hortonworks.com: Hi Vikram, Can we also add:

Re: Hive contributor

2014-09-11 Thread Navis류승우
Done! Thanks, Navis 2014-09-12 6:42 GMT+09:00 Sebastien Marti marti@gmail.com: Hi all, Please add me to Hive contributor list My Jira User name : smarti Thanks Sebastien

Re: request to beome a contributor

2014-09-02 Thread Navis류승우
Done! Thanks, Navis 2014-09-03 8:11 GMT+09:00 David Serafini d...@altiscale.com: JIRA user: dbsalti (david serafini) Working on HIVE-7100 thanks, dbs

Re: Running tests in IntelliJ

2014-09-01 Thread Navis류승우
Make a jar dependency on metastore module with hive-metastore,jar and give higher priority to it than module source. Pretty sure there is a better way than this. Thanks, Navis 2014-08-30 18:47 GMT+09:00 Lars Francke lars.fran...@gmail.com: Hi, I'm trying to set up my dev environment

Re: Why does SMB join generate hash table locally, even if input tables are large?

2014-08-03 Thread Navis류승우
I don't think hash table generation is needed for SMB joins. Could you check the result of explain extended? Thanks, Navis 2014-07-31 4:08 GMT+09:00 Pala M Muthaia mchett...@rocketfuelinc.com: +hive-users On Tue, Jul 29, 2014 at 1:56 PM, Pala M Muthaia mchett...@rocketfuelinc.com

Re: hive udf cannot recognize generic method

2014-08-01 Thread Navis류승우
I've booked this on https://issues.apache.org/jira/browse/HIVE-7588. With the patch, something like below are possible. // unknown input public String evaluate(Object arg) { return arg == null ? null : String.valueOf(arg); } // typed variable public T T evaluate(T arg) { return arg; } //

Re: want to be a contributor

2014-07-28 Thread Navis류승우
Done. Feel free assign issues to yourself. Thanks, Navis 2014-07-29 10:41 GMT+09:00 Xu, Cheng A cheng.a...@intel.com: Regards, Ferdinand Xu

Re: Hive exception while getting duplicate records with in the table

2014-07-27 Thread Navis류승우
Try, select a.* from tmp_source_fs_price1 a join ( select fund_id,nav_date,CURRENCY,nav,count(1) from tmp_source_fs_price1 group by fund_id,nav_date,CURRENCY,nav having count(1) 1) b on a.fund_id = b.fund_id ; The grammar you've mentioned is not supported in hive-0.11.0 (hive-0.13.0, by

Re: AST to Query Sring

2014-07-24 Thread Navis류승우
You need TokenRewriteStream for the ASTNode. which is in Context or ParseDriver. String rewrite(TokenRewriteStream rewriter, ASTNode source) throws Exception { // some modification.. return rewriter.toString(source.getTokenStartIndex(), source.getTokenStopIndex()); } Thanks, Navis

Re: [GitHub] hive pull request: HIVE 2304 : for hive2

2014-07-20 Thread Navis류승우
I've attached the patch to https://issues.apache.org/jira/browse/HIVE-6165. If you tell me your name of apache account, I can assign this to you. Thanks, Navis 2014-07-19 17:15 GMT+09:00 Nitin Pawar nitinpawar...@gmail.com: as per understanding, apache hive development does not support git

Re: Archive Replication Issue HIVE-7429

2014-07-16 Thread Navis류승우
Committed to trunk. Thanks Daniel, for the contribution. Navis 2014-07-17 6:20 GMT+09:00 Daniel Weeks dwe...@netflix.com.invalid: I was wondering if someone could quickly review the patch below. It's trivial and is just fixing a order of execution problem when uploading the archive file to

Re: Case problem in complex type

2014-07-14 Thread Navis류승우
: Following POLA[1] I would suggest that ORC should follow conventions as rest of Hive. If all other Struct OI are case-insensitive, than ORC should be as well. 1: http://en.wikipedia.org/wiki/Principle_of_least_astonishment On Thu, Jul 10, 2014 at 10:21 PM, Navis류승우 navis@nexr.com wrote

Re: Case problem in complex type

2014-07-10 Thread Navis류승우
QL Syntax https://cwiki.apache.org/confluence/display/Hive/LanguageManual+ORC#LanguageManualORC-HiveQLSyntax . -- Lefty On Wed, Jul 9, 2014 at 11:48 PM, Navis류승우 navis@nexr.com wrote: For column name, hive restricts it as a lower case string. But how about field name? Currently

Case problem in complex type

2014-07-09 Thread Navis류승우
For column name, hive restricts it as a lower case string. But how about field name? Currently, StructObjectInspector except ORC ignores case(lower case only). This should not be implementation dependent and should be documented somewhere. see https://issues.apache.org/jira/browse/HIVE-6198

Re: [GitHub] hive pull request: Fix lock/unlock pairing

2014-06-26 Thread Navis류승우
Hive in github is just for mirroring of apache svn. So pull request cannot be handled. Could you make a patch and attach it on https://issues.apache.org/jira/browse/HIVE-7303 ? Thanks, Navis 2014-06-26 22:29 GMT+09:00 pavel-sakun g...@git.apache.org: GitHub user pavel-sakun opened a pull

Re: Hive 0.13/Hcatalog : Mapreduce Exception : java.lang.IncompatibleClassChangeError

2014-06-05 Thread Navis류승우
I don't have environment to confirm this. But if the this happens, we should include HIVE-6432 into HIVE-0.13.1. 2014-06-05 12:44 GMT+09:00 Navis류승우 navis@nexr.com: It's fixed in HIVE-6432. I think you should rebuild your own hcatalog from source with profile -Phadoop-1. 2014-06-05 9

Re: Why isn't itests/ listed as submodule of root pom.xml?

2014-03-14 Thread Navis류승우
Should we write this on wiki? :) 2014-03-12 8:46 GMT+09:00 Brock Noland br...@cloudera.com: Hopefully this is the last time I have to say this :) The qfile tests in itests require the packaging phase. The maven test phase is after compile and before packaging. We could change the qfile tests

Re: Timeline for the Hive 0.13 release?

2014-03-05 Thread Navis류승우
I have really big wish list(65 pending) but it would be time to focus on finalization. - Small bugs HIVE-6403 uncorrelated subquery is failing with auto.convert.join=true HIVE-4790 MapredLocalTask task does not make virtual columns HIVE-4293 Predicates following UDTF operator are removed by PPD

Re: [jira] [Commented] (HIVE-6037) Synchronize HiveConf with hive-default.xml.template and support show conf

2014-02-18 Thread Navis류승우
JIRA seemed entered to maintenance status, so replying to mail. I've forget why I made SystemVarilables class in common package, which handled this problem in the first patch. Almost done. 2014-02-19 11:23 GMT+09:00 Brock Noland (JIRA) j...@apache.org: [

Re: Timeline for the Hive 0.13 release?

2014-02-16 Thread Navis류승우
HIVE-6037 is for generating hive-default.template file from HiveConf. Could it be included in this release? If it's not, I'll suspend further rebasing of it till next release (conflicts too frequently). 2014-02-16 20:38 GMT+09:00 Lefty Leverenz leftylever...@gmail.com: I'll try to catch up on

Re: hive precommit tests on bigtop jenkins

2014-02-16 Thread Navis류승우
exit 1 fi On Fri, Feb 14, 2014 at 12:51 AM, Navis류승우 navis@nexr.com wrote: Recently, precommit test takes more than 1 day (including queue time). Deduping work queue (currently, HIVE-6403 and HIVE-6418 is queued twice) can make this better. Rewriting some test queries simpler (I'm

Re: hive precommit tests on bigtop jenkins

2014-02-13 Thread Navis류승우
Recently, precommit test takes more than 1 day (including queue time). Deduping work queue (currently, HIVE-6403 and HIVE-6418 is queued twice) can make this better. Rewriting some test queries simpler (I'm thinking of removing order-by clauses just for conforming purpose). Any other ideas?

Re: [jira] [Commented] (HIVE-6329) Support column level encryption/decryption

2014-02-12 Thread Navis류승우
Yes, I've removed ByteArrayRef from LazyObjectBase, which is just useless overhead. Can we just remove it? 2014-02-13 1:36 GMT+09:00 Brock Noland (JIRA) j...@apache.org: [

Re: Timeline for the Hive 0.13 release?

2014-02-04 Thread Navis류승우
Hi all, We have so much on-going works especially within tez/vectorization/authorization territory and they are all under cover of Hortonworks. Could anyone in the company to tell whether they have some internal milestone for next release? Thanks, Navis 2014-01-21 Brock Noland

Recent test failures in pre-tests

2014-01-27 Thread Navis류승우
Including HIVE-6259, HIVE-6310, etc., recent test failures of minimr tests are seemed to be related to memory issue (not all of them but mostly). {noformat} java.lang.Throwable: Child Error at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:271) Caused by: java.io.IOException: Task

Re: Recent test failures in pre-tests

2014-01-27 Thread Navis류승우
, Xuefu On Mon, Jan 27, 2014 at 6:44 PM, Navis류승우 navis@nexr.com wrote: Including HIVE-6259, HIVE-6310, etc., recent test failures of minimr tests are seemed to be related to memory issue (not all of them but mostly). {noformat} java.lang.Throwable: Child Error

Re: how to use phabricator with maven

2014-01-15 Thread Navis류승우
We don't use phabricator anymore except some patches on it which are made long ago. Use apache review board, instead. - Navis 2014/1/16 Satish Mittal satish.mit...@inmobi.com Hi All, The following phabricator link

Re: Requesting Hive contributor access.

2013-12-29 Thread Navis류승우
I've enlisted you in contributor list (and assigned issues mentioned above to you). Sorry for delay. 2013/12/20 Konstantin Kudryavtsev kudryavtsev.konstan...@gmail.com Hi guys, Could you please grant access for me? I prepared a couple of issues, HIVE-6006 has been already done and path is

Re: map join in subqueries

2013-12-10 Thread Navis류승우
What version are you using? After 0.11.0, mapjoin hint is ignored by default. use, set hive.ignore.mapjoin.hint=false; if you want to mapjoin hint applied. 2013/12/4 Sukhendu Chakraborty sukhendu.chakrabo...@gmail.com Hi, Is there anyway mapjoin works on the subquery(not the underlying

Re: Build seems broken

2013-11-25 Thread Navis류승우
My bad. I should removed the class committing HIVE-4518. 2013/11/26 Xuefu Zhang xzh...@cloudera.com [INFO] BUILD FAILURE [INFO] [INFO] Total time: 5.604s [INFO] Finished at: Mon Nov 25 17:53:20 PST 2013 [INFO] Final

Re: Build seems broken

2013-11-25 Thread Navis류승우
I've forgot to mark delete/add files for the patch. It seemed working now. Sorry for the inconvenience to all. 2013/11/26 Jarek Jarcec Cecho jar...@apache.org I've pushed something that I didn't want couple of minutes ago and then force push to remove it. I'm not sure whether it's caused by

Re: FYI Hive trunk has moved to maven

2013-10-31 Thread Navis류승우
Another great work, Brock! I think this really deserves award the patch of the year. 2013/11/1 Thejas Nair the...@hortonworks.com Thanks Brock and Ed! On Thu, Oct 31, 2013 at 2:36 PM, Brock Noland br...@cloudera.com wrote: Thanks guys. Another FYI, precommit tests are going to come back

Re: [ANNOUNCE] New Hive PMC Members - Thejas Nair and Brock Noland

2013-10-24 Thread Navis류승우
Congrats! 2013/10/25 Gunther Hagleitner ghagleit...@hortonworks.com Congrats Thejas and Brock! Thanks, Gunther. On Thu, Oct 24, 2013 at 3:25 PM, Prasad Mujumdar pras...@cloudera.com wrote: Congratulations Thejas and Brock ! thanks Prasad On Thu, Oct 24, 2013 at

Re: Bootstrap in Hive

2013-09-09 Thread Navis류승우
I don't know anything about statistics but in your case, duplicating splits(x100?) by using custom InputFormat might much simpler. 2013/9/6 Sameer Agarwal samee...@cs.berkeley.edu Hi All, In order to support approximate queries in Hive and BlinkDB ( http://blinkdb.org/), I am working

Re: [ANNOUNCE] New Hive Committer - Yin Huai

2013-09-04 Thread Navis류승우
Congratulations, Yin. I remember your hard work on ysmart ( https://issues.apache.org/jira/browse/HIVE-2206) and others(

Re: [ANNOUNCE] New Hive Committer - Thejas Nair

2013-08-20 Thread Navis류승우
Congratulations! 2013/8/20 Clark Yang (杨卓荦) yangzhuo...@gmail.com: Congrats Thejas! 在 2013年8月20日星期二,Carl Steinbach 写道: The Apache Hive PMC has voted to make Thejas Nair a committer on the Apache Hive project. Please join me in congratulating Thejas!

Re: Proposing a 0.11.1

2013-08-13 Thread Navis류승우
If this is only for addressing npath problem, we got three months for that. Would it be enough time for releasing 0.12.0? ps. IMHO, n-path seemed too generic name to be patented. I hate Teradata. 2013/8/14 Edward Capriolo edlinuxg...@gmail.com: Should we get the npath rename in? Do we have a

Re: Discuss: End of static, thread local

2013-08-10 Thread Navis류승우
https://issues.apache.org/jira/browse/HIVE-4226 seemed addressing this. 2013/8/11 Brock Noland br...@cloudera.com: I would love to get rid of the static thread local stuff. It was required to make hive work in a server model but isn't the correct solution to this problem. I do think it will

Re: [ANNOUNCE] New Hive Committer - Gunther Hagleitner

2013-07-22 Thread Navis류승우
I'm a little late. Congratulations Gunther and Brock! 2013/7/21 Prasanth J j.prasant...@gmail.com: Congrats Gunther! Thanks -- Prasanth On Jul 21, 2013, at 1:00 AM, Carl Steinbach c...@apache.org wrote: The Apache Hive PMC has voted to make Gunther Hagleitner a committer on the Apache

Re: GROUP BY Issue

2013-06-13 Thread Navis류승우
Your table has five F1 = 9887 rows and joining will make 25 rows with the same F1 value. I cannot imagine what you're intended to do. 2013/6/12 Gourav Sengupta gourav.had...@gmail.com: Hi, I had initially forwarded this request to the user group but am yet to receive any response. I will

Re: [VOTE] Apache Hive 0.11.0 Release Candidate 2

2013-05-15 Thread Navis류승우
+1 - built from source, passed all tests (without assertion fail or conversion to backup task) - working good with queries from running-site - some complaints on missing HIVE-4172 (void type for JDBC2) Thanks 2013/5/12 Owen O'Malley omal...@apache.org: Based on feedback from everyone, I have

Re: [ANNOUNCE] New Hive Committers: Harish Butani and Owen O'Malley

2013-04-15 Thread Navis류승우
We are happy with newly added window functions and ORC format. Congratulations! 2013/4/16 Carl Steinbach c...@apache.org: The Hive PMC has voted to make Harish Butani and Owen O'Malley committers on the Apache Hive Project. A list of Harish's contributions to the project can be seen here:

Re: lots of tests failing

2013-04-09 Thread Navis류승우
Yes, it's all my fault. I've forgot that the Driver affects test results. Reverting HIVE-1953 is created(HIVE-4319) and ready to be committed. Again, sorry for all the troubles to community (especially for Vikram). I should think twice before doing things. 2013/4/10 Namit Jain nj...@fb.com: It

[discussion] Convention for internal magic words

2012-12-10 Thread Navis류승우
Hi, All Doing HIVE-3431(https://issues.apache.org/jira/browse/HIVE-3431), I needed to define a magic word which means this is not a path string and translate it as a temporary directory. I think HIVE-3779 (https://issues.apache.org/jira/browse/HIVE-3779) also might need something like that.

Re: stats19.q is failing on the current trunk?

2012-12-10 Thread Navis류승우
It's booked on https://issues.apache.org/jira/browse/HIVE-3783 and I also seen this. 2012/12/11 Zhenxiao Luo zhenx...@fb.com: Always get this diff: [junit] diff -a /home/zhenxiao/Code/hive/build/ql/test/logs/clientpositive/stats19.q.out

Re: writing your own custom map-reduce to scan a table

2012-08-20 Thread Navis류승우
How about using HCatalogue? I heard it's made for that kind of works. 2012/8/18 Mahsa Mofidpoor mofidp...@gmail.com Hi all, Does anybody know how you can write your own custom mapReduce to scan a table? Thank you in advance for your response. Mahsa

Re: non map-reduce for simple queries

2012-07-30 Thread Navis류승우
, 2012 at 6:17 PM, Navis류승우 navis@nexr.com wrote: I was thinking of timeout for fetching, 2000msec for example. How about that? Instead of time, which requires launching the query and letting it timeout, how about determining the number of bytes that would need to be fetched to the local

Re: non map-reduce for simple queries

2012-07-28 Thread Navis류승우
I was thinking of timeout for fetching, 2000msec for example. How about that? 2012년 7월 29일 일요일에 Edward Caprioloedlinuxg...@gmail.com님이 작성: If where condition is too complex , selecting specific columns seems simple enough and useful. On Saturday, July 28, 2012, Namit Jain nj...@fb.com wrote:

Re: Problems with Arc/Phabricator

2012-05-09 Thread Navis류승우
Me too. arc diff --trace .. PHP Fatal error: Uncaught exception 'HTTPFutureResponseStatusHTTP' with message '[HTTP/500]' in /home/navis/bin/libphutil/src/future/http/base/BaseHTTPFuture.php:299 Stack trace: #0 /home/navis/bin/libphutil/src/future/http/https/HTTPSFuture.php(95):