Re: Custom UserDefinedFunction in Hive

2012-08-07 Thread Jan Dolinár
Hi Jamal, Check if the function really returns what it should and that your data are really in MMdd format. You can do this by simple query like this: SELECT dt, yesterdaydate('MMdd') FROM REALTIME LIMIT 1; I don't see anything wrong with the function itself, it works well for me

[jira] [Updated] (HIVE-3268) expressions in cluster by are not working

2012-08-07 Thread Namit Jain (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-3268: - Status: Patch Available (was: Open) comments addressed, latest patch attached

[jira] [Updated] (HIVE-3268) expressions in cluster by are not working

2012-08-07 Thread Namit Jain (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-3268: - Attachment: hive.3268.2.patch expressions in cluster by are not working

Re: Custom UserDefinedFunction in Hive

2012-08-07 Thread Raihan Jamal
I tested that function using main and by printing it out and it works fine. As I am trying to get the Yesterday's date. I need my query to be like this as today's date is Aug 6th, so query should be for Aug 5th. And this works fine for me. *SELECT * FROM REALTIME where dt= '20120805' LIMIT 10;*

[jira] [Created] (HIVE-3339) Change the rules in SemanticAnalyzer to use Operator.getName() instead of hardcoded names

2012-08-07 Thread Namit Jain (JIRA)
Namit Jain created HIVE-3339: Summary: Change the rules in SemanticAnalyzer to use Operator.getName() instead of hardcoded names Key: HIVE-3339 URL: https://issues.apache.org/jira/browse/HIVE-3339

[jira] [Updated] (HIVE-2843) UDAF to convert an aggregation to a map

2012-08-07 Thread David Worms (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Worms updated HIVE-2843: -- Affects Version/s: 0.10.0 Status: Patch Available (was: Open) UDAF to convert an

[jira] [Updated] (HIVE-2843) UDAF to convert an aggregation to a map

2012-08-07 Thread David Worms (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Worms updated HIVE-2843: -- Attachment: HIVE-2843.1.patch.txt UDAF to convert an aggregation to a map

[jira] [Updated] (HIVE-3141) Bug in SELECT query

2012-08-07 Thread Ajesh Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajesh Kumar updated HIVE-3141: -- Attachment: HIVE-3141.1.patch.txt Made change in CliDriver.java to make a check on the syntax of select

[jira] [Updated] (HIVE-3141) Bug in SELECT query

2012-08-07 Thread Ajesh Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajesh Kumar updated HIVE-3141: -- Labels: patch (was: ) Affects Version/s: 0.9.0 Status: Patch Available

Re: Possible patch to fix column comments with non-native SerDe

2012-08-07 Thread Stephen R. Scaffidi
So, the patch doesn not seem to fix the problem we are having, but it combined with the one I sent to the list seems to take care of it. I will continue to study this issue and report back on any issues. Thanks again! On 08/06/2012 06:59 PM, Stephen Scaffid wrote: Thanks! I'll see how it

Build failed in Jenkins: Hive-0.9.1-SNAPSHOT-h0.21-keepgoing=false #99

2012-08-07 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hive-0.9.1-SNAPSHOT-h0.21-keepgoing=false/99/ -- [...truncated 10205 lines...] [echo] Project: odbc [copy] Warning: https://builds.apache.org/job/Hive-0.9.1-SNAPSHOT-h0.21-keepgoing=false/ws/hive/odbc/src/conf

[jira] [Updated] (HIVE-967) Implement show create table

2012-08-07 Thread Feng Lu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feng Lu updated HIVE-967: - Attachment: HIVE-967.3.patch.txt The diff is updated and a current patch is attached here.

Re: Custom UserDefinedFunction in Hive

2012-08-07 Thread Raihan Jamal
Hi Jan, I figured that out, it is working fine for me now. The only question I have is, if I am doing like this- SELECT * FROM REALTIME where dt= yesterdaydate('MMdd') LIMIT 10; Then the above query will be evaluated as below right? SELECT * FROM REALTIME where dt= ‘20120806’ LIMIT

Re: Changing table types from managed to external

2012-08-07 Thread Igor Tatarinov
Try ALTER TABLE table SET TBLPROPERTIES('EXTERNAL'='TRUE'); It worked for me. igor decide.com On Mon, Aug 6, 2012 at 11:08 PM, Babe Ruth gtevelde-h...@hotmail.comwrote: Hello, I created a managed table in HIVE when i intended for it to be external, is it possible for me to change the

Re: Custom UserDefinedFunction in Hive

2012-08-07 Thread kulkarni.swar...@gmail.com
Have you tried using EXPLAIN[1] on your query? I usually like to use that to get a better understanding of what my query is actually doing and debugging at other times. [1] https://cwiki.apache.org/confluence/display/Hive/LanguageManual+Explain On Tue, Aug 7, 2012 at 12:20 PM, Raihan Jamal

Re: Custom UserDefinedFunction in Hive

2012-08-07 Thread Jan Dolinár
I'm afraid that he query SELECT * FROM REALTIME where dt= yesterdaydate('MMdd') LIMIT 10; will scan entire table, because the functions is evaluated at runtime, so Hive doesn't know what the value is when it decides which files to scan. I am not 100% sure though, you should try it. Also,

Re: Custom UserDefinedFunction in Hive

2012-08-07 Thread Jan Dolinár
Oops, sorry I made a copypaste mistake :) The annotation should read @*UDFType(deterministic=true*) Jan On Tue, Aug 7, 2012 at 7:37 PM, Jan Dolinár dolik@gmail.com wrote: I'm afraid that he query SELECT * FROM REALTIME where dt= yesterdaydate('MMdd') LIMIT 10; will scan entire

Re: Some Weird Behavior

2012-08-07 Thread Techy Teck
I am not sure about the data, but when we do SELECT count(*) from data_realtime where dt='20120730' and uid is null I get the count but If I do- SELECT * from data_realtime where dt='20120730' and uid is null I get zero record back. But if all the record is NULL then I should be getting NULL

Re: Some Weird Behavior

2012-08-07 Thread Techy Teck
I am running Hive 0.6. On Tue, Aug 7, 2012 at 11:04 AM, kulkarni.swar...@gmail.com kulkarni.swar...@gmail.com wrote: What is the hive version that you are using? On Tue, Aug 7, 2012 at 12:57 PM, Techy Teck comptechge...@gmail.comwrote: I am not sure about the data, but when we do

Re: Custom UserDefinedFunction in Hive

2012-08-07 Thread Raihan Jamal
Hi Jan, I have date in different format also, so that is the reason I was thinking to do by this approach. How can I make sure this will work on the selected partition only and it will not scan the entire table. I will add your suggestion in my UDF as deterministic thing. My simple question here

Re: Some Weird Behavior

2012-08-07 Thread kulkarni.swar...@gmail.com
In that case you might want to try count(1) instead of count(*) and see if that makes any difference. [1] [1] https://issues.apache.org/jira/browse/HIVE-287 On Tue, Aug 7, 2012 at 1:07 PM, Techy Teck comptechge...@gmail.com wrote: I am running Hive 0.6. On Tue, Aug 7, 2012 at 11:04 AM,

[jira] [Created] (HIVE-3340) shims unit test failures fails further test progress

2012-08-07 Thread Giridharan Kesavan (JIRA)
Giridharan Kesavan created HIVE-3340: Summary: shims unit test failures fails further test progress Key: HIVE-3340 URL: https://issues.apache.org/jira/browse/HIVE-3340 Project: Hive

[jira] [Updated] (HIVE-3337) Create Table Like should copy configured Table Parameters

2012-08-07 Thread Bhushan Mandhani (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhushan Mandhani updated HIVE-3337: --- Attachment: HIVE-3337.1.patch.txt Create Table Like should copy configured Table

[jira] [Updated] (HIVE-3337) Create Table Like should copy configured Table Parameters

2012-08-07 Thread Bhushan Mandhani (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhushan Mandhani updated HIVE-3337: --- Labels: configuration (was: ) Status: Patch Available (was: Open) Submitting patch

Re: Some Weird Behavior

2012-08-07 Thread Techy Teck
Let me try that and I will update on this thread If I found something interesting. Thanks for the help kulkarni. On Tue, Aug 7, 2012 at 11:10 AM, kulkarni.swar...@gmail.com kulkarni.swar...@gmail.com wrote: In that case you might want to try count(1) instead of count(*) and see if that

[jira] [Updated] (HIVE-3340) shims unit test failures fails further test progress

2012-08-07 Thread Giridharan Kesavan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giridharan Kesavan updated HIVE-3340: - Attachment: HIVE-3340.patch shims unit test failures fails further test progress

[jira] [Updated] (HIVE-3340) shims unit test failures fails further test progress

2012-08-07 Thread Giridharan Kesavan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giridharan Kesavan updated HIVE-3340: - Status: Patch Available (was: Open) shims unit test failures fails further test

[jira] [Created] (HIVE-3341) Making hive tests run against different MR versions

2012-08-07 Thread Sushanth Sowmyan (JIRA)
Sushanth Sowmyan created HIVE-3341: -- Summary: Making hive tests run against different MR versions Key: HIVE-3341 URL: https://issues.apache.org/jira/browse/HIVE-3341 Project: Hive Issue

[jira] [Commented] (HIVE-3337) Create Table Like should copy configured Table Parameters

2012-08-07 Thread Carl Steinbach (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13430602#comment-13430602 ] Carl Steinbach commented on HIVE-3337: -- +1. Will commit if tests pass.

Re: Logging info is not present in console output

2012-08-07 Thread kulkarni.swar...@gmail.com
Are you running via console? The default logging level is WARN. $HIVE_HOME/bin/hive -hiveconf hive.root.logger=INFO,console This should print the INFO messages onto the console. On Tue, Aug 7, 2012 at 4:07 PM, Ablimit Aji abli...@gmail.com wrote: Hi, I have put some LOG.info() statements

Re: Logging info is not present in console output

2012-08-07 Thread Ablimit Aji
That's what I'm using right now. It was totally functional in SymenticAnalyzer, but not working properly for JOIN. On Tue, Aug 7, 2012 at 5:28 PM, kulkarni.swar...@gmail.com kulkarni.swar...@gmail.com wrote: Are you running via console? The default logging level is WARN. $HIVE_HOME/bin/hive

RE: Changing table types from managed to external

2012-08-07 Thread Babe Ruth
Thanks Igor! It worked! Date: Mon, 6 Aug 2012 23:26:04 -0700 Subject: Re: Changing table types from managed to external From: i...@decide.com To: u...@hive.apache.org CC: dev@hive.apache.org TryALTER TABLE table SET TBLPROPERTIES('EXTERNAL'='TRUE'); It worked for me. igordecide.com On

[jira] [Commented] (HIVE-3341) Making hive tests run against different MR versions

2012-08-07 Thread Sushanth Sowmyan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13430651#comment-13430651 ] Sushanth Sowmyan commented on HIVE-3341: Phabricator review request posted at :

[jira] [Updated] (HIVE-3341) Making hive tests run against different MR versions

2012-08-07 Thread Sushanth Sowmyan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sushanth Sowmyan updated HIVE-3341: --- Status: Patch Available (was: Open) Making hive tests run against different MR versions

Hive-trunk-h0.21 - Build # 1596 - Failure

2012-08-07 Thread Apache Jenkins Server
Changes for Build #1596 1 tests failed. REGRESSION: org.apache.hadoop.hive.cli.TestNegativeCliDriver.testNegativeCliDriver_script_broken_pipe1 Error Message: Unexpected exception See build/ql/tmp/hive.log, or try ant test ... -Dtest.silent=false to get more logs. Stack Trace:

[jira] [Created] (HIVE-3342) Hive: Query misaligned result for Group by followed by Join with filter and skip a group-by result

2012-08-07 Thread Gang Tim Liu (JIRA)
Gang Tim Liu created HIVE-3342: -- Summary: Hive: Query misaligned result for Group by followed by Join with filter and skip a group-by result Key: HIVE-3342 URL: https://issues.apache.org/jira/browse/HIVE-3342

[jira] [Created] (HIVE-3343) Hive: Query misaligned result for Group by followed by Join with filter and skip a group-by result

2012-08-07 Thread Gang Tim Liu (JIRA)
Gang Tim Liu created HIVE-3343: -- Summary: Hive: Query misaligned result for Group by followed by Join with filter and skip a group-by result Key: HIVE-3343 URL: https://issues.apache.org/jira/browse/HIVE-3343

[jira] [Commented] (HIVE-3343) Hive: Query misaligned result for Group by followed by Join with filter and skip a group-by result

2012-08-07 Thread Gang Tim Liu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13430757#comment-13430757 ] Gang Tim Liu commented on HIVE-3343: If we remove b.k1 5, it will generate right

[jira] [Commented] (HIVE-3343) Hive: Query misaligned result for Group by followed by Join with filter and skip a group-by result

2012-08-07 Thread Gang Tim Liu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13430761#comment-13430761 ] Gang Tim Liu commented on HIVE-3343: root-cause is ColumnPrunerFilterProc doesn't

[jira] [Commented] (HIVE-2468) Make Hive compile against Hadoop 0.23

2012-08-07 Thread Namit Jain (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13430881#comment-13430881 ] Namit Jain commented on HIVE-2468: -- @Carl: can the above be used to compile hive source

compiling hive on hadoop 23

2012-08-07 Thread Namit Jain
I was trying to add a test case which only works for hadoop 23. However, I got some errors when I tried to compile: I tried the following: ant -Dhadoop.version=0.23.0 -Dhadoop.security.version=0.23.0 -Dhadoop.security.version.prefix=0.23 package ant -Dhadoop.version=0.23.0 package looking

[jira] [Updated] (HIVE-3141) Bug in SELECT query

2012-08-07 Thread Namit Jain (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-3141: - Status: Open (was: Patch Available) Bug in SELECT query --- Key:

[jira] [Commented] (HIVE-3141) Bug in SELECT query

2012-08-07 Thread Namit Jain (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13430885#comment-13430885 ] Namit Jain commented on HIVE-3141: -- Can you add negative test for the scenarios you