Re: UDAF HELP
Hi, i have a requirement to compare two different columns in 2 adjacent rows and if values are equal, it should return a non zero value else should give 0 as result. Please let me know how can we implement using UDAF(User Defined Aggregate Function) in hive. TIA. Regards, Swagtk On Fri, Aug 16, 2013 at 11:43 PM, Swagatika Tripathy swagatikat...@gmail.com wrote: Hi, i have a requirement to compare two different columns in 2 adjacent rows and if values are equal, it should return a non zero value else should give 0 as result. Please let me know how can we implement using UDAF(User Defined Aggregate Function) in hive. TIA. Regards, Swagatika
can hive do paging query result?
the limit cause has no offset option,how to page result query by hive?
LAG throws exceptions
Hi, I am executing the below query using lag in 0.11 in Amazon EMR cluster. SELECT id , MARKET_ID, city, product_id, SALE_DAY, isbn, seller_ID, currency, lag(quantity,1,0) over (partition by isbn,ID,MARKET_ID,city,seller_ID,currency order by SALE_DAY) AS start_quantity FROM test_table This simple query ended with below exceptions: Exception in thread Thread-758 java.lang.ClassFormatError: org/apache/hadoop/mapred/TaskLogServlet at org.apache.hadoop.hive.shims.Hadoop20SShims.getTaskAttemptLogUrl(Hadoop20SShims.java:49) at org.apache.hadoop.hive.ql.exec.JobDebugger$TaskInfoGrabber.getTaskInfos(JobDebugger.java:190) at org.apache.hadoop.hive.ql.exec.JobDebugger$TaskInfoGrabber.run(JobDebugger.java:146) at java.lang.Thread.run(Thread.java:724) Counters: FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.MapRedTask Any thoughts on this? Please let me know, if i am doing something wrong. -- Thanks, Pandeeswaran
question about get part result from hive
hi,all: i have a problem ,i have a hive table ,it source data based on HDFS,and i want to get part query result for processing(the whole data is huge,so must load partly),any good suggestions? (hive has no paging query result function)
Re: LAG throws exceptions
Can you fetch the logs from jobtracker url and use pastebin to provide log? This is client side error, the actual error is on job page On Mon, Aug 19, 2013 at 8:28 AM, pandees waran pande...@gmail.com wrote: Hi, I am executing the below query using lag in 0.11 in Amazon EMR cluster. SELECT id , MARKET_ID, city, product_id, SALE_DAY, isbn, seller_ID, currency, lag(quantity,1,0) over (partition by isbn,ID,MARKET_ID,city,seller_ID,currency order by SALE_DAY) AS start_quantity FROM test_table This simple query ended with below exceptions: Exception in thread Thread-758 java.lang.ClassFormatError: org/apache/hadoop/mapred/TaskLogServlet at org.apache.hadoop.hive.shims.Hadoop20SShims.getTaskAttemptLogUrl(Hadoop20SShims.java:49) at org.apache.hadoop.hive.ql.exec.JobDebugger$TaskInfoGrabber.getTaskInfos(JobDebugger.java:190) at org.apache.hadoop.hive.ql.exec.JobDebugger$TaskInfoGrabber.run(JobDebugger.java:146) at java.lang.Thread.run(Thread.java:724) Counters: FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.MapRedTask Any thoughts on this? Please let me know, if i am doing something wrong. -- Thanks, Pandeeswaran -- Nitin Pawar
Re: can hive do paging query result?
You can use beeswax from hue. It will neatly page your results. On Sun, Aug 18, 2013 at 11:39 PM, Nitin Pawar nitinpawar...@gmail.comwrote: it can not page, it displays all the results on the console to avoid this, we either put the output in another table or put it inside a file On Mon, Aug 19, 2013 at 8:16 AM, ch huang justlo...@gmail.com wrote: the limit cause has no offset option,how to page result query by hive? -- Nitin Pawar -- Swarnim
