Yes, I just find this. Thanks. In my hadoop-env.sh, I defined my HADOOP_CLASSPATH. Now, I define my HADOOP_CLASSPATH as following: export HADOOP_CLASSPATH=$HADOOP_CLASSPATH:my defined classpaths....
On Tue, Oct 20, 2009 at 2:05 AM, Ryan LeCompte <[email protected]> wrote: > Hello, > > I solved this by making sure that the Hive libraries in /build/dist/lib > were specified in my hadoop/conf/hadoop-env.sh config file CLASSPATH. This > way they were available when starting up the hive CLI tool. > > Thanks, > Ryan > > > > On Mon, Oct 19, 2009 at 2:00 PM, Schubert Zhang <[email protected]> wrote: > >> Hi Ryan, >> >> How about the classpath issue? >> I have the same problem. >> >> On Sun, Oct 11, 2009 at 8:14 AM, Ryan LeCompte <[email protected]>wrote: >> >>> Thank you! >>> >>> Very helpful. >>> >>> Another problem: >>> >>> I am trying to install Hive 0.4, and I'm coming across the following >>> error when I try to start bin/hive after building: >>> >>> >>> java.lang.NoClassDefFoundError: org/apache/hadoop/hive/conf/HiveConf >>> at java.lang.Class.forName0(Native Method) >>> at java.lang.Class.forName(Class.java:247) >>> at org.apache.hadoop.util.RunJar.main(RunJar.java:158) >>> at org.apache.hadoop.mapred.JobShell.run(JobShell.java:54) >>> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65) >>> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79) >>> at org.apache.hadoop.mapred.JobShell.main(JobShell.java:68) >>> Caused by: java.lang.ClassNotFoundException: >>> org.apache.hadoop.hive.conf.HiveConf >>> at java.net.URLClassLoader$1.run(URLClassLoader.java:200) >>> at java.security.AccessController.doPrivileged(Native Method) >>> at java.net.URLClassLoader.findClass(URLClassLoader.java:188) >>> at java.lang.ClassLoader.loadClass(ClassLoader.java:306) >>> at java.lang.ClassLoader.loadClass(ClassLoader.java:251) >>> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:319) >>> ... 7 more >>> >>> >>> Any ideas? >>> >>> Thanks, >>> Ryan >>> >>> >>> On Sat, Oct 10, 2009 at 2:47 PM, Zheng Shao <[email protected]> wrote: >>> >>>> Yes, we can do this: >>>> >>>> SELECT ip, SUM(IF(action = 'action1', 1, 0)), SUM(IF(action = 'action2', >>>> 1, 0)), SUM(IF(action = 'action3', 1, 0)) >>>> FROM mytable >>>> GROUP BY ip; >>>> >>>> For more details on IF, please refer to: >>>> http://dev.mysql.com/doc/refman/5.0/en/control-flow-functions.html#function_if >>>> >>>> Zheng >>>> >>>> >>>> On Sat, Oct 10, 2009 at 11:42 AM, Ryan LeCompte <[email protected]>wrote: >>>> >>>>> Hello all, >>>>> >>>>> Very newto Hive (haven't even installed it yet!), but I had a use case >>>>> that I didn't see demonstrated in any of the tutorial/documentation that >>>>> I've read thus far. >>>>> >>>>> Let's say that I have apache logs that I want to process with >>>>> Hadoop/Hive. Of course there may be different types of log records all >>>>> tying >>>>> back to the same user or IP address or other log attribute. Is there a way >>>>> to submit a SINGLE Hive query to get back results that may look like: >>>>> >>>>> >>>>> IP Action1Count Action2Count Action3Count >>>>> >>>>> .. where the different actions correspond to different log events for >>>>> that IP address. >>>>> >>>>> Do I have to submit 3 different Hive queries here or can I submit a >>>>> single Hive query? In a regular Java-based map/reduce job, I would have >>>>> written a custom Writable that would record counts for each of the >>>>> different >>>>> actions, and submit it to the reducer using output.collect(IP, >>>>> customWritable). Here I wouldn't have to submit multiple map/reduce jobs, >>>>> just 1. >>>>> >>>>> Thanks >>>>> Ryan >>>>> >>>>> >>>> >>>> >>>> -- >>>> Yours, >>>> Zheng >>>> >>> >>> >> >
