Hi Doug, I built those debian packages (for Stanislav) from 0.9.3.2 source. Here is what I followed.
I made changes to hypertable sources according to issues (as it wasn't building without the fix) http://code.google.com/p/hypertable/issues/detail?id=220 http://code.google.com/p/hypertable/issues/detail?id=409 s...@codedesk:~$ cmake -DPACKAGE_THRIFTBROKER=1 -DBUILD_SHARED_LIBS=ON -DCMAKE_BUILD_TYPE=Release ~/src/hypertable -DJAVA_INCLUDE_PATH=/usr/lib/jvm/java-6-sun-1.6.0.20/include -DJAVA_INCLUDE_PATH2=/usr/lib/jvm/java-6-sun-1.6.0.20/include/linux -DHADOOP_INCLUDE_PATH=/home/sree/src/hadoop-0.20.2/src/c++/install/include -DHADOOP_LIB_PATH=/home/sree/src/hadoop-0.20.2/src/c++/install/lib -DPHPTHRIFT_ROOT=/home/sree/src/thrift-0.2.0/lib/php/src s...@codedesk:~$ cpack -G DEB s...@codedesk:~$ cpack -G RPM s...@codedesk:~$ cmake -DPACKAGE_THRIFTBROKER= -DBUILD_SHARED_LIBS=ON -DCMAKE_BUILD_TYPE=Release ~/src/hypertable -DJAVA_INCLUDE_PATH=/usr/lib/jvm/java-6-sun-1.6.0.20/include -DJAVA_INCLUDE_PATH2=/usr/lib/jvm/java-6-sun-1.6.0.20/include/linux -DHADOOP_INCLUDE_PATH=/home/sree/src/hadoop-0.20.2/src/c++/install/include -DHADOOP_LIB_PATH=/home/sree/src/hadoop-0.20.2/src/c++/install/lib -DPHPTHRIFT_ROOT=/home/sree/src/thrift-0.2.0/lib/php/src s...@codedesk:~$ cpack -G DEB s...@codedesk:~$ cpack -G RPM s...@codedesk:~$ sudo dpkg -i hypertable-0.9.3.2-linux-i386.deb s...@codedesk:~$ ls -l /opt/hypertable/0.9.3.2/lib/ total 16560 drwxr-xr-x 2 sree sree 4096 2010-06-23 18:01 java -rw-r--r-- 1 sree sree 75640 2010-06-15 19:38 libboost_filesystem.so.1.40.0 -rw-r--r-- 1 sree sree 42696 2010-06-15 19:46 libboost_iostreams.so.1.40.0 -rw-r--r-- 1 sree sree 289336 2010-06-15 19:46 libboost_program_options.so.1.40.0 -rw-r--r-- 1 sree sree 13800 2010-06-15 19:46 libboost_system.so.1.40.0 -rw-r--r-- 1 sree sree 83764 2010-06-15 19:46 libboost_thread.so.1.40.0 -rw-r--r-- 1 sree sree 70076 2010-06-15 19:31 libbz2.so.1.0 -rw-r--r-- 1 sree sree 1763912 2010-06-15 19:31 libdb_cxx-4.8.so -rw-r--r-- 1 sree sree 91768 2010-06-15 19:31 libevent-1.4.so.2 -rw-r--r-- 1 sree sree 157064 2010-06-15 19:31 libexpat.so.1 -rw-r--r-- 1 sree sree 116272 2010-06-15 19:31 libgcc_s.so.1 -rw-r--r-- 1 sree sree 527962 2010-06-15 19:46 libHyperCommon.so -rw-r--r-- 1 sree sree 442913 2010-06-15 19:48 libHyperComm.so -rw-r--r-- 1 sree sree 348999 2010-06-15 19:51 libHyperDfsBroker.so -rw-r--r-- 1 sree sree 53546 2010-06-15 20:00 libHyperDfsCmds.so -rw-r--r-- 1 sree sree 1789883 2010-06-15 19:59 libHyperRanger.so -rw-r--r-- 1 sree sree 665860 2010-06-15 19:48 libHyperspace.so -rw-r--r-- 1 sree sree 2779668 2010-06-15 19:53 libHypertable.so -rw-r--r-- 1 sree sree 93367 2010-06-15 20:02 libHyperThriftConfig.so -rw-r--r-- 1 sree sree 780921 2010-06-15 20:02 libHyperThrift.so -rw-r--r-- 1 sree sree 95871 2010-06-15 19:48 libHyperTools.so -rw-r--r-- 1 sree sree 245256 2010-06-15 19:31 liblog4cpp.so.5 -rw-r--r-- 1 sree sree 212010 2010-06-15 20:03 libMapReduce.so -rw-r--r-- 1 sree sree 223768 2010-06-15 19:31 libncurses.so.5 -rw-r--r-- 1 sree sree 204860 2010-06-15 19:31 libreadline.so.6 -rw-r--r-- 1 sree sree 206952 2010-06-15 19:31 librrd.so.4 -rw-r--r-- 1 sree sree 232969 2010-06-15 19:31 libsigar-x86-linux.so -rw-r--r-- 1 sree sree 962800 2010-06-15 19:31 libstdc++.so.6 -rw-r--r-- 1 sree sree 681611 2010-06-15 19:31 libtcmalloc_minimal.so.0 -rw-r--r-- 1 sree sree 308151 2010-06-15 19:31 libthriftnb.so.0 -rw-r--r-- 1 sree sree 3112270 2010-06-15 19:31 libthrift.so.0 -rw-r--r-- 1 sree sree 79512 2010-06-15 19:31 libz.so.1 drwxr-xr-x 4 sree sree 4096 2010-06-23 18:01 perl drwxr-xr-x 3 sree sree 4096 2010-06-23 18:01 php drwxr-xr-x 4 sree sree 4096 2010-06-23 18:01 py drwxr-xr-x 3 sree sree 4096 2010-06-23 18:01 rb s...@codedesk:~$ ls -l /opt/hypertable/0.9.3.2/lib/java total 5880 -rw-r--r-- 1 sree sree 41123 2010-06-15 16:50 commons-cli-1.2.jar -rw-r--r-- 1 sree sree 38015 2010-06-15 16:50 commons-logging-1.0.4.jar -rw-r--r-- 1 sree sree 2689741 2010-06-15 16:50 hadoop-0.20.2-core.jar -rw-r--r-- 1 sree sree 11358 2010-06-15 16:50 hadoop-0.20.2-core.LICENSE.txt -rw-r--r-- 1 sree sree 1567530 2010-06-15 16:50 hbase-0.20.4.jar -rw-r--r-- 1 sree sree 106547 2010-06-15 16:50 junit-4.3.1.jar -rw-r--r-- 1 sree sree 15162 2010-06-15 16:50 junit-4.3.1.LICENSE.txt -rw-r--r-- 1 sree sree 195759 2010-06-15 16:50 libthrift-0.3.0.jar -rw-r--r-- 1 sree sree 358180 2010-06-15 16:50 log4j-1.2.13.jar -rw-r--r-- 1 sree sree 23445 2010-06-15 16:50 slf4j-api-1.5.8.jar -rw-r--r-- 1 sree sree 9679 2010-06-15 16:50 slf4j-log4j12-1.5.8.jar -rw-r--r-- 1 sree sree 915651 2010-06-15 16:50 zookeeper-3.2.2.jar -- Regards, Sreejith K On Wed, Jun 23, 2010 at 2:33 PM, Stanislav Yudin <[email protected]> wrote: > It's ubuntu 10.04, so I missed that initially. > sta...@unicorn:/opt/hypertable/0.9.3.2$ uname -a > Linux unicorn 2.6.32-21-server #32-Ubuntu SMP Fri Apr 16 09:17:34 UTC 2010 > x86_64 GNU/Linux > sta...@unicorn:/opt/hypertable/0.9.3.2$ lsb_release -a > No LSB modules are available. > Distributor ID: Ubuntu > Description: Ubuntu 10.04 LTS > Release: 10.04 > Codename: lucid > sta...@unicorn:/opt/hypertable/0.9.3.2$ > > > On Wed, Jun 23, 2010 at 2:27 PM, Doug Judd <[email protected]> wrote: > >> That change went out a while ago. We could have done a better job >> announcing the changes necessary. Replace Hyperspace.Master.* with >> Hyperspace.Replica.* We'll fix the document tomorrow. Can you post the >> output of uname -a ? >> >> - Doug >> >> >> On Wed, Jun 23, 2010 at 1:52 AM, Stanislav Yudin <[email protected]>wrote: >> >>> Ok, putting jars back fixes the problem with dfs broker startup, so that >>> mean it was the only reason. Also, I've noticed that you've made changes to >>> configuration parsing, namely dropped Hyperspace.Master.* properties. Config >>> props >>> reference<http://code.google.com/p/hypertable/wiki/ConfigPropetiesReference?tm=1>doesn't >>> know anything about new props, so I guess that you've missed >>> documentation update. Had I missed the announce of such changes? >>> >>> >>> On Wed, Jun 23, 2010 at 2:14 PM, Stanislav Yudin <[email protected]>wrote: >>> >>>> Hi Doug, >>>> Sorry, but we are back to 0.9.2.7 for our development environment for >>>> now. We will try to reproduce problem with missed jars on 0.9.3.3 build on >>>> cluster. Thou on my personal test host it did reproduce on 0.9.3.2. See >>>> console session. >>>> sta...@unicorn:~$ sudo rm -fr /opt/hypertable/* >>>> sta...@unicorn:~$ ls -l >>>> -rw-r--r-- 1 stanly stanly 10658452 2010-06-19 13:58 >>>> hypertable-0.9.2.7-linux-x86_64.deb >>>> -rw-r--r-- 1 stanly stanly 13695996 2010-06-18 17:42 >>>> hypertable-0.9.3.2-linux-x86_64.deb >>>> -rw-r--r-- 1 stanly stanly 3714334 2010-06-19 13:57 >>>> hypertable-thriftbroker-0.9.2.7-linux-x86_64.deb >>>> -rw-r--r-- 1 stanly stanly 9547270 2010-06-18 17:42 >>>> hypertable-thriftbroker-0.9.3.2-linux-x86_64.deb >>>> >>>> sta...@unicorn:~$ ls /opt/hypertable/ >>>> sta...@unicorn:~$ sudo dpkg -i hypertable-0.9.3.2-linux-x86_64.deb >>>> Selecting previously deselected package hypertable. >>>> (Reading database ... 174153 files and directories currently installed.) >>>> >>>> Unpacking hypertable (from hypertable-0.9.3.2-linux-x86_64.deb) ... >>>> Setting up hypertable (0.9.3.2) ... >>>> sta...@unicorn:~$ ls /opt/hypertable/0.9.3.2/lib/java/ >>>> commons-cli-1.2.jar hadoop-0.20.2-core.jar >>>> hbase-0.20.4.jar junit-4.3.1.LICENSE.txt log4j-1.2.13.jar >>>> slf4j-log4j12-1.5.8.jar >>>> commons-logging-1.0.4.jar hadoop-0.20.2-core.LICENSE.txt >>>> junit-4.3.1.jar libthrift-0.3.0.jar slf4j-api-1.5.8.jar >>>> zookeeper-3.2.2.jar >>>> sta...@unicorn:~$ dpkg -L hypertable | grep "lib/java" >>>> >>>> /opt/hypertable/0.9.3.2/lib/java >>>> /opt/hypertable/0.9.3.2/lib/java/zookeeper-3.2.2.jar >>>> >>>> /opt/hypertable/0.9.3.2/lib/java/commons-cli-1.2.jar >>>> /opt/hypertable/0.9.3.2/lib/java/hbase-0.20.4.jar >>>> /opt/hypertable/0.9.3.2/lib/java/hadoop-0.20.2-core.jar >>>> /opt/hypertable/0.9.3.2/lib/java/junit-4.3.1.jar >>>> /opt/hypertable/0.9.3.2/lib/java/hadoop-0.20.2-core.LICENSE.txt >>>> /opt/hypertable/0.9.3.2/lib/java/slf4j-api-1.5.8.jar >>>> /opt/hypertable/0.9.3.2/lib/java/slf4j-log4j12-1.5.8.jar >>>> /opt/hypertable/0.9.3.2/lib/java/log4j-1.2.13.jar >>>> /opt/hypertable/0.9.3.2/lib/java/junit-4.3.1.LICENSE.txt >>>> /opt/hypertable/0.9.3.2/lib/java/libthrift-0.3.0.jar >>>> /opt/hypertable/0.9.3.2/lib/java/commons-logging-1.0.4.jar >>>> sta...@unicorn:~$ >>>> >>>> >>>> >>>> On Tue, Jun 22, 2010 at 11:52 AM, Doug Judd <[email protected]>wrote: >>>> >>>>> Hi Stanislav, >>>>> >>>>> I just installed the Debian package on an 64-bit Ubuntu 8.04 and the >>>>> hypertable jar files were deposited in the proper location. I've attached >>>>> the terminal session below. How exactly did you install this package? >>>>> Can >>>>> you remove the package and try installing it again to be sure that it is >>>>> in >>>>> fact a problem with the package? Thanks. >>>>> >>>>> - Doug >>>>> >>>>> [r...@ip-10-196-57-187 ~]# dpkg -i >>>>> hypertable-0.9.3.2-linux-x86_64.deb >>>>> Selecting previously deselected package hypertable. >>>>> (Reading database ... 32779 files and directories currently installed.) >>>>> Unpacking hypertable (from hypertable-0.9.3.2-linux-x86_64.deb) ... >>>>> Setting up hypertable (0.9.3.2) ... >>>>> [r...@ip-10-196-57-187 ~]# ls -l /opt/hypertable/0.9.3.2/lib/java/ >>>>> total 31020 >>>>> -rw-r--r-- 1 root root 41123 2010-06-13 17:55 commons-cli-1.2.jar >>>>> -rw-r--r-- 1 root root 38015 2010-06-13 17:55 >>>>> commons-logging-1.0.4.jar >>>>> -rw-r--r-- 1 root root 2689741 2010-06-13 17:55 hadoop-0.20.2-core.jar >>>>> -rw-r--r-- 1 root root 11358 2010-06-13 17:55 >>>>> hadoop-0.20.2-core.LICENSE.txt >>>>> -rw-r--r-- 1 root root 1567530 2010-06-13 17:55 hbase-0.20.4.jar >>>>> -rw-r--r-- 1 root root 12942187 2010-06-13 18:07 >>>>> hypertable-0.9.3.2-examples.jar >>>>> -rw-r--r-- 1 root root 12756293 2010-06-13 18:07 hypertable-0.9.3.2.jar >>>>> -rw-r--r-- 1 root root 106547 2010-06-13 17:55 junit-4.3.1.jar >>>>> -rw-r--r-- 1 root root 15162 2010-06-13 17:55 >>>>> junit-4.3.1.LICENSE.txt >>>>> -rw-r--r-- 1 root root 195759 2010-06-13 17:55 libthrift-0.3.0.jar >>>>> -rw-r--r-- 1 root root 358180 2010-06-13 17:55 log4j-1.2.13.jar >>>>> -rw-r--r-- 1 root root 23445 2010-06-13 17:55 slf4j-api-1.5.8.jar >>>>> -rw-r--r-- 1 root root 9679 2010-06-13 17:55 >>>>> slf4j-log4j12-1.5.8.jar >>>>> -rw-r--r-- 1 root root 915651 2010-06-13 17:55 zookeeper-3.2.2.jar >>>>> >>>>> >>>>> On Sat, Jun 19, 2010 at 1:26 AM, Stanislav Yudin <[email protected]>wrote: >>>>> >>>>>> Hi everyone, >>>>>> Recently we've upgraded one of the installations to 0.9.3.2 from >>>>>> 0.9.2.7, and we've got a problem running it on a hadoop cluster. >>>>>> Basically dfs broker cannot load required java classes which are >>>>>> supposed to be there from deb. Maybe package doesn't have something. >>>>>> Hadoop version 0.20.1 runs fine and contains /hypertable with correct >>>>>> rights. >>>>>> >>>>>> sta...@unicorn:~$ apt-cache show hypertable >>>>>> Package: hypertable >>>>>> Status: install ok installed >>>>>> Priority: optional >>>>>> Section: devel >>>>>> Installed-Size: 31565 >>>>>> Maintainer: [email protected] >>>>>> Architecture: amd64 >>>>>> Version: 0.9.3.2 >>>>>> Description: Hypertable 0.9.3.2 >>>>>> >>>>>> sta...@unicorn:~$ /opt/hypertable/0.9.3.2/bin/start-dfsbroker.shhadoop >>>>>> DFS broker: available file descriptors: 1024 >>>>>> Waiting for DFS Broker (hadoop) to come up... >>>>>> ... >>>>>> sta...@unicorn:~$ cat /opt/hypertable/ >>>>>> 0.9.3.2/log/DfsBroker.hadoop.log >>>>>> Exception in thread "main" java.lang.NoClassDefFoundError: >>>>>> org/hypertable/DfsBroker/hadoop/main >>>>>> Caused by: java.lang.ClassNotFoundException: >>>>>> org.hypertable.DfsBroker.hadoop.main >>>>>> at java.net.URLClassLoader$1.run(URLClassLoader.java:202) >>>>>> at java.security.AccessController.doPrivileged(Native Method) >>>>>> at java.net.URLClassLoader.findClass(URLClassLoader.java:190) >>>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:307) >>>>>> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) >>>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:248) >>>>>> Could not find the main class: org.hypertable.DfsBroker.hadoop.main. >>>>>> Program will exit. >>>>>> sta...@unicorn:~$ ls /opt/hypertable/0.9.3.2/lib/ >>>>>> java libboost_thread.so.1.40.0 >>>>>> libgcc_s.so.1 libHyperRanger.so libHyperTools.so >>>>>> librrd.so.4 libthrift.so.0 rb >>>>>> libboost_filesystem.so.1.40.0 libbz2.so.1.0 >>>>>> libHyperCommon.so libHyperspace.so liblog4cpp.so.5 >>>>>> libsigar-amd64-linux.so libz.so.1 >>>>>> libboost_iostreams.so.1.40.0 libdb_cxx-4.8.so >>>>>> libHyperComm.so libHypertable.so libMapReduce.so >>>>>> libstdc++.so.6 perl >>>>>> libboost_program_options.so.1.40.0 libevent-1.4.so.2 >>>>>> libHyperDfsBroker.so libHyperThriftConfig.so libncurses.so.5 >>>>>> libtcmalloc_minimal.so.0 php >>>>>> libboost_system.so.1.40.0 libexpat.so.1 >>>>>> libHyperDfsCmds.so libHyperThrift.so libreadline.so.6 >>>>>> libthriftnb.so.0 py >>>>>> sta...@unicorn:~$ ls /opt/hypertable/0.9.3.2/lib/java/ >>>>>> commons-cli-1.2.jar hadoop-0.20.2-core.jar >>>>>> hbase-0.20.4.jar junit-4.3.1.LICENSE.txt log4j-1.2.13.jar >>>>>> slf4j-log4j12-1.5.8.jar >>>>>> commons-logging-1.0.4.jar hadoop-0.20.2-core.LICENSE.txt >>>>>> junit-4.3.1. >>>>>> >>>>>> -- >>>>>> You received this message because you are subscribed to the Google >>>>>> Groups "Hypertable Development" group. >>>>>> To post to this group, send email to [email protected]. >>>>>> To unsubscribe from this group, send email to >>>>>> [email protected]<hypertable-dev%[email protected]> >>>>>> . >>>>>> For more options, visit this group at >>>>>> http://groups.google.com/group/hypertable-dev?hl=en. >>>>>> >>>>> >>>>> -- >>>>> You received this message because you are subscribed to the Google >>>>> Groups "Hypertable Development" group. >>>>> To post to this group, send email to [email protected]. >>>>> To unsubscribe from this group, send email to >>>>> [email protected]<hypertable-dev%[email protected]> >>>>> . >>>>> For more options, visit this group at >>>>> http://groups.google.com/group/hypertable-dev?hl=en. >>>>> >>>> >>>> >>> -- >>> You received this message because you are subscribed to the Google Groups >>> "Hypertable Development" group. >>> To post to this group, send email to [email protected]. >>> To unsubscribe from this group, send email to >>> [email protected]<hypertable-dev%[email protected]> >>> . >>> For more options, visit this group at >>> http://groups.google.com/group/hypertable-dev?hl=en. >>> >> >> -- >> You received this message because you are subscribed to the Google Groups >> "Hypertable Development" group. >> To post to this group, send email to [email protected]. >> To unsubscribe from this group, send email to >> [email protected]<hypertable-dev%[email protected]> >> . >> For more options, visit this group at >> http://groups.google.com/group/hypertable-dev?hl=en. >> > > -- > You received this message because you are subscribed to the Google Groups > "Hypertable Development" group. > To post to this group, send email to [email protected]. > To unsubscribe from this group, send email to > [email protected]<hypertable-dev%[email protected]> > . > For more options, visit this group at > http://groups.google.com/group/hypertable-dev?hl=en. > -- You received this message because you are subscribed to the Google Groups "Hypertable Development" group. To post to this group, send email to [email protected]. To unsubscribe from this group, send email to [email protected]. For more options, visit this group at http://groups.google.com/group/hypertable-dev?hl=en.
