Bonjour,
Finally installing debugging hive help me correct :
Modifying the file : /usr/local/hadoop/etc/hadoop/hadoop-env.sh
export
HADOOP_CLASSPATH=/usr/local/pig/pig-0.15.0/lib/*:/usr/local/hive/apache-hive-1.2.1-bin/lib/*:$JAVA_HOME/lib/tools.jar:$HIVE_HOME/lib/hive-common-1.2.1.jar
Did the trick !
Thanks for your support
Le 16/07/2015 12:22, Antoine Lafleur a écrit :
Hi,
hduser@master:/$ find /usr/local -name joda*.jar
/usr/local/hadoop/share/hadoop/tools/lib/joda-time-2.5.jar
/usr/local/pig/pig-0.15.0/build/ivy/lib/Pig/joda-time-2.5.jar
/usr/local/pig/pig-0.15.0/lib/joda-time-2.5.jar
hduser@master:/$ md5sum
/usr/local/hadoop/share/hadoop/tools/lib/joda-time-2.5.jar
c18e34f88c183cb21bbb693b3505e7d2
/usr/local/hadoop/share/hadoop/tools/lib/joda-time-2.5.jar
hduser@master:/$ md5sum /usr/local/pig/pig-0.15.0/lib/joda-time-2.5.jar
c18e34f88c183cb21bbb693b3505e7d2
/usr/local/pig/pig-0.15.0/lib/joda-time-2.5.jar
Regards
Le 16/07/2015 01:37, Jianfeng (Jeff) Zhang a écrit :
Do you find the joda jar under
<hadoop_home>/share/hadoop/tools/lib/joda-time-2.5.jar ?
Best Regard,
Jeff Zhang
On 7/15/15, 1:42 PM, "Antoine Lafleur" <[email protected]> wrote:
Hi,
The result of the command is :
Find hadoop at /usr/local/hadoop/bin/hadoop
dry run:
HADOOP_CLASSPATH:
/usr/local/pig/pig-0.15.0/bin/../conf:/usr/lib/jvm/java-7-openjdk-amd64/li
b/tools.jar:/usr/local/pig/pig-0.15.0/bin/../lib/ST4-4.0.4.jar:/usr/local/
pig/pig-0.15.0/bin/../lib/accumulo-core-1.5.0.jar:/usr/local/pig/pig-0.15.
0/bin/../lib/accumulo-fate-1.5.0.jar:/usr/local/pig/pig-0.15.0/bin/../lib/
accumulo-server-1.5.0.jar:/usr/local/pig/pig-0.15.0/bin/../lib/accumulo-st
art-1.5.0.jar:/usr/local/pig/pig-0.15.0/bin/../lib/accumulo-trace-1.5.0.ja
r:/usr/local/pig/pig-0.15.0/bin/../lib/antlr-runtime-3.4.jar:/usr/local/pi
g/pig-0.15.0/bin/../lib/asm-3.3.1.jar:/usr/local/pig/pig-0.15.0/bin/../lib
/automaton-1.11-8.jar:/usr/local/pig/pig-0.15.0/bin/../lib/avro-1.7.5.jar:
/usr/local/pig/pig-0.15.0/bin/../lib/avro-tools-1.7.5-nodeps.jar:/usr/loca
l/pig/pig-0.15.0/bin/../lib/groovy-all-1.8.6.jar:/usr/local/pig/pig-0.15.0
/bin/../lib/guava-11.0.jar:/usr/local/pig/pig-0.15.0/bin/../lib/hive-commo
n-0.14.0.jar:/usr/local/pig/pig-0.15.0/bin/../lib/hive-exec-0.14.0-core.ja
r:/usr/local/pig/pig-0.15.0/bin/../lib/hive-serde-0.14.0.jar:/usr/local/pi
g/pig-0.15.0/bin/../lib/hive-shims-common-0.14.0.jar:/usr/local/pig/pig-0.
15.0/bin/../lib/hive-shims-common-secure-0.14.0.jar:/usr/local/pig/pig-0.1
5.0/bin/../lib/jackson-core-asl-1.8.8.jar:/usr/local/pig/pig-0.15.0/bin/..
/lib/jackson-mapper-asl-1.8.8.jar:/usr/local/pig/pig-0.15.0/bin/../lib/jan
si-1.9.jar:/usr/local/pig/pig-0.15.0/bin/../lib/jline-1.0.jar:/usr/local/p
ig/pig-0.15.0/bin/../lib/joda-time-2.5.jar:/usr/local/pig/pig-0.15.0/bin/.
./lib/jruby-complete-1.6.7.jar:/usr/local/pig/pig-0.15.0/bin/../lib/js-1.7
R2.jar:/usr/local/pig/pig-0.15.0/bin/../lib/json-simple-1.1.jar:/usr/local
/pig/pig-0.15.0/bin/../lib/jython-standalone-2.5.3.jar:/usr/local/pig/pig-
0.15.0/bin/../lib/kryo-2.22.jar:/usr/local/pig/pig-0.15.0/bin/../lib/piggy
bank.jar:/usr/local/pig/pig-0.15.0/bin/../lib/protobuf-java-2.5.0.jar:/usr
/local/pig/pig-0.15.0/bin/../lib/snappy-java-1.1.0.1.jar:/usr/local/pig/pi
g-0.15.0/bin/../lib/trevni-avro-1.7.5.jar:/usr/local/pig/pig-0.15.0/bin/..
/lib/trevni-core-1.7.5.jar:/usr/local/pig/pig-0.15.0/bin/../lib/zookeeper-
3.4.5.jar:/usr/local/pig/pig-0.15.0/bin/../pig-0.15.0-core-h2.jar:/usr/loc
al/pig/pig-0.15.0/bin/../lib/h2/avro-mapred-1.7.5-hadoop2.jar:/usr/local/p
ig/pig-0.15.0/bin/../lib/h2/commons-collections4-4.0.jar:/usr/local/pig/pi
g-0.15.0/bin/../lib/h2/hbase-client-0.98.12-hadoop2.jar:/usr/local/pig/pig
-0.15.0/bin/../lib/h2/hbase-common-0.98.12-hadoop2.jar:/usr/local/pig/pig-
0.15.0/bin/../lib/h2/hbase-hadoop-compat-0.98.12-hadoop2.jar:/usr/local/pi
g/pig-0.15.0/bin/../lib/h2/hbase-hadoop2-compat-0.98.12-hadoop2.jar:/usr/l
ocal/pig/pig-0.15.0/bin/../lib/h2/hbase-protocol-0.98.12-hadoop2.jar:/usr/
local/pig/pig-0.15.0/bin/../lib/h2/hbase-server-0.98.12-hadoop2.jar:/usr/l
ocal/pig/pig-0.15.0/bin/../lib/h2/hive-shims-0.23-0.14.0.jar:/usr/local/pi
g/pig-0.15.0/bin/../lib/h2/tez-api-0.7.0.jar:/usr/local/pig/pig-0.15.0/bin
/../lib/h2/tez-common-0.7.0.jar:/usr/local/pig/pig-0.15.0/bin/../lib/h2/te
z-dag-0.7.0.jar:/usr/local/pig/pig-0.15.0/bin/../lib/h2/tez-mapreduce-0.7.
0.jar:/usr/local/pig/pig-0.15.0/bin/../lib/h2/tez-runtime-internals-0.7.0.
jar:/usr/local/pig/pig-0.15.0/bin/../lib/h2/tez-runtime-library-0.7.0.jar:
/usr/local/pig/pig-0.15.0/bin/../lib/h2/tez-yarn-timeline-history-with-acl
s-0.7.0.jar:
HADOOP_OPTS: -Djava.library.path=/usr/local/hadoop/lib
HADOOP_CLIENT_OPTS: -Xmx1000m
-Dpig.log.dir=/usr/local/pig/pig-0.15.0/bin/../logs
-Dpig.log.file=pig.log -Dpig.home.dir=/usr/local/pig/pig-0.15.0/bin/..
/usr/local/hadoop/bin/hadoop jar
/usr/local/pig/pig-0.15.0/bin/../pig-0.15.0-core-h2.jar
However version 0.13 (no issues) gave me :
hduser@master:/usr/local/pig/pig-0.13.0/bin$ ./pig -printCmdDebug
Find hadoop at /usr/local/hadoop/bin/hadoop
dry run:
HADOOP_CLASSPATH:
/usr/local/pig/pig-0.13.0/bin/../conf:/usr/lib/jvm/java-7-openjdk-amd64/li
b/tools.jar:/usr/local/pig/pig-0.13.0/bin/../lib/accumulo-core-1.5.0.jar:/
usr/local/pig/pig-0.13.0/bin/../lib/accumulo-fate-1.5.0.jar:/usr/local/pig
/pig-0.13.0/bin/../lib/accumulo-server-1.5.0.jar:/usr/local/pig/pig-0.13.0
/bin/../lib/accumulo-start-1.5.0.jar:/usr/local/pig/pig-0.13.0/bin/../lib/
accumulo-trace-1.5.0.jar:/usr/local/pig/pig-0.13.0/bin/../lib/avro-1.7.5.j
ar:/usr/local/pig/pig-0.13.0/bin/../lib/avro-mapred-1.7.5.jar:/usr/local/p
ig/pig-0.13.0/bin/../lib/avro-tools-1.7.5-nodeps.jar:/usr/local/pig/pig-0.
13.0/bin/../lib/groovy-all-1.8.6.jar:/usr/local/pig/pig-0.13.0/bin/../lib/
hbase-0.94.1.jar:/usr/local/pig/pig-0.13.0/bin/../lib/jruby-complete-1.6.7
.jar:/usr/local/pig/pig-0.13.0/bin/../lib/js-1.7R2.jar:/usr/local/pig/pig-
0.13.0/bin/../lib/json-simple-1.1.jar:/usr/local/pig/pig-0.13.0/bin/../lib
/jython-standalone-2.5.3.jar:/usr/local/pig/pig-0.13.0/bin/../lib/piggyban
k.jar:/usr/local/pig/pig-0.13.0/bin/../lib/protobuf-java-2.4.0a.jar:/usr/l
ocal/pig/pig-0.13.0/bin/../lib/zookeeper-3.4.5.jar:/usr/local/pig/pig-0.13
.0/bin/../pig-0.13.0-withouthadoop-h2.jar:
HADOOP_OPTS: -Xmx1000m
-Dpig.log.dir=/usr/local/pig/pig-0.13.0/bin/../logs
-Dpig.log.file=pig.log -Dpig.home.dir=/usr/local/pig/pig-0.13.0/bin/..
-Djava.library.path=/usr/local/hadoop/lib
HADOOP_CLIENT_OPTS: -Xmx1000m
-Dpig.log.dir=/usr/local/pig/pig-0.13.0/bin/../logs
-Dpig.log.file=pig.log -Dpig.home.dir=/usr/local/pig/pig-0.13.0/bin/..
/usr/local/hadoop/bin/hadoop jar
/usr/local/pig/pig-0.13.0/bin/../pig-0.13.0-withouthadoop-h2.jar
Best regards
Le 15/07/2015 21:17, Jianfeng (Jeff) Zhang a écrit :
pig -printCmdDebug
