Instead of adding just one pig jar
usr/hdp/2.3.0.0-2557/pig/pig-0.15.0.2.3.0.0-2557-core- Add the whole
directory. You're missing pig lib on classpath.
On Dec 5, 2015 6:06 AM, "Shashi Vishwakarma" <shashi.vish...@gmail.com>
wrote:
> Hi Mike,
>
> I tried running code using "" in command and i got below error.
>
> java -cp
>
> "/usr/hdp/2.3.0.0-2557/hadoop/client/*;/usr/hdp/2.3.0.0-2557/hadoop-hdfs/lib/*;/usr/hdp/2.3.0.0-2557/hadoop-mapreduce/lib/*;/usr/hdp/2.3.0.0-2557/hadoop-yarn/lib/*;/usr/hdp/2.3.0.0-2557/pig/lib/*;/usr/hdp/2.3.0.0-2557/hadoop/conf;/usr/hdp/2.3.0.0-2557/pig/pig-0.15.0.2.3.0.0-2557-core-h2.jar:$HADOOP_CONF"
> -jar PigTest.jar
> Exception in thread "main" java.lang.NoClassDefFoundError:
> org/apache/pig/PigServer
> at java.lang.Class.getDeclaredMethods0(Native Method)
> at java.lang.Class.privateGetDeclaredMethods(Class.java:2625)
> at java.lang.Class.getMethod0(Class.java:2866)
> at java.lang.Class.getMethod(Class.java:1676)
> at
> sun.launcher.LauncherHelper.getMainMethod(LauncherHelper.java:494)
> at
> sun.launcher.LauncherHelper.checkAndLoadMain(LauncherHelper.java:486)
> Caused by: java.lang.ClassNotFoundException: org.apache.pig.PigServer
> at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
> at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
> ... 6 more
>
> It says class not found. Looks like it is looking for some jar. Can you
> please tell me whats going wrong here?
>
> Thanks
> Shashi
>
> On Fri, Dec 4, 2015 at 4:38 PM, Michael Spertus <m...@spertus.com> wrote:
>
> > The shell is interpreting the semicolons as meaning a new command is
> being
> > entered. You might need to use some quotation marks around the classpath
> > On Dec 3, 2015 11:34 PM, "Shashi Vishwakarma" <shashi.vish...@gmail.com>
> > wrote:
> >
> > > Hi
> > > I am trying to simple pig code but its giving me some permission. Here
> is
> > > my sample pig code.
> > >
> > > import java.io.IOException;import org.apache.pig.PigServer;import
> > > org.apache.pig.ExecType;import
> > > org.apache.hadoop.conf.Configuration;public class PigTest{
> > > public static void main(String[] args) {
> > > try {
> > > Configuration conf = new Configuration();
> > > conf.set("hdp.version","2.3.0.0-2557");
> > > //PigServer pigServer = new PigServer("mapreduce",conf);
> > > PigServer pigServer = new PigServer(ExecType.MAPREDUCE, conf);
> > > runIdQuery(pigServer, "myfile.txt");
> > > }
> > > catch(Exception e) {
> > > }}public static void runIdQuery(PigServer pigServer, String
> > > inputFile) throws IOException {
> > > pigServer.registerQuery("A = load '" + inputFile + "' using
> > > PigStorage(':');");
> > > pigServer.registerQuery("B = foreach A generate $0 as id;");
> > > pigServer.store("B", "idout");
> > > }}
> > >
> > > I set my classpath as below
> > >
> > > echo
> > >
> >
> $CLASSPATH.:/usr/hdp/2.3.0.0-2557/hadoop/client/*:/usr/hdp/2.3.0.0-2557/hadoop-hdfs/lib/*:/usr/hdp/2.3.0.0-2557/hadoop-mapreduce/lib/*:/usr/hdp/2.3.0.0-2557/hadoop-yarn/lib/*:/usr/hdp/2.3.0.0-2557/pig/lib/*:/usr/hdp/2.3.0.0-2557/hadoop/conf:/usr/hdp/2.3.0.0-2557/pig/pig-0.15.0.2.3.0.0-2557-core-h2.jar
> > >
> > > When i am running my code with java command it is working perfectly but
> > > when created a jar of my code and trying to run , it is giving me below
> > > permission error.
> > >
> > > *java -cp
> > >
> >
> /usr/hdp/2.3.0.0-2557/hadoop/client**/*;*/usr/hdp/2.3.0.0-2557/hado*op-hdfs/lib/*;/usr/hdp/2.3.0.0-2557/hadoop-mapreduce/lib/*;/usr/hdp/2.3.0.0-2557/hadoop-yarn/lib/*;/usr/hdp/2.3.0.0-2557/pig/lib/*;/usr/hdp/2.3.0.0-2557/hadoop/conf;/usr/hdp/2.3.0.0-2557/pig/pig-0.15.0.2.3.0.0-2557-core-h2.jar
> > > -jar PigTest.jar*
> > >
> > > *Error: Could not find or load main class
> > > .usr.hdp.2.3.0.0-2557.hadoop.client.activation.jar
> > > -bash: /usr/hdp/2.3.0.0-2557/hadoop-hdfs/lib/asm-3.2.jar: Permission
> > denied
> > > -bash: /usr/hdp/2.3.0.0-2557/hadoop-mapreduce/lib/aopalliance-1.0.jar:
> > > Permission denied
> > > -bash: /usr/hdp/2.3.0.0-2557/hadoop-yarn/lib/activation-1.1.jar:
> > > Permission denied
> > > -bash: /usr/hdp/2.3.0.0-2557/pig/lib/accumulo-core-1.5.0.jar:
> Permission
> > > denied
> > > -bash: /usr/hdp/2.3.0.0-2557/hadoop/conf: is a directory
> > > -bash: /usr/hdp/2.3.0.0-2557/pig/pig-0.15.0.2.3.0.0-2557-core-h2.jar:
> > > Permission denied*
> > >
> > >
> > > Any clue on this?
> > >
> > > Thanks
> > > Shashi
> > >
> >
>
