Hi Adinath, Maybe your cluster is misconfigured with bad mapred-site.xml. Can you try adding
set mapreduce.map.java.opts -Xmx1024m set mapreduce.reduce.java.opts -Xmx1024m in your pig script? If that doesn't work, let's take this offline. Please reply to me and Adam. Koji On Wed, May 2, 2018 at 7:49 AM, Adam Szita <sz...@cloudera.com> wrote: > You can also make the pig launch script echo out all the supplied options > it would start the JVM with by using: > > pig -printCmdDebug > > Adam > > On 2 May 2018 at 13:34, Adinath Kamode <adinath.kam...@gmail.com> wrote: > > > Hello Koji, > > I am not passing anything explicitly to PIG_OPTS. I echoed values of > > PIG_OPTS. Below is output. > > > > [ADINATH] Java Home is /usr/lib/jvm/java-8-oracle > > [ADINATH] HADOOP HOME /home/adinath/hadoop/hadoop-3.0.0 > > [ADINATH HADOOP_PREFIX /home/adinath/hadoop/hadoop-3.0.0 > > [ADINATH] PIG_OPTS are : > > -Dpig.log.dir=/home/adinath/hadoop/pig-0.17.0/logs > -Dpig.log.file=pig.log > > -Dpig.home.dir=/home/adinath/hadoop/pig-0.17.0 > > > > Steps to produce issue : > > 1. Put sample Text File to HDFS, Confirmed that file is available and > > accessible using hadoop command. > > 2. adinath = load '/pig/student.txt' as (roll: chararray); > > 3. Dump adinath; > > > > That's all. > > > > student.txt is as below. > > Adinath > > Sonali > > Ramesh > > John > > > > > > > > > > On Tue, May 1, 2018 at 9:01 PM, Koji Noguchi <knogu...@oath.com.invalid> > > wrote: > > > > > Hi Adinath, > > > > > > It seems like you're passing invalid jvm options. (most likely with > > space) > > > Can you share your script or PIG_OPTS where you may be setting the jvm > > > options for the tasks? > > > > > > Koji > > > > > > > > > On Mon, Apr 30, 2018 at 2:59 AM, Adinath Kamode < > > adinath.kam...@gmail.com> > > > wrote: > > > > > > > > > > > ---------- Forwarded message ---------- > > > > From: Adinath Kamode <adinath.kam...@gmail.com> > > > > Date: Mon, Apr 30, 2018 at 12:17 PM > > > > Subject: Re: Pig Error : Could not find or load main class 1600 Error > > > > To: > > > > > > > > user@pig.apache.org > > > > > > > > > > > > Thanks Koji, > > > > I am attaching screenshot of error as well as steps to reproduce this > > > > issue. It is simple Dump command, I am running. > > > > Attaching all logs. > > > > > > > > On Sat, Apr 28, 2018 at 1:27 AM, Koji Noguchi > > <knogu...@oath.com.invalid > > > > > > > > wrote: > > > > > > > >> Hi Adinath, > > > >> > > > >> Anything set inside PIG_OPTS? > > > >> If not, I'll need detail steps to reproduce your error. > > > >> > > > >> Koji > > > >> > > > >> On Fri, Apr 27, 2018 at 6:48 AM, Adinath Kamode < > > > adinath.kam...@gmail.com > > > >> > > > > >> wrote: > > > >> > > > >> > Hello All, > > > >> > I have configured Pig 0.17 as well as 0.16 on Hadoop 2.6 till 3.0 > , > > > but > > > >> > everytime getting error "Could not find or load main class 1600 > > error" > > > >> even > > > >> > for simple DUmp command. I enabled DEBUG level logging but could > > not > > > >> > figure out what 1600 mean. Nothing there on Net. > > > >> > Setup works fine on LOCAL mode. > > > >> > This is Ubuntu machine with Java 8. > > > >> > > > > >> > Please help. > > > >> > > > > >> > Thanks, > > > >> > Adinath > > > >> > > > > >> > > > > > > > > > > > > > > > > > >
