Also, it would be help to go to the MapReduce web UI and having a look at the details of the job corresponding to this query.
Regards, Mohammad Tariq On Wed, Jul 25, 2012 at 5:31 PM, Mohammad Tariq <donta...@gmail.com> wrote: > I have worked with pig-0.7.0 once and it was working fine. Try to see > if there is anything interesting in the log files. Also, if possible, > share 2-3 lines of your file..I'll give it a try on my machine. > > Regards, > Mohammad Tariq > > > On Wed, Jul 25, 2012 at 5:20 PM, <yogesh.kuma...@wipro.com> wrote: >> Hi Mohammad, >> >> I have switched from pig 0.10.0 to 0.7.0 and its horrible experience. >> I do perform >> >> grunt> A = load '/hello/demotry.txt' >>>> as (name:chararray, roll:int, mssg:chararray); >> >> grunt> dump A; >> >> it shows this error: >> >> grunt> dump A; >> 2012-07-25 17:20:34,081 [main] INFO >> org.apache.pig.impl.logicalLayer.optimizer.PruneColumns - No column pruned >> for A >> 2012-07-25 17:20:34,081 [main] INFO >> org.apache.pig.impl.logicalLayer.optimizer.PruneColumns - No map keys pruned >> for A >> 2012-07-25 17:20:34,102 [main] INFO >> org.apache.hadoop.metrics.jvm.JvmMetrics - Initializing JVM Metrics with >> processName=JobTracker, sessionId= >> 2012-07-25 17:20:34,169 [main] INFO >> org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - (Name: >> Store(file:/tmp/temp61624047/tmp1087576502:org.apache.pig.builtin.BinStorage) >> - 1-18 Operator Key: 1-18) >> 2012-07-25 17:20:34,195 [main] INFO >> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MultiQueryOptimizer >> - MR plan size before optimization: 1 >> 2012-07-25 17:20:34,195 [main] INFO >> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MultiQueryOptimizer >> - MR plan size after optimization: 1 >> 2012-07-25 17:20:34,211 [main] INFO >> org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics >> with processName=JobTracker, sessionId= - already initialized >> 2012-07-25 17:20:34,217 [main] INFO >> org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics >> with processName=JobTracker, sessionId= - already initialized >> 2012-07-25 17:20:34,217 [main] INFO >> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler >> - mapred.job.reduce.markreset.buffer.percent is not set, set to default 0.3 >> 2012-07-25 17:20:35,570 [main] INFO >> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler >> - Setting up single store job >> 2012-07-25 17:20:35,599 [main] INFO >> org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics >> with processName=JobTracker, sessionId= - already initialized >> 2012-07-25 17:20:35,600 [main] INFO >> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher >> - 1 map-reduce job(s) waiting for submission. >> 2012-07-25 17:20:35,606 [Thread-7] WARN org.apache.hadoop.mapred.JobClient >> - Use GenericOptionsParser for parsing the arguments. Applications should >> implement Tool for the same. >> 2012-07-25 17:20:35,750 [Thread-7] INFO >> org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics >> with processName=JobTracker, sessionId= - already initialized >> 2012-07-25 17:20:35,763 [Thread-7] INFO >> org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics >> with processName=JobTracker, sessionId= - already initialized >> 2012-07-25 17:20:36,101 [main] INFO >> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher >> - 0% complete >> 2012-07-25 17:20:36,101 [main] INFO >> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher >> - 100% complete >> 2012-07-25 17:20:36,101 [main] ERROR >> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher >> - 1 map reduce job(s) failed! >> 2012-07-25 17:20:36,107 [main] ERROR >> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher >> - Failed to produce result in: "file:/tmp/temp61624047/tmp1087576502" >> 2012-07-25 17:20:36,107 [main] INFO >> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher >> - Failed! >> 2012-07-25 17:20:36,120 [main] INFO >> org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics >> with processName=JobTracker, sessionId= - already initialized >> 2012-07-25 17:20:36,121 [main] ERROR org.apache.pig.tools.grunt.Grunt - >> ERROR 2997: Unable to recreate exception from backend error: >> org.apache.pig.backend.executionengine.ExecException: ERROR 2118: Unable to >> create input splits for: file:///hello/demotry.txt >> Details at logfile: /users/mediaadmin/pig_1343217013235.log >> >> >> why is it happening so :-( >> >> Please help and Suggest >> >> Thanks & Regards >> yogesh Kumar >> >> >> >> ________________________________________ >> From: Mohammad Tariq [donta...@gmail.com] >> Sent: Wednesday, July 25, 2012 5:00 PM >> To: user@pig.apache.org >> Subject: Re: DATA not storing as comma-separted >> >> Hi Yogesh, >> >> Is 'load' working fine with PigStorage()?? Try to load >> something using PigStorage(',') and dump it to see if that is working. >> >> Regards, >> Mohammad Tariq >> >> >> On Wed, Jul 25, 2012 at 4:41 PM, <yogesh.kuma...@wipro.com> wrote: >>> Hello Dmitriy, >>> >>> I have also performed the cat command in hadoop. >>> >>> hadoop dfs -cat /hadoop/pig/records/part-m-00000 >>> >>> but still it shows same output without commas. >>> Please suggest >>> >>> Thanks & regards >>> Yogesh Kumar >>> ________________________________________ >>> From: Dmitriy Ryaboy [dvrya...@gmail.com] >>> Sent: Wednesday, July 25, 2012 4:33 PM >>> To: user@pig.apache.org >>> Subject: Re: DATA not storing as comma-separted >>> >>> Using the store expression you wrote should work. Dump is its own thing and >>> doesn't know anything about the format you store things in. To see files >>> created on hdfs, you can use cat. >>> >>> On Jul 25, 2012, at 3:48 AM, <yogesh.kuma...@wipro.com> wrote: >>> >>>> Hi All, >>>> >>>> I am new to PIG, trying to stroe data in HDFS as comma separated by using >>>> command >>>> >>>> store RECORDS into 'hadoop/pig/records' using PigStorage(','); >>>> >>>> If I do >>>> >>>> dump RECORDS ; >>>> >>>> it shows >>>> >>>> (YogeshKumar 210 hello) >>>> (Mohitkumar 211 hi) >>>> (AAshichoudhary 212 hii) >>>> (renuchoudhary 213 namestey) >>>> >>>> I want it to store as >>>> >>>> (YogeshKumar, 210, hello) >>>> (Mohitkumar, 211,hi) >>>> (AAshichoudhary, 212, hii) >>>> (renuchoudhary, 213, namestey) >>>> >>>> >>>> Please suggest and Help >>>> >>>> Thanks & Regards >>>> Yogesh Kumar >>>> >>>> >>>> >>>> >>>> Please do not print this email unless it is absolutely necessary. >>>> >>>> The information contained in this electronic message and any attachments >>>> to this message are intended for the exclusive use of the addressee(s) and >>>> may contain proprietary, confidential or privileged information. If you >>>> are not the intended recipient, you should not disseminate, distribute or >>>> copy this e-mail. Please notify the sender immediately and destroy all >>>> copies of this message and any attachments. >>>> >>>> WARNING: Computer viruses can be transmitted via email. The recipient >>>> should check this email and any attachments for the presence of viruses. >>>> The company accepts no liability for any damage caused by any virus >>>> transmitted by this email. >>>> >>>> www.wipro.com >>> >>> Please do not print this email unless it is absolutely necessary. >>> >>> The information contained in this electronic message and any attachments to >>> this message are intended for the exclusive use of the addressee(s) and may >>> contain proprietary, confidential or privileged information. If you are not >>> the intended recipient, you should not disseminate, distribute or copy this >>> e-mail. Please notify the sender immediately and destroy all copies of this >>> message and any attachments. >>> >>> WARNING: Computer viruses can be transmitted via email. The recipient >>> should check this email and any attachments for the presence of viruses. >>> The company accepts no liability for any damage caused by any virus >>> transmitted by this email. >>> >>> www.wipro.com >> >> Please do not print this email unless it is absolutely necessary. >> >> The information contained in this electronic message and any attachments to >> this message are intended for the exclusive use of the addressee(s) and may >> contain proprietary, confidential or privileged information. If you are not >> the intended recipient, you should not disseminate, distribute or copy this >> e-mail. Please notify the sender immediately and destroy all copies of this >> message and any attachments. >> >> WARNING: Computer viruses can be transmitted via email. The recipient should >> check this email and any attachments for the presence of viruses. The >> company accepts no liability for any damage caused by any virus transmitted >> by this email. >> >> www.wipro.com