Also, it would be help to go to the MapReduce web UI and having a look
at the details of the job corresponding to this query.
Regards,
Mohammad Tariq
On Wed, Jul 25, 2012 at 5:31 PM, Mohammad Tariq <donta...@gmail.com> wrote:
> I have worked with pig-0.7.0 once and it was working fine. Try to see
> if there is anything interesting in the log files. Also, if possible,
> share 2-3 lines of your file..I'll give it a try on my machine.
>
> Regards,
> Mohammad Tariq
>
>
> On Wed, Jul 25, 2012 at 5:20 PM, <yogesh.kuma...@wipro.com> wrote:
>> Hi Mohammad,
>>
>> I have switched from pig 0.10.0 to 0.7.0 and its horrible experience.
>> I do perform
>>
>> grunt> A = load '/hello/demotry.txt'
>>>> as (name:chararray, roll:int, mssg:chararray);
>>
>> grunt> dump A;
>>
>> it shows this error:
>>
>> grunt> dump A;
>> 2012-07-25 17:20:34,081 [main] INFO
>> org.apache.pig.impl.logicalLayer.optimizer.PruneColumns - No column pruned
>> for A
>> 2012-07-25 17:20:34,081 [main] INFO
>> org.apache.pig.impl.logicalLayer.optimizer.PruneColumns - No map keys pruned
>> for A
>> 2012-07-25 17:20:34,102 [main] INFO
>> org.apache.hadoop.metrics.jvm.JvmMetrics - Initializing JVM Metrics with
>> processName=JobTracker, sessionId=
>> 2012-07-25 17:20:34,169 [main] INFO
>> org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - (Name:
>> Store(file:/tmp/temp61624047/tmp1087576502:org.apache.pig.builtin.BinStorage)
>> - 1-18 Operator Key: 1-18)
>> 2012-07-25 17:20:34,195 [main] INFO
>> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MultiQueryOptimizer
>> - MR plan size before optimization: 1
>> 2012-07-25 17:20:34,195 [main] INFO
>> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MultiQueryOptimizer
>> - MR plan size after optimization: 1
>> 2012-07-25 17:20:34,211 [main] INFO
>> org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics
>> with processName=JobTracker, sessionId= - already initialized
>> 2012-07-25 17:20:34,217 [main] INFO
>> org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics
>> with processName=JobTracker, sessionId= - already initialized
>> 2012-07-25 17:20:34,217 [main] INFO
>> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler
>> - mapred.job.reduce.markreset.buffer.percent is not set, set to default 0.3
>> 2012-07-25 17:20:35,570 [main] INFO
>> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler
>> - Setting up single store job
>> 2012-07-25 17:20:35,599 [main] INFO
>> org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics
>> with processName=JobTracker, sessionId= - already initialized
>> 2012-07-25 17:20:35,600 [main] INFO
>> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
>> - 1 map-reduce job(s) waiting for submission.
>> 2012-07-25 17:20:35,606 [Thread-7] WARN org.apache.hadoop.mapred.JobClient
>> - Use GenericOptionsParser for parsing the arguments. Applications should
>> implement Tool for the same.
>> 2012-07-25 17:20:35,750 [Thread-7] INFO
>> org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics
>> with processName=JobTracker, sessionId= - already initialized
>> 2012-07-25 17:20:35,763 [Thread-7] INFO
>> org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics
>> with processName=JobTracker, sessionId= - already initialized
>> 2012-07-25 17:20:36,101 [main] INFO
>> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
>> - 0% complete
>> 2012-07-25 17:20:36,101 [main] INFO
>> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
>> - 100% complete
>> 2012-07-25 17:20:36,101 [main] ERROR
>> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
>> - 1 map reduce job(s) failed!
>> 2012-07-25 17:20:36,107 [main] ERROR
>> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
>> - Failed to produce result in: "file:/tmp/temp61624047/tmp1087576502"
>> 2012-07-25 17:20:36,107 [main] INFO
>> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
>> - Failed!
>> 2012-07-25 17:20:36,120 [main] INFO
>> org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics
>> with processName=JobTracker, sessionId= - already initialized
>> 2012-07-25 17:20:36,121 [main] ERROR org.apache.pig.tools.grunt.Grunt -
>> ERROR 2997: Unable to recreate exception from backend error:
>> org.apache.pig.backend.executionengine.ExecException: ERROR 2118: Unable to
>> create input splits for: file:///hello/demotry.txt
>> Details at logfile: /users/mediaadmin/pig_1343217013235.log
>>
>>
>> why is it happening so :-(
>>
>> Please help and Suggest
>>
>> Thanks & Regards
>> yogesh Kumar
>>
>>
>>
>> ________________________________________
>> From: Mohammad Tariq [donta...@gmail.com]
>> Sent: Wednesday, July 25, 2012 5:00 PM
>> To: user@pig.apache.org
>> Subject: Re: DATA not storing as comma-separted
>>
>> Hi Yogesh,
>>
>> Is 'load' working fine with PigStorage()?? Try to load
>> something using PigStorage(',') and dump it to see if that is working.
>>
>> Regards,
>> Mohammad Tariq
>>
>>
>> On Wed, Jul 25, 2012 at 4:41 PM, <yogesh.kuma...@wipro.com> wrote:
>>> Hello Dmitriy,
>>>
>>> I have also performed the cat command in hadoop.
>>>
>>> hadoop dfs -cat /hadoop/pig/records/part-m-00000
>>>
>>> but still it shows same output without commas.
>>> Please suggest
>>>
>>> Thanks & regards
>>> Yogesh Kumar
>>> ________________________________________
>>> From: Dmitriy Ryaboy [dvrya...@gmail.com]
>>> Sent: Wednesday, July 25, 2012 4:33 PM
>>> To: user@pig.apache.org
>>> Subject: Re: DATA not storing as comma-separted
>>>
>>> Using the store expression you wrote should work. Dump is its own thing and
>>> doesn't know anything about the format you store things in. To see files
>>> created on hdfs, you can use cat.
>>>
>>> On Jul 25, 2012, at 3:48 AM, <yogesh.kuma...@wipro.com> wrote:
>>>
>>>> Hi All,
>>>>
>>>> I am new to PIG, trying to stroe data in HDFS as comma separated by using
>>>> command
>>>>
>>>> store RECORDS into 'hadoop/pig/records' using PigStorage(',');
>>>>
>>>> If I do
>>>>
>>>> dump RECORDS ;
>>>>
>>>> it shows
>>>>
>>>> (YogeshKumar 210 hello)
>>>> (Mohitkumar 211 hi)
>>>> (AAshichoudhary 212 hii)
>>>> (renuchoudhary 213 namestey)
>>>>
>>>> I want it to store as
>>>>
>>>> (YogeshKumar, 210, hello)
>>>> (Mohitkumar, 211,hi)
>>>> (AAshichoudhary, 212, hii)
>>>> (renuchoudhary, 213, namestey)
>>>>
>>>>
>>>> Please suggest and Help
>>>>
>>>> Thanks & Regards
>>>> Yogesh Kumar
>>>>
>>>>
>>>>
>>>>
>>>> Please do not print this email unless it is absolutely necessary.
>>>>
>>>> The information contained in this electronic message and any attachments
>>>> to this message are intended for the exclusive use of the addressee(s) and
>>>> may contain proprietary, confidential or privileged information. If you
>>>> are not the intended recipient, you should not disseminate, distribute or
>>>> copy this e-mail. Please notify the sender immediately and destroy all
>>>> copies of this message and any attachments.
>>>>
>>>> WARNING: Computer viruses can be transmitted via email. The recipient
>>>> should check this email and any attachments for the presence of viruses.
>>>> The company accepts no liability for any damage caused by any virus
>>>> transmitted by this email.
>>>>
>>>> www.wipro.com
>>>
>>> Please do not print this email unless it is absolutely necessary.
>>>
>>> The information contained in this electronic message and any attachments to
>>> this message are intended for the exclusive use of the addressee(s) and may
>>> contain proprietary, confidential or privileged information. If you are not
>>> the intended recipient, you should not disseminate, distribute or copy this
>>> e-mail. Please notify the sender immediately and destroy all copies of this
>>> message and any attachments.
>>>
>>> WARNING: Computer viruses can be transmitted via email. The recipient
>>> should check this email and any attachments for the presence of viruses.
>>> The company accepts no liability for any damage caused by any virus
>>> transmitted by this email.
>>>
>>> www.wipro.com
>>
>> Please do not print this email unless it is absolutely necessary.
>>
>> The information contained in this electronic message and any attachments to
>> this message are intended for the exclusive use of the addressee(s) and may
>> contain proprietary, confidential or privileged information. If you are not
>> the intended recipient, you should not disseminate, distribute or copy this
>> e-mail. Please notify the sender immediately and destroy all copies of this
>> message and any attachments.
>>
>> WARNING: Computer viruses can be transmitted via email. The recipient should
>> check this email and any attachments for the presence of viruses. The
>> company accepts no liability for any damage caused by any virus transmitted
>> by this email.
>>
>> www.wipro.com
