I have worked with pig-0.7.0 once and it was working fine. Try to see
if there is anything interesting in the log files. Also, if possible,
share 2-3 lines of your file..I'll give it a try on my machine.
Regards,
Mohammad Tariq
On Wed, Jul 25, 2012 at 5:20 PM, <yogesh.kuma...@wipro.com> wrote:
> Hi Mohammad,
>
> I have switched from pig 0.10.0 to 0.7.0 and its horrible experience.
> I do perform
>
> grunt> A = load '/hello/demotry.txt'
>>> as (name:chararray, roll:int, mssg:chararray);
>
> grunt> dump A;
>
> it shows this error:
>
> grunt> dump A;
> 2012-07-25 17:20:34,081 [main] INFO
> org.apache.pig.impl.logicalLayer.optimizer.PruneColumns - No column pruned
> for A
> 2012-07-25 17:20:34,081 [main] INFO
> org.apache.pig.impl.logicalLayer.optimizer.PruneColumns - No map keys pruned
> for A
> 2012-07-25 17:20:34,102 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics
> - Initializing JVM Metrics with processName=JobTracker, sessionId=
> 2012-07-25 17:20:34,169 [main] INFO
> org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - (Name:
> Store(file:/tmp/temp61624047/tmp1087576502:org.apache.pig.builtin.BinStorage)
> - 1-18 Operator Key: 1-18)
> 2012-07-25 17:20:34,195 [main] INFO
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MultiQueryOptimizer
> - MR plan size before optimization: 1
> 2012-07-25 17:20:34,195 [main] INFO
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MultiQueryOptimizer
> - MR plan size after optimization: 1
> 2012-07-25 17:20:34,211 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics
> - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= -
> already initialized
> 2012-07-25 17:20:34,217 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics
> - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= -
> already initialized
> 2012-07-25 17:20:34,217 [main] INFO
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler
> - mapred.job.reduce.markreset.buffer.percent is not set, set to default 0.3
> 2012-07-25 17:20:35,570 [main] INFO
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler
> - Setting up single store job
> 2012-07-25 17:20:35,599 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics
> - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= -
> already initialized
> 2012-07-25 17:20:35,600 [main] INFO
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
> - 1 map-reduce job(s) waiting for submission.
> 2012-07-25 17:20:35,606 [Thread-7] WARN org.apache.hadoop.mapred.JobClient -
> Use GenericOptionsParser for parsing the arguments. Applications should
> implement Tool for the same.
> 2012-07-25 17:20:35,750 [Thread-7] INFO
> org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics with
> processName=JobTracker, sessionId= - already initialized
> 2012-07-25 17:20:35,763 [Thread-7] INFO
> org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics with
> processName=JobTracker, sessionId= - already initialized
> 2012-07-25 17:20:36,101 [main] INFO
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
> - 0% complete
> 2012-07-25 17:20:36,101 [main] INFO
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
> - 100% complete
> 2012-07-25 17:20:36,101 [main] ERROR
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
> - 1 map reduce job(s) failed!
> 2012-07-25 17:20:36,107 [main] ERROR
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
> - Failed to produce result in: "file:/tmp/temp61624047/tmp1087576502"
> 2012-07-25 17:20:36,107 [main] INFO
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
> - Failed!
> 2012-07-25 17:20:36,120 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics
> - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= -
> already initialized
> 2012-07-25 17:20:36,121 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR
> 2997: Unable to recreate exception from backend error:
> org.apache.pig.backend.executionengine.ExecException: ERROR 2118: Unable to
> create input splits for: file:///hello/demotry.txt
> Details at logfile: /users/mediaadmin/pig_1343217013235.log
>
>
> why is it happening so :-(
>
> Please help and Suggest
>
> Thanks & Regards
> yogesh Kumar
>
>
>
> ________________________________________
> From: Mohammad Tariq [donta...@gmail.com]
> Sent: Wednesday, July 25, 2012 5:00 PM
> To: user@pig.apache.org
> Subject: Re: DATA not storing as comma-separted
>
> Hi Yogesh,
>
> Is 'load' working fine with PigStorage()?? Try to load
> something using PigStorage(',') and dump it to see if that is working.
>
> Regards,
> Mohammad Tariq
>
>
> On Wed, Jul 25, 2012 at 4:41 PM, <yogesh.kuma...@wipro.com> wrote:
>> Hello Dmitriy,
>>
>> I have also performed the cat command in hadoop.
>>
>> hadoop dfs -cat /hadoop/pig/records/part-m-00000
>>
>> but still it shows same output without commas.
>> Please suggest
>>
>> Thanks & regards
>> Yogesh Kumar
>> ________________________________________
>> From: Dmitriy Ryaboy [dvrya...@gmail.com]
>> Sent: Wednesday, July 25, 2012 4:33 PM
>> To: user@pig.apache.org
>> Subject: Re: DATA not storing as comma-separted
>>
>> Using the store expression you wrote should work. Dump is its own thing and
>> doesn't know anything about the format you store things in. To see files
>> created on hdfs, you can use cat.
>>
>> On Jul 25, 2012, at 3:48 AM, <yogesh.kuma...@wipro.com> wrote:
>>
>>> Hi All,
>>>
>>> I am new to PIG, trying to stroe data in HDFS as comma separated by using
>>> command
>>>
>>> store RECORDS into 'hadoop/pig/records' using PigStorage(',');
>>>
>>> If I do
>>>
>>> dump RECORDS ;
>>>
>>> it shows
>>>
>>> (YogeshKumar 210 hello)
>>> (Mohitkumar 211 hi)
>>> (AAshichoudhary 212 hii)
>>> (renuchoudhary 213 namestey)
>>>
>>> I want it to store as
>>>
>>> (YogeshKumar, 210, hello)
>>> (Mohitkumar, 211,hi)
>>> (AAshichoudhary, 212, hii)
>>> (renuchoudhary, 213, namestey)
>>>
>>>
>>> Please suggest and Help
>>>
>>> Thanks & Regards
>>> Yogesh Kumar
>>>
>>>
>>>
>>>
>>> Please do not print this email unless it is absolutely necessary.
>>>
>>> The information contained in this electronic message and any attachments to
>>> this message are intended for the exclusive use of the addressee(s) and may
>>> contain proprietary, confidential or privileged information. If you are not
>>> the intended recipient, you should not disseminate, distribute or copy this
>>> e-mail. Please notify the sender immediately and destroy all copies of this
>>> message and any attachments.
>>>
>>> WARNING: Computer viruses can be transmitted via email. The recipient
>>> should check this email and any attachments for the presence of viruses.
>>> The company accepts no liability for any damage caused by any virus
>>> transmitted by this email.
>>>
>>> www.wipro.com
>>
>> Please do not print this email unless it is absolutely necessary.
>>
>> The information contained in this electronic message and any attachments to
>> this message are intended for the exclusive use of the addressee(s) and may
>> contain proprietary, confidential or privileged information. If you are not
>> the intended recipient, you should not disseminate, distribute or copy this
>> e-mail. Please notify the sender immediately and destroy all copies of this
>> message and any attachments.
>>
>> WARNING: Computer viruses can be transmitted via email. The recipient should
>> check this email and any attachments for the presence of viruses. The
>> company accepts no liability for any damage caused by any virus transmitted
>> by this email.
>>
>> www.wipro.com
>
> Please do not print this email unless it is absolutely necessary.
>
> The information contained in this electronic message and any attachments to
> this message are intended for the exclusive use of the addressee(s) and may
> contain proprietary, confidential or privileged information. If you are not
> the intended recipient, you should not disseminate, distribute or copy this
> e-mail. Please notify the sender immediately and destroy all copies of this
> message and any attachments.
>
> WARNING: Computer viruses can be transmitted via email. The recipient should
> check this email and any attachments for the presence of viruses. The company
> accepts no liability for any damage caused by any virus transmitted by this
> email.
>
> www.wipro.com
