In streaming contents of the file will be streamed to mapper through
STDIN, not the file names.
Fix the perl script accordingly.
Thanks, Subir
On 8/3/12, Devi Kumarappan wrote:
>
>
> After specifying NLineInputFormat option, streaming job fails with
>
> Error from attempt_201205171448_0092_m_00
Just for reference of others who might see this thread. Jira
corresponding to parameter on reduce input limit is MAPREDUCE-2324
On 7/14/12, Harsh J wrote:
> Subir,
>
> On Sat, Jul 14, 2012 at 5:30 PM, Subir S wrote:
>> Harsh, Thanks I think this is what I was looking for. I
ists.
>
> On Tue, Jul 10, 2012 at 8:59 PM, Subir S wrote:
>> Is there any property to convey the maximum amount of data each
>> reducer/partition may take for processing. Like the bytes_per_reducer
>> of pig, so that the count of reducers can be controlled based on size
>
Probably a wrong question in a wrong thread and wrong mailing list :)
On 7/10/12, Subir S wrote:
> Is there any property to convey the maximum amount of data each
> reducer/partition may take for processing. Like the bytes_per_reducer
> of pig, so that the count of reducers can be c
Is there any property to convey the maximum amount of data each
reducer/partition may take for processing. Like the bytes_per_reducer
of pig, so that the count of reducers can be controlled based on size
of intermediate map output data size?
On 7/10/12, Karthik Kambatla wrote:
> The partitioner i
This is a pig mailing list question. +pig list for better response.
Which version of Pig you are using.
You miss the Hbase jars in PIG_CLASSPATH as per logs below.
Try:
export HBASE_CONF_DIR=$HBASE_HOME/conf
export HBASE_CLASSPATH="`/usr/bin/hbase
classpath`:$HBASE_HOME/conf/hbase-site.xml:$HBA
You won't receive ur post, others will. You are able to post; Proof is my reply.
On 3/31/12, Fang Xin wrote:
> all
>
> sorry to bother, as a new user, it seems that I cannot post anything.
> I've tried twice yesterday, but I didn't receive my own post...
>
> can anyone enlighten me? thanks
>
Hi,
Is there any way i can dump the output of my Ruby Map Reduce jobs into
HBase directly? In other words does Hadoop Streaming with Ruby integrate
with HBase? Like Pig has HBaseStorage etc.
Thanks in advance!
Regards
Subir
Hello Folks,
Are there any pointers to such comparisons between Apache Pig and Hadoop
Streaming Map Reduce jobs?
Also there was a claim in our company that Pig performs better than Map
Reduce jobs? Is this true? Are there any such benchmarks available
Thanks, Subir
