Jarcec, finally I got solved this problem by learning more on hadoop 2
(lot of reading), and then tuning some settings to let the work move
from the SCHEDULED state. With this said, the last problem was only
concerning on hadoop.
Thanks for your support!
El 30/10/13 18:03, Jarek Jarcec Cecho
Hi Claudio,
it's hard to guess from the limited information. I would suggest to take a look
into logs to see what is happening.
One guess though - You've mentioned that the task was "running" for 30 minutes,
but it still seems to be in SCHEDULED time - are your node managers correctly
running?
Indeed. Do you mind filing a jira?
https://issues.apache.org/jira/browse/PIG
On Wed, Oct 30, 2013 at 11:34 AM, Henning Kropp wrote:
> Wow, I was pretty sure to have tested it, but apparently not. The reason
> for the NPE seems to be the @MonitoredUDF
>
> You can reproduced it with the following
Wow, I was pretty sure to have tested it, but apparently not. The reason
for the NPE seems to be the @MonitoredUDF
You can reproduced it with the following code:
import java.io.IOException;
import java.util.concurrent.TimeUnit;
import org.apache.hadoop.conf.Configuration;
import org.apache.pig.Ev
Are you able to post your UDF (or at least a sanitized version)?
On Wed, Oct 30, 2013 at 10:46 AM, Henning Kropp wrote:
> Hi,
>
> thanks for your reply. I read about the expected behavior on the front-end
> and I am getting the NPE on the back-end. The Mappers log the Exception
> during Executio
Hi,
thanks for your reply. I read about the expected behavior on the front-end
and I am getting the NPE on the back-end. The Mappers log the Exception
during Execution.
I am currently digging through debug messages. What to look out for? There
are bunch of
[main] DEBUG org.apache.hadoop.conf.Con
Hi,
Are you getting NPE on the front-end or the back-end? Sounds like jobConf
is not added to UDFContext, which is expected on the front-end. Please see
the comments in getJobConf() and addJobConf() in the source code:
https://svn.apache.org/repos/asf/pig/trunk/src/org/apache/pig/impl/util/UDFCon
Hi,
I am stuck. In my UDF (Java) extends EvalFunc the following code throws and
NPE in exec(), when executed in -x mapred mode:
Configuration jobConf = UDFContext.getUDFContext().getJobConf();
System.err.println(jobConf.toString());
I did not find any useful information as why my JobConf is alwa
Hi Sameer,
Can you replace "DUMP X" with "STORE X into /scratch/X" and retry?
I believe multi-query optimization of pig only works for "STORE" and DUMP is
executed as an independent query.
Besides from that, having randomness in pig/mapreduce code is always tricky.
Any mappers can be retried af
I have a code in SQL to convert to Pig. I request for your help in
converting this code.
WHILE @Dt1 <= @Dt2
BEGIN
INSERT INTO ( , , , )
SELECT , , , ,
WHERE X > Y
SELECT @Dt1 = SELECT DATEADD(MM,1,@Dt1))
END
Hi,
I have a code in SQL to convert to Pig. I request for your help in
converting this code.
WHILE @Dt1 <= @Dt2
BEGIN
INSERT INTO ( , , , )
SELECT , , , ,
WHERE X > Y
SELECT @Dt1 = (SELECT DATEADD(MM,1,@Dt1))
END
Thanks in Advance
11 matches
Mail list logo
