Pig 0.11.1 blocks at: Connecting to hadoop file system at: file:///

2016-04-25 Thread Vadim Vararu

Hi,

Trying to run pig in local mode:
//tmp/pig-0.11.1/bin/pig -x local -m /tmp/pig.properties -f 
"/tmp/pig-scripts/local/pig_script.pig"/


It blocks at the:
/2016-04-25 08:46:55,947 [main] INFO 
org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - 
Connecting to hadoop file system at: file:

and stays at this line infinitely.

The problem is on pig 0.11.1, but does not reproduce on 0.12.0
It does not print anything in the logs or console, so I don't have a 
clue why it happens.   Any ideas?


Thank, Vadim.




RE: System auto reboot When MR runs

2016-04-25 Thread sunww
It maybe a kernel bug. 

url is https://bugs.centos.org/print_bug_page.php?bug_id=7770


From: spe...@outlook.com
To: user@hadoop.apache.org
Subject: System auto  reboot When MR runs
Date: Sun, 24 Apr 2016 13:07:31 +




Hi
I'm using Hadoop2.7   with  cgroup enabled on Redhat7.1.

When I run  large MR jobs, some nodemanager machine auto reboot. 
If I use DefaultLCEResourcesHandler instead of CgroupsLCEResourcesHandler, 
The MR jobs run fine.

/var/crash/127.0.0.1-2016.04.23-21:52:08/vmcore-dmesg.txt  like this:
CPU: 29 PID: 63957 Comm: java Not tainted 3.10.0-229.el7.x86_64 #1
...
...
[15770.097168] Call Trace:
[15770.097536]  [] ? pick_next_task_fair+0x129/0x1d0
[15770.097905]  [] __schedule+0x127/0x7c0
[15770.098271]  [] schedule+0x29/0x70
[15770.098633]  [] futex_wait_queue_me+0xd3/0x130
[15770.098992]  [] futex_wait+0x179/0x280
[15770.099353]  [] ? native_sched_clock+0x13/0x80
[15770.099698]  [] ? sched_clock+0x9/0x10
[15770.100057]  [] ? sched_slice.isra.51+0x5e/0xc0
[15770.100419]  [] ? __enqueue_entity+0x78/0x80
[15770.100783]  [] do_futex+0xfe/0x5b0
[15770.101143]  [] ? wake_up_new_task+0x104/0x160
[15770.101496]  [] SyS_futex+0x80/0x180
[15770.101852]  [] system_call_fastpath+0x16/0x1b


Any suggestion will be appreciated. Thanks