Again, moving to [email protected] (please subscribe if you haven't already, Kartheek).
Kartheek, is this from attempt_201403100147_0004_m_000001_1 or one of the failed task logs? On Thu, Mar 13, 2014 at 9:27 PM, kartheek reddy <[email protected]> wrote: > i found this error in task tracker log. > 2014-03-13 21:17:16,809 INFO org.apache.hadoop.mapred.TaskTracker: JVM with > ID: jvm_201403132057_0001_m_-669109447 given task: > attempt_201403132057_0001_m_000001_1 > 2014-03-13 21:17:18,483 INFO org.apache.hadoop.mapred.TaskTracker: > attempt_201403132057_0001_m_000000_1 0.0% > 2014-03-13 21:17:18,517 INFO org.apache.hadoop.mapred.TaskTracker: > attempt_201403132057_0001_m_000001_1 0.0% > 2014-03-13 21:17:18,687 INFO org.apache.hadoop.mapred.JvmManager: JVM : > jvm_201403132057_0001_m_-1511417430 exited with exit code 0. Number of tasks > it ran: 0 > 2014-03-13 21:17:18,711 INFO org.apache.hadoop.mapred.JvmManager: JVM : > jvm_201403132057_0001_m_-669109447 exited with exit code 0. Number of tasks > it ran: 0 > 2014-03-13 21:17:21,690 INFO org.apache.hadoop.mapred.TaskTracker: > addFreeSlot : current free slots : 1 > 2014-03-13 21:17:21,713 INFO org.apache.hadoop.mapred.TaskTracker: > addFreeSlot : current free slots : 2 > 2014-03-13 21:17:21,856 INFO org.apache.hadoop.mapred.TaskTracker: > LaunchTaskAction (registerTask): attempt_201403132057_0001_m_000000_2 task's > state:UNASSIGNED > 2014-03-13 21:17:21,857 INFO org.apache.hadoop.mapred.TaskTracker: > LaunchTaskAction (registerTask): attempt_201403132057_0001_m_000001_2 task's > state:UNASSIGNED > 2014-03-13 21:17:21,857 INFO org.apache.hadoop.mapred.TaskTracker: Trying to > launch : attempt_201403132057_0001_m_000000_2 which needs 1 slots > 2014-03-13 21:17:21,857 INFO org.apache.hadoop.mapred.TaskTracker: In > TaskLauncher, current free slots : 2 and trying to launch > attempt_201403132057_0001_m_000000_2 which needs 1 slots > 2014-03-13 21:17:21,857 INFO org.apache.hadoop.mapred.TaskTracker: Trying to > launch : attempt_201403132057_0001_m_000001_2 which needs 1 slots > 2014-03-13 21:17:21,858 INFO org.apache.hadoop.mapred.TaskTracker: In > TaskLauncher, current free slots : 1 and trying to launch > attempt_201403132057_0001_m_000001_2 which needs 1 slots > 2014-03-13 21:17:21,867 INFO org.apache.hadoop.mapred.JvmManager: In > JvmRunner constructed JVM ID: jvm_201403132057_0001_m_107561801 > 2014-03-13 21:17:21,867 INFO org.apache.hadoop.mapred.JvmManager: JVM Runner > jvm_201403132057_0001_m_107561801 spawned. > 2014-03-13 21:17:21,868 INFO org.apache.hadoop.mapred.JvmManager: In > JvmRunner constructed JVM ID: jvm_201403132057_0001_m_-238632827 > 2014-03-13 21:17:21,872 INFO org.apache.hadoop.mapred.JvmManager: JVM Runner > jvm_201403132057_0001_m_-238632827 spawned. > 2014-03-13 21:17:21,873 INFO org.apache.hadoop.mapred.TaskController: > Writing commands to > /home/hduser/tmp/mapred/local/ttprivate/taskTracker/hduser/jobcache/job_201403132057_0001/attempt_201403132057_0001_m_000000_2/taskjvm.sh > 2014-03-13 21:17:21,874 INFO org.apache.hadoop.mapred.TaskController: > Writing commands to > /home/hduser/tmp/mapred/local/ttprivate/taskTracker/hduser/jobcache/job_201403132057_0001/attempt_201403132057_0001_m_000001_2/taskjvm.sh > 2014-03-13 21:17:22,524 INFO org.apache.hadoop.mapred.TaskTracker: JVM with > ID: jvm_201403132057_0001_m_-238632827 given task: > attempt_201403132057_0001_m_000001_2 > 2014-03-13 21:17:22,573 INFO org.apache.hadoop.mapred.TaskTracker: JVM with > ID: jvm_201403132057_0001_m_107561801 given task: > attempt_201403132057_0001_m_000000_2 > 2014-03-13 21:17:24,327 INFO org.apache.hadoop.mapred.TaskTracker: > attempt_201403132057_0001_m_000000_2 0.0% > 2014-03-13 21:17:24,473 INFO org.apache.hadoop.mapred.TaskTracker: > attempt_201403132057_0001_m_000001_2 0.0% > 2014-03-13 21:17:24,621 INFO org.apache.hadoop.mapred.JvmManager: JVM : > jvm_201403132057_0001_m_107561801 exited with exit code 0. Number of tasks > it ran: 0 > 2014-03-13 21:17:24,636 INFO org.apache.hadoop.mapred.JvmManager: JVM : > jvm_201403132057_0001_m_-238632827 exited with exit code 0. Number of tasks > it ran: 0 > 2014-03-13 21:17:27,627 INFO org.apache.hadoop.mapred.TaskTracker: > addFreeSlot : current free slots : 1 > 2014-03-13 21:17:27,642 INFO org.apache.hadoop.mapred.TaskTracker: > addFreeSlot : current free slots : 2 > 2014-03-13 21:17:27,675 INFO org.apache.hadoop.mapred.TaskTracker: > LaunchTaskAction (registerTask): attempt_201403132057_0001_m_000000_3 task's > state:UNASSIGNED > 2014-03-13 21:17:27,675 INFO org.apache.hadoop.mapred.TaskTracker: > LaunchTaskAction (registerTask): attempt_201403132057_0001_m_000001_3 task's > state:UNASSIGNED > 2014-03-13 21:17:27,675 INFO org.apache.hadoop.mapred.TaskTracker: Trying to > launch : attempt_201403132057_0001_m_000000_3 which needs 1 slots > 2014-03-13 21:17:27,675 INFO org.apache.hadoop.mapred.TaskTracker: In > TaskLauncher, current free slots : 2 and trying to launch > attempt_201403132057_0001_m_000000_3 which needs 1 slots > 2014-03-13 21:17:27,676 INFO org.apache.hadoop.mapred.TaskTracker: Trying to > launch : attempt_201403132057_0001_m_000001_3 which needs 1 slots > 2014-03-13 21:17:27,676 INFO org.apache.hadoop.mapred.TaskTracker: In > TaskLauncher, current free slots : 1 and trying to launch > attempt_201403132057_0001_m_000001_3 which needs 1 slots > 2014-03-13 21:17:27,685 INFO org.apache.hadoop.mapred.JvmManager: In > JvmRunner constructed JVM ID: jvm_201403132057_0001_m_-607582511 > 2014-03-13 21:17:27,685 INFO org.apache.hadoop.mapred.JvmManager: JVM Runner > jvm_201403132057_0001_m_-607582511 spawned. > 2014-03-13 21:17:27,685 INFO org.apache.hadoop.mapred.JvmManager: In > JvmRunner constructed JVM ID: jvm_201403132057_0001_m_1970579140 > 2014-03-13 21:17:27,694 INFO org.apache.hadoop.mapred.JvmManager: JVM Runner > jvm_201403132057_0001_m_1970579140 spawned. > 2014-03-13 21:17:27,694 INFO org.apache.hadoop.mapred.TaskController: > Writing commands to > /home/hduser/tmp/mapred/local/ttprivate/taskTracker/hduser/jobcache/job_201403132057_0001/attempt_201403132057_0001_m_000000_3/taskjvm.sh > 2014-03-13 21:17:27,696 INFO org.apache.hadoop.mapred.TaskController: > Writing commands to > /home/hduser/tmp/mapred/local/ttprivate/taskTracker/hduser/jobcache/job_201403132057_0001/attempt_201403132057_0001_m_000001_3/taskjvm.sh > 2014-03-13 21:17:28,389 INFO org.apache.hadoop.mapred.TaskTracker: JVM with > ID: jvm_201403132057_0001_m_-607582511 given task: > attempt_201403132057_0001_m_000000_3 > 2014-03-13 21:17:28,434 INFO org.apache.hadoop.mapred.TaskTracker: JVM with > ID: jvm_201403132057_0001_m_1970579140 given task: > attempt_201403132057_0001_m_000001_3 > 2014-03-13 21:17:30,045 INFO org.apache.hadoop.mapred.TaskTracker: > attempt_201403132057_0001_m_000000_3 0.0% > 2014-03-13 21:17:30,117 INFO org.apache.hadoop.mapred.TaskTracker: > attempt_201403132057_0001_m_000001_3 0.0% > 2014-03-13 21:17:30,162 INFO org.apache.hadoop.mapred.JvmManager: JVM : > jvm_201403132057_0001_m_-607582511 exited with exit code 0. Number of tasks > it ran: 0 > 2014-03-13 21:17:30,267 INFO org.apache.hadoop.mapred.JvmManager: JVM : > jvm_201403132057_0001_m_1970579140 exited with exit code 0. Number of tasks > it ran: 0 > 2014-03-13 21:17:33,163 INFO org.apache.hadoop.mapred.TaskTracker: > addFreeSlot : current free slots : 1 > 2014-03-13 21:17:33,171 INFO org.apache.hadoop.mapred.TaskTracker: > LaunchTaskAction (registerTask): attempt_201403132057_0001_m_000004_0 task's > state:UNASSIGNED > 2014-03-13 21:17:33,171 INFO org.apache.hadoop.mapred.TaskTracker: Trying to > launch : attempt_201403132057_0001_m_000004_0 which needs 1 slots > 2014-03-13 21:17:33,171 INFO org.apache.hadoop.mapred.TaskTracker: In > TaskLauncher, current free slots : 1 and trying to launch > attempt_201403132057_0001_m_000004_0 which needs 1 slots > 2014-03-13 21:17:33,176 INFO org.apache.hadoop.mapred.JvmManager: In > JvmRunner constructed JVM ID: jvm_201403132057_0001_m_-1874753763 > 2014-03-13 21:17:33,177 INFO org.apache.hadoop.mapred.JvmManager: JVM Runner > jvm_201403132057_0001_m_-1874753763 spawned. > 2014-03-13 21:17:33,178 INFO org.apache.hadoop.mapred.TaskController: > Writing commands to > /home/hduser/tmp/mapred/local/ttprivate/taskTracker/hduser/jobcache/job_201403132057_0001/attempt_201403132057_0001_m_000004_0/taskjvm.sh > 2014-03-13 21:17:33,268 INFO org.apache.hadoop.mapred.TaskTracker: > addFreeSlot : current free slots : 1 > 2014-03-13 21:17:33,818 INFO org.apache.hadoop.mapred.TaskTracker: JVM with > ID: jvm_201403132057_0001_m_-1874753763 given task: > attempt_201403132057_0001_m_000004_0 > 2014-03-13 21:17:34,619 INFO org.apache.hadoop.mapred.TaskTracker: > attempt_201403132057_0001_m_000004_0 0.0% > 2014-03-13 21:17:34,669 INFO org.apache.hadoop.mapred.TaskTracker: > attempt_201403132057_0001_m_000004_0 0.0% cleanup > 2014-03-13 21:17:34,670 INFO org.apache.hadoop.mapred.TaskTracker: Task > attempt_201403132057_0001_m_000004_0 is done. > 2014-03-13 21:17:34,671 INFO org.apache.hadoop.mapred.TaskTracker: reported > output size for attempt_201403132057_0001_m_000004_0 was -1 > 2014-03-13 21:17:34,671 INFO org.apache.hadoop.mapred.TaskTracker: > addFreeSlot : current free slots : 2 > 2014-03-13 21:17:34,812 INFO org.apache.hadoop.mapred.TaskTracker: Received > KillTaskAction for task: attempt_201403132057_0001_m_000000_3 > 2014-03-13 21:17:34,812 INFO org.apache.hadoop.mapred.TaskTracker: Received > KillTaskAction for task: attempt_201403132057_0001_m_000001_3 > 2014-03-13 21:17:34,812 INFO org.apache.hadoop.mapred.TaskTracker: Received > 'KillJobAction' for job: job_201403132057_0001 > 2014-03-13 21:17:34,814 INFO org.apache.hadoop.mapred.IndexCache: Map ID > attempt_201403132057_0001_m_000004_0 not found in cache > 2014-03-13 21:17:34,814 INFO org.apache.hadoop.mapred.UserLogCleaner: Adding > job_201403132057_0001 for user-log deletion with > retainTimeStamp:1394857054814 > 2014-03-13 21:17:34,870 INFO org.apache.hadoop.mapred.JvmManager: JVM : > jvm_201403132057_0001_m_-1874753763 exited with exit code 0. Number of tasks > it ran: 1 > > > Thanks & Regards > Kartheek Reddy > 91-8390753543 > > >> From: [email protected] >> Date: Thu, 13 Mar 2014 15:02:27 -0700 >> Subject: Re: Oraoop_Issue >> To: [email protected]; [email protected] > >> >> Moving to [email protected] (please subscribe if you haven't >> already, Kartheek). >> >> Hi Kartheek, >> >> As mentioned in the error message "Can't export data, please check >> task tracker logs," looks like there will be more helpful debugging >> information contained in attempt_201403100147_0004_m_000001_1 - can >> you please post the error messages from there? >> >> Regards, >> Kate >> >> On Wed, Mar 12, 2014 at 10:22 PM, kartheek reddy >> <[email protected]> wrote: >> > >> > Hi Kathleen , >> > >> > Greeting. >> > >> > This is Kartheek from india. i had >> > issue withe oraoop connector.while am exporting the data from hive to >> > oracle >> > database am getting follow error ...please can u help me on this.i >> > posted >> > but no body reply me.and one more query like how can i increase my >> > export/import performance by using oraoop. if any parameters i have to >> > change in oraoop-site.xml.if changes required please tell me what are >> > the >> > changes i do.. here am using sqoop version is apache sqopp 1.4.3 and >> > hadoop >> > 1.1.2 . >> > >> > 14/03/10 02:21:46 INFO mapred.JobClient: Task Id : >> > attempt_201403100147_0004_m_000001_1, Status : FAILED >> > java.io.IOException: Can't export data, please check task tracker logs >> > at >> > >> > org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:112) >> > at >> > >> > org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:39) >> > at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144) >> > at >> > >> > org.apache.sqoop.mapreduce.AutoProgressMapper.run(AutoProgressMapper.java:64) >> > at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764) >> > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370) >> > at org.apache.hadoop.mapred.Child$4.run(Child.java:255) >> > at java.security.AccessController.doPrivileged(Native Method) >> > at javax.security.auth.Subject.doAs(Subject.java:415) >> > at >> > >> > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1149) >> > at org.apache.hadoop.mapred.Child.main(Child.java:249) >> > Caused by: java.io.IOException: java.sql.SQLException: >> > java.lang.NullPointerException >> > at >> > >> > org.apache.sqoop.mapreduce.AsyncSqlRecordWriter.write(AsyncSqlRecordWriter.java:220) >> > at >> > >> > com.quest.oraoop.OraOopOutputFormatBase$OraOopDBRecordWriterBase.write(OraOopOutputFormatBase.java:507) >> > at >> > >> > com.quest.oraoop.OraOopOutputFormatInsert$OraOopDBRecordWriterInsert.write(OraOopOutputFormatInsert.java:94) >> > at >> > >> > com.quest.oraoop.OraOopOutputFormatBase$OraOopDBRecordWriterBase.write(OraOopOutputFormatBase.java:175) >> > at >> > >> > org.apache.hadoop.mapred.MapTask$NewDirectOutputCollector.write(MapTask.java:639) >> > at >> > >> > org.apache.hadoop.mapreduce.TaskInputOutputContext.write(TaskInputOutputContext.java:80) >> > at >> > >> > org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:84) >> > ... 10 more >> > Caused by: java.sql.SQLException: java.lang.NullPointerException >> > at >> > >> > com.quest.oraoop.OraOopOutputFormatInsert$OraOopDBRecordWriterInsert.configurePreparedStatement(OraOopOutputFormatInsert.java:228) >> > sqoop export --connect jdbc:oracle:thin:@servername:1521:grasa01 >> > --username >> > TEST --password gra --table K --export-dir /user/hive/warehouse/k >> > --columns >> > 'c_id' --input-lines-terminated-by '\n' >> > >> > >> > Thanks & Regards >> > Kartheek Reddy
