[jira] [Commented] (HIVE-8966) Delta files created by hive hcatalog streaming cannot be compacted

[Jihong Liu (JIRA)]

    [ 
https://issues.apache.org/jira/browse/HIVE-8966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14266854#comment-14266854
 ] 

Jihong Liu commented on HIVE-8966:
----------------------------------

The error occur when doing the mapreduce job. Following is log in 
hivemetastore.log

2015-01-06 16:42:22,506 INFO  [sfdmgctmn003.gid.gap.com-32]: compactor.Worker 
(Worker.java:run(137)) - Starting MAJOR compaction for 
ds_infra.event_metrics.date=2014-12-24
2015-01-06 16:42:22,564 INFO  [sfdmgctmn003.gid.gap.com-32]: 
impl.TimelineClientImpl (TimelineClientImpl.java:serviceInit(285)) - Timeline 
service address: http://sfdmgctmn003.gid.gap.com:8188/ws/v1/timeline/
2015-01-06 16:42:22,622 INFO  [sfdmgctmn003.gid.gap.com-32]: 
impl.TimelineClientImpl (TimelineClientImpl.java:serviceInit(285)) - Timeline 
service address: http://sfdmgctmn003.gid.gap.com:8188/ws/v1/timeline/
2015-01-06 16:42:22,628 WARN  [sfdmgctmn003.gid.gap.com-32]: 
mapreduce.JobSubmitter (JobSubmitter.java:copyAndConfigureFiles(153)) - Hadoop 
command-line option parsing not performed. Implement the Tool interface and 
execute your application with ToolRunner to remedy this.
2015-01-06 16:42:22,753 WARN  [sfdmgctmn003.gid.gap.com-32]: 
split.JobSplitWriter (JobSplitWriter.java:writeOldSplits(168)) - Max block 
location exceeded for split: CompactorInputSplit{base: 
hdfs://sfdmgct/apps/hive/warehouse/ds_infra/event_metrics/date=2014-12-24/base_0035304,
 bucket: 1, length: 292280, deltas: [delta_0035311_0035313, 
delta_0035479_0035481, delta_0035491_0035493, delta_0035515_0035517, 
delta_0035533_0035535, delta_0035548_0035550, delta_0035563_0035565, 
delta_0035578_0035580, delta_0035593_0035595, delta_0035599_0035601, 
delta_0035656_0035658, delta_0035671_0035673, delta_0035686_0035688, 
delta_0035701_0035703, delta_0035716_0035718, delta_0035731_0035733, 
delta_0035746_0035748, delta_0035761_0035763, delta_0035776_0035778, 
delta_0035791_0035793, delta_0035806_0035808, delta_0035821_0035823, 
delta_0035830_0035832, delta_0035842_0035844, delta_0035854_0035856, 
delta_0035866_0035868, delta_0035878_0035880]} splitsize: 27 maxsize: 10
2015-01-06 16:42:22,753 WARN  [sfdmgctmn003.gid.gap.com-32]: 
split.JobSplitWriter (JobSplitWriter.java:writeOldSplits(168)) - Max block 
location exceeded for split: CompactorInputSplit{base: null, bucket: 3, length: 
199770, deltas: [delta_0035311_0035313, delta_0035479_0035481, 
delta_0035491_0035493, delta_0035515_0035517, delta_0035533_0035535, 
delta_0035548_0035550, delta_0035563_0035565, delta_0035578_0035580, 
delta_0035593_0035595, delta_0035599_0035601, delta_0035656_0035658, 
delta_0035671_0035673, delta_0035686_0035688, delta_0035701_0035703, 
delta_0035716_0035718, delta_0035731_0035733, delta_0035746_0035748, 
delta_0035761_0035763, delta_0035776_0035778, delta_0035791_0035793, 
delta_0035806_0035808, delta_0035821_0035823, delta_0035830_0035832, 
delta_0035842_0035844, delta_0035854_0035856, delta_0035866_0035868, 
delta_0035878_0035880]} splitsize: 21 maxsize: 10
2015-01-06 16:42:22,753 WARN  [sfdmgctmn003.gid.gap.com-32]: 
split.JobSplitWriter (JobSplitWriter.java:writeOldSplits(168)) - Max block 
location exceeded for split: CompactorInputSplit{base: 
hdfs://sfdmgct/apps/hive/warehouse/ds_infra/event_metrics/date=2014-12-24/base_0035304,
 bucket: 0, length: 172391, deltas: [delta_0035311_0035313, 
delta_0035479_0035481, delta_0035491_0035493, delta_0035515_0035517, 
delta_0035533_0035535, delta_0035548_0035550, delta_0035563_0035565, 
delta_0035578_0035580, delta_0035593_0035595, delta_0035599_0035601, 
delta_0035656_0035658, delta_0035671_0035673, delta_0035686_0035688, 
delta_0035701_0035703, delta_0035716_0035718, delta_0035731_0035733, 
delta_0035746_0035748, delta_0035761_0035763, delta_0035776_0035778, 
delta_0035791_0035793, delta_0035806_0035808, delta_0035821_0035823, 
delta_0035830_0035832, delta_0035842_0035844, delta_0035854_0035856, 
delta_0035866_0035868, delta_0035878_0035880]} splitsize: 30 maxsize: 10
2015-01-06 16:42:22,777 INFO  [sfdmgctmn003.gid.gap.com-32]: 
mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(494)) - number of 
splits:4
2015-01-06 16:42:22,793 INFO  [sfdmgctmn003.gid.gap.com-32]: 
mapreduce.JobSubmitter (JobSubmitter.java:printTokens(583)) - Submitting tokens 
for job: job_1419291043936_1639
2015-01-06 16:42:23,000 INFO  [sfdmgctmn003.gid.gap.com-32]: 
impl.YarnClientImpl (YarnClientImpl.java:submitApplication(251)) - Submitted 
application application_1419291043936_1639
2015-01-06 16:42:23,001 INFO  [sfdmgctmn003.gid.gap.com-32]: mapreduce.Job 
(Job.java:submit(1300)) - The url to track the job: 
http://sfdmgctmn002.gid.gap.com:8088/proxy/application_1419291043936_1639/
2015-01-06 16:42:23,001 INFO  [sfdmgctmn003.gid.gap.com-32]: mapreduce.Job 
(Job.java:monitorAndPrintJob(1345)) - Running job: job_1419291043936_1639
2015-01-06 16:42:30,042 INFO  [sfdmgctmn003.gid.gap.com-32]: mapreduce.Job 
(Job.java:monitorAndPrintJob(1366)) - Job job_1419291043936_1639 running in 
uber mode : false
2015-01-06 16:42:30,043 INFO  [sfdmgctmn003.gid.gap.com-32]: mapreduce.Job 
(Job.java:monitorAndPrintJob(1373)) -  map 0% reduce 0%
2015-01-06 16:42:35,066 INFO  [sfdmgctmn003.gid.gap.com-32]: mapreduce.Job 
(Job.java:printTaskEvents(1452)) - Task Id : 
attempt_1419291043936_1639_m_000002_0, Status : FAILED
2015-01-06 16:42:37,078 INFO  [sfdmgctmn003.gid.gap.com-32]: mapreduce.Job 
(Job.java:monitorAndPrintJob(1373)) -  map 75% reduce 0%
2015-01-06 16:42:41,091 INFO  [sfdmgctmn003.gid.gap.com-32]: mapreduce.Job 
(Job.java:printTaskEvents(1452)) - Task Id : 
attempt_1419291043936_1639_m_000002_1, Status : FAILED
2015-01-06 16:42:45,105 INFO  [sfdmgctmn003.gid.gap.com-32]: mapreduce.Job 
(Job.java:printTaskEvents(1452)) - Task Id : 
attempt_1419291043936_1639_m_000002_2, Status : FAILED
2015-01-06 16:42:52,124 INFO  [sfdmgctmn003.gid.gap.com-32]: mapreduce.Job 
(Job.java:monitorAndPrintJob(1373)) -  map 100% reduce 0%
2015-01-06 16:42:52,130 INFO  [sfdmgctmn003.gid.gap.com-32]: mapreduce.Job 
(Job.java:monitorAndPrintJob(1386)) - Job job_1419291043936_1639 failed with 
state FAILED due to: Task failed task_1419291043936_1639_m_000002
Job failed as tasks failed. failedMaps:1 failedReduces:0

2015-01-06 16:42:52,149 INFO  [sfdmgctmn003.gid.gap.com-32]: mapreduce.Job 
(Job.java:monitorAndPrintJob(1391)) - Counters: 32
        File System Counters
                FILE: Number of bytes read=0
                FILE: Number of bytes written=668781
                FILE: Number of read operations=0
                FILE: Number of large read operations=0
                FILE: Number of write operations=0
                HDFS: Number of bytes read=840325
                HDFS: Number of bytes written=405818
                HDFS: Number of read operations=243
                HDFS: Number of large read operations=0
                HDFS: Number of write operations=3
        Job Counters
                Failed map tasks=4
                Launched map tasks=7
                Other local map tasks=3
                Data-local map tasks=4
                Total time spent by all maps in occupied slots (ms)=32359
                Total time spent by all reduces in occupied slots (ms)=0
                Total time spent by all map tasks (ms)=32359
                Total vcore-seconds taken by all map tasks=32359
                Total megabyte-seconds taken by all map tasks=463898624
        Map-Reduce Framework
                Map input records=3
                Map output records=0
                Input split bytes=10663
                Spilled Records=0
                Failed Shuffles=0
                Merged Map outputs=0
                GC time elapsed (ms)=153
                CPU time spent (ms)=7680
                Physical memory (bytes) snapshot=1065402368
                Virtual memory (bytes) snapshot=39759937536
                Total committed heap usage (bytes)=6714032128
        File Input Format Counters
                Bytes Read=0
        File Output Format Counters
                Bytes Written=0
2015-01-06 16:42:52,150 ERROR [sfdmgctmn003.gid.gap.com-32]: compactor.Worker 
(Worker.java:run(159)) - Caught exception while trying to compact 
ds_infra.event_metrics.date=2014-12-24.  Marking clean to avoid repeated 
failures, java.io.IOException: Job failed!
        at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:836)
        at 
org.apache.hadoop.hive.ql.txn.compactor.CompactorMR.run(CompactorMR.java:184)
        at org.apache.hadoop.hive.ql.txn.compactor.Worker.run(Worker.java:145)

2015-01-06 16:42:52,150 ERROR [sfdmgctmn003.gid.gap.com-32]: 
txn.CompactionTxnHandler (CompactionTxnHandler.java:markCleaned(327)) - 
Expected to remove at least one row from completed_txn_components when marking 
compaction entry as clean!



--------------------------------------------------------------------------------------------------------------------------------
following is mapreduce job log. Got the log from uri mentioned in the above 
log:  
(http://sfdmgctmn002.gid.gap.com:8088/proxy/application_1419291043936_1639/)


2015-01-06 16:42:25,991 INFO [main] 
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Created MRAppMaster for 
application appattempt_1419291043936_1639_000001
2015-01-06 16:42:26,304 WARN [main] org.apache.hadoop.util.NativeCodeLoader: 
Unable to load native-hadoop library for your platform... using builtin-java 
classes where applicable
2015-01-06 16:42:26,314 INFO [main] 
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Executing with tokens:
2015-01-06 16:42:26,314 INFO [main] 
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Kind: YARN_AM_RM_TOKEN, 
Service: , Ident: (appAttemptId { application_id { id: 1639 cluster_timestamp: 
1419291043936 } attemptId: 1 } keyId: -950898635)
2015-01-06 16:42:26,842 WARN [main] 
org.apache.hadoop.hdfs.shortcircuit.DomainSocketFactory: The short-circuit 
local reads feature cannot be used because libhadoop cannot be loaded.
2015-01-06 16:42:26,919 INFO [main] 
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: OutputCommitter set in config 
org.apache.hadoop.hive.ql.txn.compactor.CompactorMR$CompactorOutputCommitter
2015-01-06 16:42:26,921 INFO [main] 
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: OutputCommitter is 
org.apache.hadoop.hive.ql.txn.compactor.CompactorMR$CompactorOutputCommitter
2015-01-06 16:42:26,951 INFO [main] 
org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class 
org.apache.hadoop.mapreduce.jobhistory.EventType for class 
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler
2015-01-06 16:42:26,951 INFO [main] 
org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class 
org.apache.hadoop.mapreduce.v2.app.job.event.JobEventType for class 
org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobEventDispatcher
2015-01-06 16:42:26,952 INFO [main] 
org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class 
org.apache.hadoop.mapreduce.v2.app.job.event.TaskEventType for class 
org.apache.hadoop.mapreduce.v2.app.MRAppMaster$TaskEventDispatcher
2015-01-06 16:42:26,952 INFO [main] 
org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class 
org.apache.hadoop.mapreduce.v2.app.job.event.TaskAttemptEventType for class 
org.apache.hadoop.mapreduce.v2.app.MRAppMaster$TaskAttemptEventDispatcher
2015-01-06 16:42:26,952 INFO [main] 
org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class 
org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventType for class 
org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler
2015-01-06 16:42:26,956 INFO [main] 
org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class 
org.apache.hadoop.mapreduce.v2.app.speculate.Speculator$EventType for class 
org.apache.hadoop.mapreduce.v2.app.MRAppMaster$SpeculatorEventDispatcher
2015-01-06 16:42:26,956 INFO [main] 
org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class 
org.apache.hadoop.mapreduce.v2.app.rm.ContainerAllocator$EventType for class 
org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerAllocatorRouter
2015-01-06 16:42:26,957 INFO [main] 
org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class 
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncher$EventType for 
class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerLauncherRouter
2015-01-06 16:42:26,975 INFO [main] 
org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default file system 
is set solely by core-default.xml therefore -  ignoring
2015-01-06 16:42:26,987 INFO [main] 
org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default file system 
is set solely by core-default.xml therefore -  ignoring
2015-01-06 16:42:26,999 INFO [main] 
org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default file system 
is set solely by core-default.xml therefore -  ignoring
2015-01-06 16:42:27,023 INFO [main] 
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Emitting job 
history data to the timeline server is not enabled
2015-01-06 16:42:27,050 INFO [main] 
org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class 
org.apache.hadoop.mapreduce.v2.app.job.event.JobFinishEvent$Type for class 
org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobFinishEventHandler
2015-01-06 16:42:27,191 WARN [main] 
org.apache.hadoop.metrics2.impl.MetricsConfig: Cannot locate configuration: 
tried hadoop-metrics2-mrappmaster.properties,hadoop-metrics2.properties
2015-01-06 16:42:27,232 INFO [main] 
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period at 
10 second(s).
2015-01-06 16:42:27,232 INFO [main] 
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: MRAppMaster metrics system 
started
2015-01-06 16:42:27,239 INFO [main] 
org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Adding job token for 
job_1419291043936_1639 to jobTokenSecretManager
2015-01-06 16:42:27,327 INFO [main] 
org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Not uberizing 
job_1419291043936_1639 because: not enabled;
2015-01-06 16:42:27,340 INFO [main] 
org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Input size for job 
job_1419291043936_1639 = 845156. Number of splits = 4
2015-01-06 16:42:27,341 INFO [main] 
org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Number of reduces for job 
job_1419291043936_1639 = 0
2015-01-06 16:42:27,341 INFO [main] 
org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1419291043936_1639Job 
Transitioned from NEW to INITED
2015-01-06 16:42:27,341 INFO [main] 
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: MRAppMaster launching normal, 
non-uberized, multi-container job job_1419291043936_1639.
2015-01-06 16:42:27,359 INFO [main] org.apache.hadoop.ipc.CallQueueManager: 
Using callQueue class java.util.concurrent.LinkedBlockingQueue
2015-01-06 16:42:27,366 INFO [Socket Reader #1 for port 57524] 
org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 57524
2015-01-06 16:42:27,379 INFO [main] 
org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl: Adding 
protocol org.apache.hadoop.mapreduce.v2.api.MRClientProtocolPB to the server
2015-01-06 16:42:27,380 INFO [IPC Server Responder] 
org.apache.hadoop.ipc.Server: IPC Server Responder: starting
2015-01-06 16:42:27,381 INFO [IPC Server listener on 57524] 
org.apache.hadoop.ipc.Server: IPC Server listener on 57524: starting
2015-01-06 16:42:27,381 INFO [main] 
org.apache.hadoop.mapreduce.v2.app.client.MRClientService: Instantiated 
MRClientService at sfdmgctsn004.gid.gap.com/10.9.21.134:57524
2015-01-06 16:42:27,429 INFO [main] org.mortbay.log: Logging to 
org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
2015-01-06 16:42:27,431 INFO [main] org.apache.hadoop.http.HttpRequestLog: Http 
request log for http.requests.mapreduce is not defined
2015-01-06 16:42:27,439 INFO [main] org.apache.hadoop.http.HttpServer2: Added 
global filter 'safety' 
(class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
2015-01-06 16:42:27,472 INFO [main] org.apache.hadoop.http.HttpServer2: Added 
filter AM_PROXY_FILTER 
(class=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter) to context 
mapreduce
2015-01-06 16:42:27,472 INFO [main] org.apache.hadoop.http.HttpServer2: Added 
filter AM_PROXY_FILTER 
(class=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter) to context 
static
2015-01-06 16:42:27,475 INFO [main] org.apache.hadoop.http.HttpServer2: adding 
path spec: /mapreduce/*
2015-01-06 16:42:27,475 INFO [main] org.apache.hadoop.http.HttpServer2: adding 
path spec: /ws/*
2015-01-06 16:42:27,482 INFO [main] org.apache.hadoop.http.HttpServer2: Jetty 
bound to port 45674
2015-01-06 16:42:27,482 INFO [main] org.mortbay.log: jetty-6.1.26.hwx
2015-01-06 16:42:27,505 INFO [main] org.mortbay.log: Extract 
jar:file:/data/sfdmgct05/hadoop/yarn/local/filecache/12/mapreduce.tar.gz/hadoop/share/hadoop/yarn/hadoop-yarn-common-2.6.0.2.2.0.0-2041.jar!/webapps/mapreduce
 to /tmp/Jetty_0_0_0_0_45674_mapreduce____.ycambd/webapp
2015-01-06 16:42:27,805 INFO [main] org.mortbay.log: Started 
HttpServer2$SelectChannelConnectorWithSafeStartup@0.0.0.0:45674
2015-01-06 16:42:27,806 INFO [main] org.apache.hadoop.yarn.webapp.WebApps: Web 
app /mapreduce started at 45674
2015-01-06 16:42:28,026 INFO [main] org.apache.hadoop.yarn.webapp.WebApps: 
Registered webapp guice modules
2015-01-06 16:42:28,029 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.speculate.DefaultSpeculator: JOB_CREATE 
job_1419291043936_1639
2015-01-06 16:42:28,030 INFO [main] org.apache.hadoop.ipc.CallQueueManager: 
Using callQueue class java.util.concurrent.LinkedBlockingQueue
2015-01-06 16:42:28,030 INFO [Socket Reader #1 for port 33406] 
org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 33406
2015-01-06 16:42:28,034 INFO [IPC Server Responder] 
org.apache.hadoop.ipc.Server: IPC Server Responder: starting
2015-01-06 16:42:28,034 INFO [IPC Server listener on 33406] 
org.apache.hadoop.ipc.Server: IPC Server listener on 33406: starting
2015-01-06 16:42:28,074 INFO [main] 
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: 
nodeBlacklistingEnabled:true
2015-01-06 16:42:28,075 INFO [main] 
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: 
maxTaskFailuresPerNode is 3
2015-01-06 16:42:28,075 INFO [main] 
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: 
blacklistDisablePercent is 33
2015-01-06 16:42:28,158 INFO [main] 
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: 
maxContainerCapability: <memory:186368, vCores:32>
2015-01-06 16:42:28,158 INFO [main] 
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: queue: default
2015-01-06 16:42:28,160 INFO [main] 
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Upper limit 
on the thread pool size is 500
2015-01-06 16:42:28,161 INFO [main] 
org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: 
yarn.client.max-cached-nodemanagers-proxies : 0
2015-01-06 16:42:28,165 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1419291043936_1639Job 
Transitioned from INITED to SETUP
2015-01-06 16:42:28,167 INFO [CommitterEvent Processor #0] 
org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing the 
event EventType: JOB_SETUP
2015-01-06 16:42:28,168 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1419291043936_1639Job 
Transitioned from SETUP to RUNNING
2015-01-06 16:42:28,182 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.yarn.util.RackResolver: Resolved sfdmgctsn004.gid.gap.com to 
/default/rack_05
2015-01-06 16:42:28,186 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.yarn.util.RackResolver: Resolved sfdmgctsn003.gid.gap.com to 
/default/rack_05
2015-01-06 16:42:28,188 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.yarn.util.RackResolver: Resolved sfdmgctsn001.gid.gap.com to 
/default/rack_05
2015-01-06 16:42:28,191 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.yarn.util.RackResolver: Resolved sfdmgctsn005.gid.gap.com to 
/default/rack_06
2015-01-06 16:42:28,194 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.yarn.util.RackResolver: Resolved sfdmgctsn002.gid.gap.com to 
/default/rack_05
2015-01-06 16:42:28,198 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: 
task_1419291043936_1639_m_000000 Task Transitioned from NEW to SCHEDULED
2015-01-06 16:42:28,198 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.yarn.util.RackResolver: Resolved sfdmgctsn004.gid.gap.com to 
/default/rack_05
2015-01-06 16:42:28,198 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.yarn.util.RackResolver: Resolved sfdmgctsn003.gid.gap.com to 
/default/rack_05
2015-01-06 16:42:28,198 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.yarn.util.RackResolver: Resolved sfdmgctsn001.gid.gap.com to 
/default/rack_05
2015-01-06 16:42:28,198 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.yarn.util.RackResolver: Resolved sfdmgctsn005.gid.gap.com to 
/default/rack_06
2015-01-06 16:42:28,198 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.yarn.util.RackResolver: Resolved sfdmgctsn002.gid.gap.com to 
/default/rack_05
2015-01-06 16:42:28,198 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: 
task_1419291043936_1639_m_000001 Task Transitioned from NEW to SCHEDULED
2015-01-06 16:42:28,199 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.yarn.util.RackResolver: Resolved sfdmgctsn004.gid.gap.com to 
/default/rack_05
2015-01-06 16:42:28,199 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.yarn.util.RackResolver: Resolved sfdmgctsn003.gid.gap.com to 
/default/rack_05
2015-01-06 16:42:28,199 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.yarn.util.RackResolver: Resolved sfdmgctsn001.gid.gap.com to 
/default/rack_05
2015-01-06 16:42:28,199 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.yarn.util.RackResolver: Resolved sfdmgctsn005.gid.gap.com to 
/default/rack_06
2015-01-06 16:42:28,199 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.yarn.util.RackResolver: Resolved sfdmgctsn002.gid.gap.com to 
/default/rack_05
2015-01-06 16:42:28,199 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: 
task_1419291043936_1639_m_000002 Task Transitioned from NEW to SCHEDULED
2015-01-06 16:42:28,199 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.yarn.util.RackResolver: Resolved sfdmgctsn004.gid.gap.com to 
/default/rack_05
2015-01-06 16:42:28,199 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.yarn.util.RackResolver: Resolved sfdmgctsn001.gid.gap.com to 
/default/rack_05
2015-01-06 16:42:28,199 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.yarn.util.RackResolver: Resolved sfdmgctsn005.gid.gap.com to 
/default/rack_06
2015-01-06 16:42:28,199 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.yarn.util.RackResolver: Resolved sfdmgctsn002.gid.gap.com to 
/default/rack_05
2015-01-06 16:42:28,199 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: 
task_1419291043936_1639_m_000003 Task Transitioned from NEW to SCHEDULED
2015-01-06 16:42:28,200 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: 
attempt_1419291043936_1639_m_000000_0 TaskAttempt Transitioned from NEW to 
UNASSIGNED
2015-01-06 16:42:28,200 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: 
attempt_1419291043936_1639_m_000001_0 TaskAttempt Transitioned from NEW to 
UNASSIGNED
2015-01-06 16:42:28,200 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: 
attempt_1419291043936_1639_m_000002_0 TaskAttempt Transitioned from NEW to 
UNASSIGNED
2015-01-06 16:42:28,200 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: 
attempt_1419291043936_1639_m_000003_0 TaskAttempt Transitioned from NEW to 
UNASSIGNED
2015-01-06 16:42:28,201 INFO [Thread-50] 
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: 
mapResourceRequest:<memory:14336, vCores:1>
2015-01-06 16:42:28,226 INFO [eventHandlingThread] 
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Event Writer 
setup for JobId: job_1419291043936_1639, File: 
hdfs://sfdmgct:8020/user/hive/.staging/job_1419291043936_1639/job_1419291043936_1639_1.jhist
2015-01-06 16:42:29,160 INFO [RMCommunicator Allocator] 
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Before Scheduling: 
PendingReds:0 ScheduledMaps:4 ScheduledReds:0 AssignedMaps:0 AssignedReds:0 
CompletedMaps:0 CompletedReds:0 ContAlloc:0 ContRel:0 HostLocal:0 RackLocal:0
2015-01-06 16:42:29,181 INFO [RMCommunicator Allocator] 
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources() for 
application_1419291043936_1639: ask=8 release= 0 newContainers=0 
finishedContainers=0 resourcelimit=<memory:458752, vCores:79> knownNMs=5
2015-01-06 16:42:30,189 INFO [RMCommunicator Allocator] 
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Got allocated 
containers 4
2015-01-06 16:42:30,190 INFO [RMCommunicator Allocator] 
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned container 
container_1419291043936_1639_01_000002 to attempt_1419291043936_1639_m_000000_0
2015-01-06 16:42:30,191 INFO [RMCommunicator Allocator] 
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned container 
container_1419291043936_1639_01_000003 to attempt_1419291043936_1639_m_000001_0
2015-01-06 16:42:30,191 INFO [RMCommunicator Allocator] 
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned container 
container_1419291043936_1639_01_000004 to attempt_1419291043936_1639_m_000002_0
2015-01-06 16:42:30,191 INFO [RMCommunicator Allocator] 
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned container 
container_1419291043936_1639_01_000005 to attempt_1419291043936_1639_m_000003_0
2015-01-06 16:42:30,191 INFO [RMCommunicator Allocator] 
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After Scheduling: 
PendingReds:0 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:4 AssignedReds:0 
CompletedMaps:0 CompletedReds:0 ContAlloc:4 ContRel:0 HostLocal:4 RackLocal:0
2015-01-06 16:42:30,217 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.yarn.util.RackResolver: Resolved sfdmgctsn004.gid.gap.com to 
/default/rack_05
2015-01-06 16:42:30,227 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: The job-jar file 
on the remote FS is 
hdfs://sfdmgct/user/hive/.staging/job_1419291043936_1639/job.jar
2015-01-06 16:42:30,229 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: The job-conf file 
on the remote FS is /user/hive/.staging/job_1419291043936_1639/job.xml
2015-01-06 16:42:30,231 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Adding #0 tokens 
and #1 secret keys for NM use for launching container
2015-01-06 16:42:30,231 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Size of 
containertokens_dob is 1
2015-01-06 16:42:30,231 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Putting shuffle 
token in serviceData
2015-01-06 16:42:30,247 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: 
attempt_1419291043936_1639_m_000000_0 TaskAttempt Transitioned from UNASSIGNED 
to ASSIGNED
2015-01-06 16:42:30,248 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.yarn.util.RackResolver: Resolved sfdmgctsn004.gid.gap.com to 
/default/rack_05
2015-01-06 16:42:30,248 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: 
attempt_1419291043936_1639_m_000001_0 TaskAttempt Transitioned from UNASSIGNED 
to ASSIGNED
2015-01-06 16:42:30,249 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.yarn.util.RackResolver: Resolved sfdmgctsn004.gid.gap.com to 
/default/rack_05
2015-01-06 16:42:30,249 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: 
attempt_1419291043936_1639_m_000002_0 TaskAttempt Transitioned from UNASSIGNED 
to ASSIGNED
2015-01-06 16:42:30,249 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.yarn.util.RackResolver: Resolved sfdmgctsn004.gid.gap.com to 
/default/rack_05
2015-01-06 16:42:30,250 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: 
attempt_1419291043936_1639_m_000003_0 TaskAttempt Transitioned from UNASSIGNED 
to ASSIGNED
2015-01-06 16:42:30,251 INFO [ContainerLauncher #0] 
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing 
the event EventType: CONTAINER_REMOTE_LAUNCH for container 
container_1419291043936_1639_01_000002 taskAttempt 
attempt_1419291043936_1639_m_000000_0
2015-01-06 16:42:30,251 INFO [ContainerLauncher #1] 
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing 
the event EventType: CONTAINER_REMOTE_LAUNCH for container 
container_1419291043936_1639_01_000003 taskAttempt 
attempt_1419291043936_1639_m_000001_0
2015-01-06 16:42:30,251 INFO [ContainerLauncher #2] 
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing 
the event EventType: CONTAINER_REMOTE_LAUNCH for container 
container_1419291043936_1639_01_000004 taskAttempt 
attempt_1419291043936_1639_m_000002_0
2015-01-06 16:42:30,251 INFO [ContainerLauncher #3] 
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing 
the event EventType: CONTAINER_REMOTE_LAUNCH for container 
container_1419291043936_1639_01_000005 taskAttempt 
attempt_1419291043936_1639_m_000003_0
2015-01-06 16:42:30,252 INFO [ContainerLauncher #2] 
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching 
attempt_1419291043936_1639_m_000002_0
2015-01-06 16:42:30,252 INFO [ContainerLauncher #1] 
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching 
attempt_1419291043936_1639_m_000001_0
2015-01-06 16:42:30,252 INFO [ContainerLauncher #3] 
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching 
attempt_1419291043936_1639_m_000003_0
2015-01-06 16:42:30,252 INFO [ContainerLauncher #0] 
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching 
attempt_1419291043936_1639_m_000000_0
2015-01-06 16:42:30,253 INFO [ContainerLauncher #2] 
org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: 
Opening proxy : sfdmgctsn004.gid.gap.com:45454
2015-01-06 16:42:30,266 INFO [ContainerLauncher #0] 
org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: 
Opening proxy : sfdmgctsn004.gid.gap.com:45454
2015-01-06 16:42:30,267 INFO [ContainerLauncher #3] 
org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: 
Opening proxy : sfdmgctsn004.gid.gap.com:45454
2015-01-06 16:42:30,267 INFO [ContainerLauncher #1] 
org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: 
Opening proxy : sfdmgctsn004.gid.gap.com:45454
2015-01-06 16:42:30,294 INFO [ContainerLauncher #2] 
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle port 
returned by ContainerManager for attempt_1419291043936_1639_m_000002_0 : 13562
2015-01-06 16:42:30,294 INFO [ContainerLauncher #3] 
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle port 
returned by ContainerManager for attempt_1419291043936_1639_m_000003_0 : 13562
2015-01-06 16:42:30,294 INFO [ContainerLauncher #0] 
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle port 
returned by ContainerManager for attempt_1419291043936_1639_m_000000_0 : 13562
2015-01-06 16:42:30,294 INFO [ContainerLauncher #1] 
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle port 
returned by ContainerManager for attempt_1419291043936_1639_m_000001_0 : 13562
2015-01-06 16:42:30,295 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt: 
[attempt_1419291043936_1639_m_000000_0] using containerId: 
[container_1419291043936_1639_01_000002 on NM: [sfdmgctsn004.gid.gap.com:45454]
2015-01-06 16:42:30,297 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: 
attempt_1419291043936_1639_m_000000_0 TaskAttempt Transitioned from ASSIGNED to 
RUNNING
2015-01-06 16:42:30,297 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt: 
[attempt_1419291043936_1639_m_000003_0] using containerId: 
[container_1419291043936_1639_01_000005 on NM: [sfdmgctsn004.gid.gap.com:45454]
2015-01-06 16:42:30,297 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: 
attempt_1419291043936_1639_m_000003_0 TaskAttempt Transitioned from ASSIGNED to 
RUNNING
2015-01-06 16:42:30,297 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt: 
[attempt_1419291043936_1639_m_000002_0] using containerId: 
[container_1419291043936_1639_01_000004 on NM: [sfdmgctsn004.gid.gap.com:45454]
2015-01-06 16:42:30,298 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: 
attempt_1419291043936_1639_m_000002_0 TaskAttempt Transitioned from ASSIGNED to 
RUNNING
2015-01-06 16:42:30,298 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt: 
[attempt_1419291043936_1639_m_000001_0] using containerId: 
[container_1419291043936_1639_01_000003 on NM: [sfdmgctsn004.gid.gap.com:45454]
2015-01-06 16:42:30,298 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: 
attempt_1419291043936_1639_m_000001_0 TaskAttempt Transitioned from ASSIGNED to 
RUNNING
2015-01-06 16:42:30,298 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: 
task_1419291043936_1639_m_000000 Task Transitioned from SCHEDULED to RUNNING
2015-01-06 16:42:30,298 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: 
task_1419291043936_1639_m_000003 Task Transitioned from SCHEDULED to RUNNING
2015-01-06 16:42:30,299 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: 
task_1419291043936_1639_m_000002 Task Transitioned from SCHEDULED to RUNNING
2015-01-06 16:42:30,299 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: 
task_1419291043936_1639_m_000001 Task Transitioned from SCHEDULED to RUNNING
2015-01-06 16:42:31,194 INFO [RMCommunicator Allocator] 
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources() for 
application_1419291043936_1639: ask=8 release= 0 newContainers=0 
finishedContainers=0 resourcelimit=<memory:401408, vCores:75> knownNMs=5
2015-01-06 16:42:33,555 INFO [Socket Reader #1 for port 33406] 
SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for 
job_1419291043936_1639 (auth:SIMPLE)
2015-01-06 16:42:33,572 INFO [IPC Server handler 0 on 33406] 
org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID : 
jvm_1419291043936_1639_m_000002 asked for a task
2015-01-06 16:42:33,572 INFO [IPC Server handler 0 on 33406] 
org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID: 
jvm_1419291043936_1639_m_000002 given task: 
attempt_1419291043936_1639_m_000000_0
2015-01-06 16:42:33,587 INFO [Socket Reader #1 for port 33406] 
SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for 
job_1419291043936_1639 (auth:SIMPLE)
2015-01-06 16:42:33,596 INFO [Socket Reader #1 for port 33406] 
SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for 
job_1419291043936_1639 (auth:SIMPLE)
2015-01-06 16:42:33,601 INFO [Socket Reader #1 for port 33406] 
SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for 
job_1419291043936_1639 (auth:SIMPLE)
2015-01-06 16:42:33,602 INFO [IPC Server handler 1 on 33406] 
org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID : 
jvm_1419291043936_1639_m_000005 asked for a task
2015-01-06 16:42:33,602 INFO [IPC Server handler 1 on 33406] 
org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID: 
jvm_1419291043936_1639_m_000005 given task: 
attempt_1419291043936_1639_m_000003_0
2015-01-06 16:42:33,607 INFO [IPC Server handler 2 on 33406] 
org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID : 
jvm_1419291043936_1639_m_000003 asked for a task
2015-01-06 16:42:33,607 INFO [IPC Server handler 2 on 33406] 
org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID: 
jvm_1419291043936_1639_m_000003 given task: 
attempt_1419291043936_1639_m_000001_0
2015-01-06 16:42:33,612 INFO [IPC Server handler 3 on 33406] 
org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID : 
jvm_1419291043936_1639_m_000004 asked for a task
2015-01-06 16:42:33,612 INFO [IPC Server handler 3 on 33406] 
org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID: 
jvm_1419291043936_1639_m_000004 given task: 
attempt_1419291043936_1639_m_000002_0
2015-01-06 16:42:35,010 INFO [IPC Server handler 4 on 33406] 
org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt 
attempt_1419291043936_1639_m_000002_0 is : 0.0
2015-01-06 16:42:35,014 FATAL [IPC Server handler 5 on 33406] 
org.apache.hadoop.mapred.TaskAttemptListenerImpl: Task: 
attempt_1419291043936_1639_m_000002_0 - exited : 
java.lang.IndexOutOfBoundsException
        at java.nio.Buffer.checkIndex(Buffer.java:532)
        at java.nio.HeapByteBuffer.get(HeapByteBuffer.java:139)
        at 
org.apache.hadoop.hive.ql.io.orc.ReaderImpl.extractMetaInfoFromFooter(ReaderImpl.java:369)
        at 
org.apache.hadoop.hive.ql.io.orc.ReaderImpl.<init>(ReaderImpl.java:311)
        at 
org.apache.hadoop.hive.ql.io.orc.OrcFile.createReader(OrcFile.java:228)
        at 
org.apache.hadoop.hive.ql.io.orc.OrcRawRecordMerger.<init>(OrcRawRecordMerger.java:464)
        at 
org.apache.hadoop.hive.ql.io.orc.OrcInputFormat.getRawReader(OrcInputFormat.java:1232)
        at 
org.apache.hadoop.hive.ql.txn.compactor.CompactorMR$CompactorMap.map(CompactorMR.java:510)
        at 
org.apache.hadoop.hive.ql.txn.compactor.CompactorMR$CompactorMap.map(CompactorMR.java:489)
        at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
        at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:450)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
        at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:163)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:415)
        at 
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
        at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)

2015-01-06 16:42:35,014 INFO [IPC Server handler 5 on 33406] 
org.apache.hadoop.mapred.TaskAttemptListenerImpl: Diagnostics report from 
attempt_1419291043936_1639_m_000002_0: Error: 
java.lang.IndexOutOfBoundsException
        at java.nio.Buffer.checkIndex(Buffer.java:532)
        at java.nio.HeapByteBuffer.get(HeapByteBuffer.java:139)
        at 
org.apache.hadoop.hive.ql.io.orc.ReaderImpl.extractMetaInfoFromFooter(ReaderImpl.java:369)
        at 
org.apache.hadoop.hive.ql.io.orc.ReaderImpl.<init>(ReaderImpl.java:311)
        at 
org.apache.hadoop.hive.ql.io.orc.OrcFile.createReader(OrcFile.java:228)
        at 
org.apache.hadoop.hive.ql.io.orc.OrcRawRecordMerger.<init>(OrcRawRecordMerger.java:464)
        at 
org.apache.hadoop.hive.ql.io.orc.OrcInputFormat.getRawReader(OrcInputFormat.java:1232)
        at 
org.apache.hadoop.hive.ql.txn.compactor.CompactorMR$CompactorMap.map(CompactorMR.java:510)
        at 
org.apache.hadoop.hive.ql.txn.compactor.CompactorMR$CompactorMap.map(CompactorMR.java:489)
        at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
        at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:450)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
        at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:163)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:415)
        at 
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
        at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)

2015-01-06 16:42:35,016 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics report 
from attempt_1419291043936_1639_m_000002_0: Error: 
java.lang.IndexOutOfBoundsException
        at java.nio.Buffer.checkIndex(Buffer.java:532)
        at java.nio.HeapByteBuffer.get(HeapByteBuffer.java:139)
        at 
org.apache.hadoop.hive.ql.io.orc.ReaderImpl.extractMetaInfoFromFooter(ReaderImpl.java:369)
        at 
org.apache.hadoop.hive.ql.io.orc.ReaderImpl.<init>(ReaderImpl.java:311)
        at 
org.apache.hadoop.hive.ql.io.orc.OrcFile.createReader(OrcFile.java:228)
        at 
org.apache.hadoop.hive.ql.io.orc.OrcRawRecordMerger.<init>(OrcRawRecordMerger.java:464)
        at 
org.apache.hadoop.hive.ql.io.orc.OrcInputFormat.getRawReader(OrcInputFormat.java:1232)
        at 
org.apache.hadoop.hive.ql.txn.compactor.CompactorMR$CompactorMap.map(CompactorMR.java:510)
        at 
org.apache.hadoop.hive.ql.txn.compactor.CompactorMR$CompactorMap.map(CompactorMR.java:489)
        at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
        at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:450)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
        at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:163)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:415)
        at 
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
        at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)

2015-01-06 16:42:35,016 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: 
attempt_1419291043936_1639_m_000002_0 TaskAttempt Transitioned from RUNNING to 
FAIL_CONTAINER_CLEANUP
2015-01-06 16:42:35,017 INFO [ContainerLauncher #4] 
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing 
the event EventType: CONTAINER_REMOTE_CLEANUP for container 
container_1419291043936_1639_01_000004 taskAttempt 
attempt_1419291043936_1639_m_000002_0
2015-01-06 16:42:35,017 INFO [ContainerLauncher #4] 
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: KILLING 
attempt_1419291043936_1639_m_000002_0
2015-01-06 16:42:35,017 INFO [ContainerLauncher #4] 
org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: 
Opening proxy : sfdmgctsn004.gid.gap.com:45454
2015-01-06 16:42:35,029 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: 
attempt_1419291043936_1639_m_000002_0 TaskAttempt Transitioned from 
FAIL_CONTAINER_CLEANUP to FAIL_TASK_CLEANUP
2015-01-06 16:42:35,030 INFO [CommitterEvent Processor #1] 
org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing the 
event EventType: TASK_ABORT
2015-01-06 16:42:35,031 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: 
attempt_1419291043936_1639_m_000002_0 TaskAttempt Transitioned from 
FAIL_TASK_CLEANUP to FAILED
2015-01-06 16:42:35,035 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.yarn.util.RackResolver: Resolved sfdmgctsn004.gid.gap.com to 
/default/rack_05
2015-01-06 16:42:35,035 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.yarn.util.RackResolver: Resolved sfdmgctsn003.gid.gap.com to 
/default/rack_05
2015-01-06 16:42:35,035 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.yarn.util.RackResolver: Resolved sfdmgctsn001.gid.gap.com to 
/default/rack_05
2015-01-06 16:42:35,035 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.yarn.util.RackResolver: Resolved sfdmgctsn005.gid.gap.com to 
/default/rack_06
2015-01-06 16:42:35,035 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.yarn.util.RackResolver: Resolved sfdmgctsn002.gid.gap.com to 
/default/rack_05
2015-01-06 16:42:35,035 INFO [Thread-50] 
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: 1 failures on node 
sfdmgctsn004.gid.gap.com
2015-01-06 16:42:35,036 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: 
attempt_1419291043936_1639_m_000002_1 TaskAttempt Transitioned from NEW to 
UNASSIGNED
2015-01-06 16:42:35,037 INFO [Thread-50] 
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Added 
attempt_1419291043936_1639_m_000002_1 to list of failed maps
2015-01-06 16:42:35,198 INFO [RMCommunicator Allocator] 
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Before Scheduling: 
PendingReds:0 ScheduledMaps:1 ScheduledReds:0 AssignedMaps:4 AssignedReds:0 
CompletedMaps:0 CompletedReds:0 ContAlloc:4 ContRel:0 HostLocal:4 RackLocal:0
2015-01-06 16:42:35,199 INFO [RMCommunicator Allocator] 
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources() for 
application_1419291043936_1639: ask=1 release= 0 newContainers=0 
finishedContainers=0 resourcelimit=<memory:401408, vCores:75> knownNMs=5
2015-01-06 16:42:35,697 INFO [IPC Server handler 4 on 33406] 
org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt 
attempt_1419291043936_1639_m_000001_0 is : 0.0
2015-01-06 16:42:35,734 INFO [IPC Server handler 5 on 33406] 
org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt 
attempt_1419291043936_1639_m_000003_0 is : 0.0
2015-01-06 16:42:35,833 INFO [IPC Server handler 6 on 33406] 
org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt 
attempt_1419291043936_1639_m_000000_0 is : 0.0
2015-01-06 16:42:35,896 INFO [IPC Server handler 7 on 33406] 
org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt 
attempt_1419291043936_1639_m_000001_0 is : 1.0
2015-01-06 16:42:35,901 INFO [IPC Server handler 8 on 33406] 
org.apache.hadoop.mapred.TaskAttemptListenerImpl: Done acknowledgement from 
attempt_1419291043936_1639_m_000001_0
2015-01-06 16:42:35,902 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: 
attempt_1419291043936_1639_m_000001_0 TaskAttempt Transitioned from RUNNING to 
SUCCESS_CONTAINER_CLEANUP
2015-01-06 16:42:35,903 INFO [ContainerLauncher #5] 
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing 
the event EventType: CONTAINER_REMOTE_CLEANUP for container 
container_1419291043936_1639_01_000003 taskAttempt 
attempt_1419291043936_1639_m_000001_0
2015-01-06 16:42:35,903 INFO [ContainerLauncher #5] 
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: KILLING 
attempt_1419291043936_1639_m_000001_0
2015-01-06 16:42:35,903 INFO [ContainerLauncher #5] 
org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: 
Opening proxy : sfdmgctsn004.gid.gap.com:45454
2015-01-06 16:42:35,911 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: 
attempt_1419291043936_1639_m_000001_0 TaskAttempt Transitioned from 
SUCCESS_CONTAINER_CLEANUP to SUCCEEDED
2015-01-06 16:42:35,912 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: Task succeeded with 
attempt attempt_1419291043936_1639_m_000001_0
2015-01-06 16:42:35,913 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: 
task_1419291043936_1639_m_000001 Task Transitioned from RUNNING to SUCCEEDED
2015-01-06 16:42:35,913 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Num completed Tasks: 1
2015-01-06 16:42:35,925 INFO [IPC Server handler 9 on 33406] 
org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt 
attempt_1419291043936_1639_m_000003_0 is : 1.0
2015-01-06 16:42:35,927 INFO [IPC Server handler 10 on 33406] 
org.apache.hadoop.mapred.TaskAttemptListenerImpl: Done acknowledgement from 
attempt_1419291043936_1639_m_000003_0
2015-01-06 16:42:35,928 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: 
attempt_1419291043936_1639_m_000003_0 TaskAttempt Transitioned from RUNNING to 
SUCCESS_CONTAINER_CLEANUP
2015-01-06 16:42:35,929 INFO [ContainerLauncher #6] 
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing 
the event EventType: CONTAINER_REMOTE_CLEANUP for container 
container_1419291043936_1639_01_000005 taskAttempt 
attempt_1419291043936_1639_m_000003_0
2015-01-06 16:42:35,929 INFO [ContainerLauncher #6] 
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: KILLING 
attempt_1419291043936_1639_m_000003_0
2015-01-06 16:42:35,929 INFO [ContainerLauncher #6] 
org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: 
Opening proxy : sfdmgctsn004.gid.gap.com:45454
2015-01-06 16:42:35,936 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: 
attempt_1419291043936_1639_m_000003_0 TaskAttempt Transitioned from 
SUCCESS_CONTAINER_CLEANUP to SUCCEEDED
2015-01-06 16:42:35,936 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: Task succeeded with 
attempt attempt_1419291043936_1639_m_000003_0
2015-01-06 16:42:35,936 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: 
task_1419291043936_1639_m_000003 Task Transitioned from RUNNING to SUCCEEDED
2015-01-06 16:42:35,937 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Num completed Tasks: 2
2015-01-06 16:42:36,035 INFO [IPC Server handler 11 on 33406] 
org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt 
attempt_1419291043936_1639_m_000000_0 is : 1.0
2015-01-06 16:42:36,037 INFO [IPC Server handler 12 on 33406] 
org.apache.hadoop.mapred.TaskAttemptListenerImpl: Done acknowledgement from 
attempt_1419291043936_1639_m_000000_0
2015-01-06 16:42:36,038 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: 
attempt_1419291043936_1639_m_000000_0 TaskAttempt Transitioned from RUNNING to 
SUCCESS_CONTAINER_CLEANUP
2015-01-06 16:42:36,039 INFO [ContainerLauncher #7] 
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing 
the event EventType: CONTAINER_REMOTE_CLEANUP for container 
container_1419291043936_1639_01_000002 taskAttempt 
attempt_1419291043936_1639_m_000000_0
2015-01-06 16:42:36,039 INFO [ContainerLauncher #7] 
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: KILLING 
attempt_1419291043936_1639_m_000000_0
2015-01-06 16:42:36,039 INFO [ContainerLauncher #7] 
org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: 
Opening proxy : sfdmgctsn004.gid.gap.com:45454
2015-01-06 16:42:36,045 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: 
attempt_1419291043936_1639_m_000000_0 TaskAttempt Transitioned from 
SUCCESS_CONTAINER_CLEANUP to SUCCEEDED
2015-01-06 16:42:36,045 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: Task succeeded with 
attempt attempt_1419291043936_1639_m_000000_0
2015-01-06 16:42:36,045 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: 
task_1419291043936_1639_m_000000 Task Transitioned from RUNNING to SUCCEEDED
2015-01-06 16:42:36,046 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Num completed Tasks: 3
2015-01-06 16:42:36,200 INFO [RMCommunicator Allocator] 
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Before Scheduling: 
PendingReds:0 ScheduledMaps:1 ScheduledReds:0 AssignedMaps:4 AssignedReds:0 
CompletedMaps:3 CompletedReds:0 ContAlloc:4 ContRel:0 HostLocal:4 RackLocal:0
2015-01-06 16:42:36,207 INFO [RMCommunicator Allocator] 
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Received completed 
container container_1419291043936_1639_01_000004
2015-01-06 16:42:36,207 INFO [RMCommunicator Allocator] 
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Got allocated 
containers 1
2015-01-06 16:42:36,208 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics report 
from attempt_1419291043936_1639_m_000002_0: Container killed by the 
ApplicationMaster.
Container killed on request. Exit code is 143
Container exited with a non-zero exit code 143

2015-01-06 16:42:36,208 INFO [RMCommunicator Allocator] 
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigning container 
Container: [ContainerId: container_1419291043936_1639_01_000006, NodeId: 
sfdmgctsn003.gid.gap.com:45454, NodeHttpAddress: sfdmgctsn003.gid.gap.com:8042, 
Resource: <memory:14336, vCores:1>, Priority: 5, Token: Token { kind: 
ContainerToken, service: 10.9.21.133:45454 }, ] to fast fail map
2015-01-06 16:42:36,208 INFO [RMCommunicator Allocator] 
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned from 
earlierFailedMaps
2015-01-06 16:42:36,208 INFO [RMCommunicator Allocator] 
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned container 
container_1419291043936_1639_01_000006 to attempt_1419291043936_1639_m_000002_1
2015-01-06 16:42:36,208 INFO [RMCommunicator Allocator] 
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After Scheduling: 
PendingReds:0 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:4 AssignedReds:0 
CompletedMaps:3 CompletedReds:0 ContAlloc:5 ContRel:0 HostLocal:4 RackLocal:0
2015-01-06 16:42:36,209 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.yarn.util.RackResolver: Resolved sfdmgctsn003.gid.gap.com to 
/default/rack_05
2015-01-06 16:42:36,209 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: 
attempt_1419291043936_1639_m_000002_1 TaskAttempt Transitioned from UNASSIGNED 
to ASSIGNED
2015-01-06 16:42:36,210 INFO [ContainerLauncher #8] 
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing 
the event EventType: CONTAINER_REMOTE_LAUNCH for container 
container_1419291043936_1639_01_000006 taskAttempt 
attempt_1419291043936_1639_m_000002_1
2015-01-06 16:42:36,210 INFO [ContainerLauncher #8] 
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching 
attempt_1419291043936_1639_m_000002_1
2015-01-06 16:42:36,210 INFO [ContainerLauncher #8] 
org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: 
Opening proxy : sfdmgctsn003.gid.gap.com:45454
2015-01-06 16:42:36,218 INFO [ContainerLauncher #8] 
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle port 
returned by ContainerManager for attempt_1419291043936_1639_m_000002_1 : 13562
2015-01-06 16:42:36,219 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt: 
[attempt_1419291043936_1639_m_000002_1] using containerId: 
[container_1419291043936_1639_01_000006 on NM: [sfdmgctsn003.gid.gap.com:45454]
2015-01-06 16:42:36,219 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: 
attempt_1419291043936_1639_m_000002_1 TaskAttempt Transitioned from ASSIGNED to 
RUNNING
2015-01-06 16:42:37,210 INFO [RMCommunicator Allocator] 
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources() for 
application_1419291043936_1639: ask=1 release= 0 newContainers=0 
finishedContainers=3 resourcelimit=<memory:444416, vCores:78> knownNMs=5
2015-01-06 16:42:37,210 INFO [RMCommunicator Allocator] 
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Received completed 
container container_1419291043936_1639_01_000002
2015-01-06 16:42:37,210 INFO [RMCommunicator Allocator] 
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Received completed 
container container_1419291043936_1639_01_000003
2015-01-06 16:42:37,210 INFO [RMCommunicator Allocator] 
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Received completed 
container container_1419291043936_1639_01_000005
2015-01-06 16:42:37,210 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics report 
from attempt_1419291043936_1639_m_000000_0: Container killed by the 
ApplicationMaster.
Container killed on request. Exit code is 143
Container exited with a non-zero exit code 143

2015-01-06 16:42:37,210 INFO [RMCommunicator Allocator] 
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After Scheduling: 
PendingReds:0 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:1 AssignedReds:0 
CompletedMaps:3 CompletedReds:0 ContAlloc:5 ContRel:0 HostLocal:4 RackLocal:0
2015-01-06 16:42:37,210 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics report 
from attempt_1419291043936_1639_m_000001_0: Container killed by the 
ApplicationMaster.
Container killed on request. Exit code is 143
Container exited with a non-zero exit code 143

2015-01-06 16:42:37,211 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics report 
from attempt_1419291043936_1639_m_000003_0: Container killed by the 
ApplicationMaster.
Container killed on request. Exit code is 143
Container exited with a non-zero exit code 143

2015-01-06 16:42:39,096 INFO [Socket Reader #1 for port 33406] 
SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for 
job_1419291043936_1639 (auth:SIMPLE)
2015-01-06 16:42:39,106 INFO [IPC Server handler 0 on 33406] 
org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID : 
jvm_1419291043936_1639_m_000006 asked for a task
2015-01-06 16:42:39,106 INFO [IPC Server handler 0 on 33406] 
org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID: 
jvm_1419291043936_1639_m_000006 given task: 
attempt_1419291043936_1639_m_000002_1
2015-01-06 16:42:40,344 INFO [IPC Server handler 1 on 33406] 
org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt 
attempt_1419291043936_1639_m_000002_1 is : 0.0
2015-01-06 16:42:40,345 FATAL [IPC Server handler 2 on 33406] 
org.apache.hadoop.mapred.TaskAttemptListenerImpl: Task: 
attempt_1419291043936_1639_m_000002_1 - exited : 
java.lang.IndexOutOfBoundsException
        at java.nio.Buffer.checkIndex(Buffer.java:532)
        at java.nio.HeapByteBuffer.get(HeapByteBuffer.java:139)
        at 
org.apache.hadoop.hive.ql.io.orc.ReaderImpl.extractMetaInfoFromFooter(ReaderImpl.java:369)
        at 
org.apache.hadoop.hive.ql.io.orc.ReaderImpl.<init>(ReaderImpl.java:311)
        at 
org.apache.hadoop.hive.ql.io.orc.OrcFile.createReader(OrcFile.java:228)
        at 
org.apache.hadoop.hive.ql.io.orc.OrcRawRecordMerger.<init>(OrcRawRecordMerger.java:464)
        at 
org.apache.hadoop.hive.ql.io.orc.OrcInputFormat.getRawReader(OrcInputFormat.java:1232)
        at 
org.apache.hadoop.hive.ql.txn.compactor.CompactorMR$CompactorMap.map(CompactorMR.java:510)
        at 
org.apache.hadoop.hive.ql.txn.compactor.CompactorMR$CompactorMap.map(CompactorMR.java:489)
        at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
        at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:450)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
        at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:163)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:415)
        at 
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
        at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)

2015-01-06 16:42:40,345 INFO [IPC Server handler 2 on 33406] 
org.apache.hadoop.mapred.TaskAttemptListenerImpl: Diagnostics report from 
attempt_1419291043936_1639_m_000002_1: Error: 
java.lang.IndexOutOfBoundsException
        at java.nio.Buffer.checkIndex(Buffer.java:532)
        at java.nio.HeapByteBuffer.get(HeapByteBuffer.java:139)
        at 
org.apache.hadoop.hive.ql.io.orc.ReaderImpl.extractMetaInfoFromFooter(ReaderImpl.java:369)
        at 
org.apache.hadoop.hive.ql.io.orc.ReaderImpl.<init>(ReaderImpl.java:311)
        at 
org.apache.hadoop.hive.ql.io.orc.OrcFile.createReader(OrcFile.java:228)
        at 
org.apache.hadoop.hive.ql.io.orc.OrcRawRecordMerger.<init>(OrcRawRecordMerger.java:464)
        at 
org.apache.hadoop.hive.ql.io.orc.OrcInputFormat.getRawReader(OrcInputFormat.java:1232)
        at 
org.apache.hadoop.hive.ql.txn.compactor.CompactorMR$CompactorMap.map(CompactorMR.java:510)
        at 
org.apache.hadoop.hive.ql.txn.compactor.CompactorMR$CompactorMap.map(CompactorMR.java:489)
        at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
        at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:450)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
        at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:163)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:415)
        at 
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
        at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)

2015-01-06 16:42:40,346 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics report 
from attempt_1419291043936_1639_m_000002_1: Error: 
java.lang.IndexOutOfBoundsException
        at java.nio.Buffer.checkIndex(Buffer.java:532)
        at java.nio.HeapByteBuffer.get(HeapByteBuffer.java:139)
        at 
org.apache.hadoop.hive.ql.io.orc.ReaderImpl.extractMetaInfoFromFooter(ReaderImpl.java:369)
        at 
org.apache.hadoop.hive.ql.io.orc.ReaderImpl.<init>(ReaderImpl.java:311)
        at 
org.apache.hadoop.hive.ql.io.orc.OrcFile.createReader(OrcFile.java:228)
        at 
org.apache.hadoop.hive.ql.io.orc.OrcRawRecordMerger.<init>(OrcRawRecordMerger.java:464)
        at 
org.apache.hadoop.hive.ql.io.orc.OrcInputFormat.getRawReader(OrcInputFormat.java:1232)
        at 
org.apache.hadoop.hive.ql.txn.compactor.CompactorMR$CompactorMap.map(CompactorMR.java:510)
        at 
org.apache.hadoop.hive.ql.txn.compactor.CompactorMR$CompactorMap.map(CompactorMR.java:489)
        at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
        at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:450)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
        at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:163)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:415)
        at 
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
        at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)

2015-01-06 16:42:40,346 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: 
attempt_1419291043936_1639_m_000002_1 TaskAttempt Transitioned from RUNNING to 
FAIL_CONTAINER_CLEANUP
2015-01-06 16:42:40,347 INFO [ContainerLauncher #9] 
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing 
the event EventType: CONTAINER_REMOTE_CLEANUP for container 
container_1419291043936_1639_01_000006 taskAttempt 
attempt_1419291043936_1639_m_000002_1
2015-01-06 16:42:40,347 INFO [ContainerLauncher #9] 
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: KILLING 
attempt_1419291043936_1639_m_000002_1
2015-01-06 16:42:40,347 INFO [ContainerLauncher #9] 
org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: 
Opening proxy : sfdmgctsn003.gid.gap.com:45454
2015-01-06 16:42:40,353 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: 
attempt_1419291043936_1639_m_000002_1 TaskAttempt Transitioned from 
FAIL_CONTAINER_CLEANUP to FAIL_TASK_CLEANUP
2015-01-06 16:42:40,354 INFO [CommitterEvent Processor #2] 
org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing the 
event EventType: TASK_ABORT
2015-01-06 16:42:40,354 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: 
attempt_1419291043936_1639_m_000002_1 TaskAttempt Transitioned from 
FAIL_TASK_CLEANUP to FAILED
2015-01-06 16:42:40,354 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.yarn.util.RackResolver: Resolved sfdmgctsn004.gid.gap.com to 
/default/rack_05
2015-01-06 16:42:40,354 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.yarn.util.RackResolver: Resolved sfdmgctsn003.gid.gap.com to 
/default/rack_05
2015-01-06 16:42:40,354 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.yarn.util.RackResolver: Resolved sfdmgctsn001.gid.gap.com to 
/default/rack_05
2015-01-06 16:42:40,355 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.yarn.util.RackResolver: Resolved sfdmgctsn005.gid.gap.com to 
/default/rack_06
2015-01-06 16:42:40,355 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.yarn.util.RackResolver: Resolved sfdmgctsn002.gid.gap.com to 
/default/rack_05
2015-01-06 16:42:40,355 INFO [Thread-50] 
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: 1 failures on node 
sfdmgctsn003.gid.gap.com
2015-01-06 16:42:40,355 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: 
attempt_1419291043936_1639_m_000002_2 TaskAttempt Transitioned from NEW to 
UNASSIGNED
2015-01-06 16:42:40,355 INFO [Thread-50] 
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Added 
attempt_1419291043936_1639_m_000002_2 to list of failed maps
2015-01-06 16:42:41,215 INFO [RMCommunicator Allocator] 
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Before Scheduling: 
PendingReds:0 ScheduledMaps:1 ScheduledReds:0 AssignedMaps:1 AssignedReds:0 
CompletedMaps:3 CompletedReds:0 ContAlloc:5 ContRel:0 HostLocal:4 RackLocal:0
2015-01-06 16:42:41,216 INFO [RMCommunicator Allocator] 
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources() for 
application_1419291043936_1639: ask=1 release= 0 newContainers=0 
finishedContainers=0 resourcelimit=<memory:444416, vCores:78> knownNMs=5
2015-01-06 16:42:42,218 INFO [RMCommunicator Allocator] 
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Received completed 
container container_1419291043936_1639_01_000006
2015-01-06 16:42:42,218 INFO [RMCommunicator Allocator] 
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Got allocated 
containers 1
2015-01-06 16:42:42,218 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics report 
from attempt_1419291043936_1639_m_000002_1: Container killed by the 
ApplicationMaster.
Container killed on request. Exit code is 143
Container exited with a non-zero exit code 143

2015-01-06 16:42:42,218 INFO [RMCommunicator Allocator] 
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigning container 
Container: [ContainerId: container_1419291043936_1639_01_000007, NodeId: 
sfdmgctsn003.gid.gap.com:45454, NodeHttpAddress: sfdmgctsn003.gid.gap.com:8042, 
Resource: <memory:14336, vCores:1>, Priority: 5, Token: Token { kind: 
ContainerToken, service: 10.9.21.133:45454 }, ] to fast fail map
2015-01-06 16:42:42,218 INFO [RMCommunicator Allocator] 
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned from 
earlierFailedMaps
2015-01-06 16:42:42,218 INFO [RMCommunicator Allocator] 
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned container 
container_1419291043936_1639_01_000007 to attempt_1419291043936_1639_m_000002_2
2015-01-06 16:42:42,218 INFO [RMCommunicator Allocator] 
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After Scheduling: 
PendingReds:0 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:1 AssignedReds:0 
CompletedMaps:3 CompletedReds:0 ContAlloc:6 ContRel:0 HostLocal:4 RackLocal:0
2015-01-06 16:42:42,218 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.yarn.util.RackResolver: Resolved sfdmgctsn003.gid.gap.com to 
/default/rack_05
2015-01-06 16:42:42,219 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: 
attempt_1419291043936_1639_m_000002_2 TaskAttempt Transitioned from UNASSIGNED 
to ASSIGNED
2015-01-06 16:42:42,219 INFO [ContainerLauncher #3] 
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing 
the event EventType: CONTAINER_REMOTE_LAUNCH for container 
container_1419291043936_1639_01_000007 taskAttempt 
attempt_1419291043936_1639_m_000002_2
2015-01-06 16:42:42,219 INFO [ContainerLauncher #3] 
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching 
attempt_1419291043936_1639_m_000002_2
2015-01-06 16:42:42,219 INFO [ContainerLauncher #3] 
org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: 
Opening proxy : sfdmgctsn003.gid.gap.com:45454
2015-01-06 16:42:42,226 INFO [ContainerLauncher #3] 
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle port 
returned by ContainerManager for attempt_1419291043936_1639_m_000002_2 : 13562
2015-01-06 16:42:42,226 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt: 
[attempt_1419291043936_1639_m_000002_2] using containerId: 
[container_1419291043936_1639_01_000007 on NM: [sfdmgctsn003.gid.gap.com:45454]
2015-01-06 16:42:42,227 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: 
attempt_1419291043936_1639_m_000002_2 TaskAttempt Transitioned from ASSIGNED to 
RUNNING
2015-01-06 16:42:43,220 INFO [RMCommunicator Allocator] 
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources() for 
application_1419291043936_1639: ask=1 release= 0 newContainers=0 
finishedContainers=0 resourcelimit=<memory:444416, vCores:78> knownNMs=5
2015-01-06 16:42:43,270 INFO [Socket Reader #1 for port 33406] 
SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for 
job_1419291043936_1639 (auth:SIMPLE)
2015-01-06 16:42:43,279 INFO [IPC Server handler 1 on 33406] 
org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID : 
jvm_1419291043936_1639_m_000007 asked for a task
2015-01-06 16:42:43,279 INFO [IPC Server handler 1 on 33406] 
org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID: 
jvm_1419291043936_1639_m_000007 given task: 
attempt_1419291043936_1639_m_000002_2
2015-01-06 16:42:44,498 INFO [IPC Server handler 3 on 33406] 
org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt 
attempt_1419291043936_1639_m_000002_2 is : 0.0
2015-01-06 16:42:44,500 FATAL [IPC Server handler 4 on 33406] 
org.apache.hadoop.mapred.TaskAttemptListenerImpl: Task: 
attempt_1419291043936_1639_m_000002_2 - exited : 
java.lang.IndexOutOfBoundsException
        at java.nio.Buffer.checkIndex(Buffer.java:532)
        at java.nio.HeapByteBuffer.get(HeapByteBuffer.java:139)
        at 
org.apache.hadoop.hive.ql.io.orc.ReaderImpl.extractMetaInfoFromFooter(ReaderImpl.java:369)
        at 
org.apache.hadoop.hive.ql.io.orc.ReaderImpl.<init>(ReaderImpl.java:311)
        at 
org.apache.hadoop.hive.ql.io.orc.OrcFile.createReader(OrcFile.java:228)
        at 
org.apache.hadoop.hive.ql.io.orc.OrcRawRecordMerger.<init>(OrcRawRecordMerger.java:464)
        at 
org.apache.hadoop.hive.ql.io.orc.OrcInputFormat.getRawReader(OrcInputFormat.java:1232)
        at 
org.apache.hadoop.hive.ql.txn.compactor.CompactorMR$CompactorMap.map(CompactorMR.java:510)
        at 
org.apache.hadoop.hive.ql.txn.compactor.CompactorMR$CompactorMap.map(CompactorMR.java:489)
        at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
        at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:450)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
        at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:163)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:415)
        at 
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
        at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)

2015-01-06 16:42:44,500 INFO [IPC Server handler 4 on 33406] 
org.apache.hadoop.mapred.TaskAttemptListenerImpl: Diagnostics report from 
attempt_1419291043936_1639_m_000002_2: Error: 
java.lang.IndexOutOfBoundsException
        at java.nio.Buffer.checkIndex(Buffer.java:532)
        at java.nio.HeapByteBuffer.get(HeapByteBuffer.java:139)
        at 
org.apache.hadoop.hive.ql.io.orc.ReaderImpl.extractMetaInfoFromFooter(ReaderImpl.java:369)
        at 
org.apache.hadoop.hive.ql.io.orc.ReaderImpl.<init>(ReaderImpl.java:311)
        at 
org.apache.hadoop.hive.ql.io.orc.OrcFile.createReader(OrcFile.java:228)
        at 
org.apache.hadoop.hive.ql.io.orc.OrcRawRecordMerger.<init>(OrcRawRecordMerger.java:464)
        at 
org.apache.hadoop.hive.ql.io.orc.OrcInputFormat.getRawReader(OrcInputFormat.java:1232)
        at 
org.apache.hadoop.hive.ql.txn.compactor.CompactorMR$CompactorMap.map(CompactorMR.java:510)
        at 
org.apache.hadoop.hive.ql.txn.compactor.CompactorMR$CompactorMap.map(CompactorMR.java:489)
        at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
        at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:450)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
        at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:163)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:415)
        at 
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
        at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)

2015-01-06 16:42:44,500 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics report 
from attempt_1419291043936_1639_m_000002_2: Error: 
java.lang.IndexOutOfBoundsException
        at java.nio.Buffer.checkIndex(Buffer.java:532)
        at java.nio.HeapByteBuffer.get(HeapByteBuffer.java:139)
        at 
org.apache.hadoop.hive.ql.io.orc.ReaderImpl.extractMetaInfoFromFooter(ReaderImpl.java:369)
        at 
org.apache.hadoop.hive.ql.io.orc.ReaderImpl.<init>(ReaderImpl.java:311)
        at 
org.apache.hadoop.hive.ql.io.orc.OrcFile.createReader(OrcFile.java:228)
        at 
org.apache.hadoop.hive.ql.io.orc.OrcRawRecordMerger.<init>(OrcRawRecordMerger.java:464)
        at 
org.apache.hadoop.hive.ql.io.orc.OrcInputFormat.getRawReader(OrcInputFormat.java:1232)
        at 
org.apache.hadoop.hive.ql.txn.compactor.CompactorMR$CompactorMap.map(CompactorMR.java:510)
        at 
org.apache.hadoop.hive.ql.txn.compactor.CompactorMR$CompactorMap.map(CompactorMR.java:489)
        at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
        at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:450)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
        at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:163)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:415)
        at 
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
        at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)

2015-01-06 16:42:44,501 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: 
attempt_1419291043936_1639_m_000002_2 TaskAttempt Transitioned from RUNNING to 
FAIL_CONTAINER_CLEANUP
2015-01-06 16:42:44,501 INFO [ContainerLauncher #1] 
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing 
the event EventType: CONTAINER_REMOTE_CLEANUP for container 
container_1419291043936_1639_01_000007 taskAttempt 
attempt_1419291043936_1639_m_000002_2
2015-01-06 16:42:44,501 INFO [ContainerLauncher #1] 
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: KILLING 
attempt_1419291043936_1639_m_000002_2
2015-01-06 16:42:44,501 INFO [ContainerLauncher #1] 
org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: 
Opening proxy : sfdmgctsn003.gid.gap.com:45454
2015-01-06 16:42:44,507 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: 
attempt_1419291043936_1639_m_000002_2 TaskAttempt Transitioned from 
FAIL_CONTAINER_CLEANUP to FAIL_TASK_CLEANUP
2015-01-06 16:42:44,508 INFO [CommitterEvent Processor #3] 
org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing the 
event EventType: TASK_ABORT
2015-01-06 16:42:44,508 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: 
attempt_1419291043936_1639_m_000002_2 TaskAttempt Transitioned from 
FAIL_TASK_CLEANUP to FAILED
2015-01-06 16:42:44,508 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.yarn.util.RackResolver: Resolved sfdmgctsn004.gid.gap.com to 
/default/rack_05
2015-01-06 16:42:44,508 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.yarn.util.RackResolver: Resolved sfdmgctsn003.gid.gap.com to 
/default/rack_05
2015-01-06 16:42:44,508 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.yarn.util.RackResolver: Resolved sfdmgctsn001.gid.gap.com to 
/default/rack_05
2015-01-06 16:42:44,508 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.yarn.util.RackResolver: Resolved sfdmgctsn005.gid.gap.com to 
/default/rack_06
2015-01-06 16:42:44,508 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.yarn.util.RackResolver: Resolved sfdmgctsn002.gid.gap.com to 
/default/rack_05
2015-01-06 16:42:44,509 INFO [Thread-50] 
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: 2 failures on node 
sfdmgctsn003.gid.gap.com
2015-01-06 16:42:44,509 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: 
attempt_1419291043936_1639_m_000002_3 TaskAttempt Transitioned from NEW to 
UNASSIGNED
2015-01-06 16:42:44,509 INFO [Thread-50] 
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Added 
attempt_1419291043936_1639_m_000002_3 to list of failed maps
2015-01-06 16:42:45,222 INFO [RMCommunicator Allocator] 
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Before Scheduling: 
PendingReds:0 ScheduledMaps:1 ScheduledReds:0 AssignedMaps:1 AssignedReds:0 
CompletedMaps:3 CompletedReds:0 ContAlloc:6 ContRel:0 HostLocal:4 RackLocal:0
2015-01-06 16:42:45,223 INFO [RMCommunicator Allocator] 
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources() for 
application_1419291043936_1639: ask=1 release= 0 newContainers=0 
finishedContainers=0 resourcelimit=<memory:444416, vCores:78> knownNMs=5
2015-01-06 16:42:46,225 INFO [RMCommunicator Allocator] 
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Received completed 
container container_1419291043936_1639_01_000007
2015-01-06 16:42:46,225 INFO [RMCommunicator Allocator] 
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Got allocated 
containers 1
2015-01-06 16:42:46,226 INFO [RMCommunicator Allocator] 
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigning container 
Container: [ContainerId: container_1419291043936_1639_01_000008, NodeId: 
sfdmgctsn005.gid.gap.com:45454, NodeHttpAddress: sfdmgctsn005.gid.gap.com:8042, 
Resource: <memory:14336, vCores:1>, Priority: 5, Token: Token { kind: 
ContainerToken, service: 10.9.21.135:45454 }, ] to fast fail map
2015-01-06 16:42:46,226 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics report 
from attempt_1419291043936_1639_m_000002_2: Container killed by the 
ApplicationMaster.
Container killed on request. Exit code is 143
Container exited with a non-zero exit code 143

2015-01-06 16:42:46,226 INFO [RMCommunicator Allocator] 
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned from 
earlierFailedMaps
2015-01-06 16:42:46,226 INFO [RMCommunicator Allocator] 
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned container 
container_1419291043936_1639_01_000008 to attempt_1419291043936_1639_m_000002_3
2015-01-06 16:42:46,226 INFO [RMCommunicator Allocator] 
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After Scheduling: 
PendingReds:0 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:1 AssignedReds:0 
CompletedMaps:3 CompletedReds:0 ContAlloc:7 ContRel:0 HostLocal:4 RackLocal:0
2015-01-06 16:42:46,226 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.yarn.util.RackResolver: Resolved sfdmgctsn005.gid.gap.com to 
/default/rack_06
2015-01-06 16:42:46,227 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: 
attempt_1419291043936_1639_m_000002_3 TaskAttempt Transitioned from UNASSIGNED 
to ASSIGNED
2015-01-06 16:42:46,227 INFO [ContainerLauncher #0] 
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing 
the event EventType: CONTAINER_REMOTE_LAUNCH for container 
container_1419291043936_1639_01_000008 taskAttempt 
attempt_1419291043936_1639_m_000002_3
2015-01-06 16:42:46,227 INFO [ContainerLauncher #0] 
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching 
attempt_1419291043936_1639_m_000002_3
2015-01-06 16:42:46,227 INFO [ContainerLauncher #0] 
org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: 
Opening proxy : sfdmgctsn005.gid.gap.com:45454
2015-01-06 16:42:46,235 INFO [ContainerLauncher #0] 
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle port 
returned by ContainerManager for attempt_1419291043936_1639_m_000002_3 : 13562
2015-01-06 16:42:46,235 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt: 
[attempt_1419291043936_1639_m_000002_3] using containerId: 
[container_1419291043936_1639_01_000008 on NM: [sfdmgctsn005.gid.gap.com:45454]
2015-01-06 16:42:46,235 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: 
attempt_1419291043936_1639_m_000002_3 TaskAttempt Transitioned from ASSIGNED to 
RUNNING
2015-01-06 16:42:47,227 INFO [RMCommunicator Allocator] 
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources() for 
application_1419291043936_1639: ask=1 release= 0 newContainers=0 
finishedContainers=0 resourcelimit=<memory:444416, vCores:78> knownNMs=5
2015-01-06 16:42:49,199 INFO [Socket Reader #1 for port 33406] 
SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for 
job_1419291043936_1639 (auth:SIMPLE)
2015-01-06 16:42:49,209 INFO [IPC Server handler 1 on 33406] 
org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID : 
jvm_1419291043936_1639_m_000008 asked for a task
2015-01-06 16:42:49,209 INFO [IPC Server handler 1 on 33406] 
org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID: 
jvm_1419291043936_1639_m_000008 given task: 
attempt_1419291043936_1639_m_000002_3
2015-01-06 16:42:50,432 INFO [IPC Server handler 3 on 33406] 
org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt 
attempt_1419291043936_1639_m_000002_3 is : 0.0
2015-01-06 16:42:50,434 FATAL [IPC Server handler 4 on 33406] 
org.apache.hadoop.mapred.TaskAttemptListenerImpl: Task: 
attempt_1419291043936_1639_m_000002_3 - exited : 
java.lang.IndexOutOfBoundsException
        at java.nio.Buffer.checkIndex(Buffer.java:532)
        at java.nio.HeapByteBuffer.get(HeapByteBuffer.java:139)
        at 
org.apache.hadoop.hive.ql.io.orc.ReaderImpl.extractMetaInfoFromFooter(ReaderImpl.java:369)
        at 
org.apache.hadoop.hive.ql.io.orc.ReaderImpl.<init>(ReaderImpl.java:311)
        at 
org.apache.hadoop.hive.ql.io.orc.OrcFile.createReader(OrcFile.java:228)
        at 
org.apache.hadoop.hive.ql.io.orc.OrcRawRecordMerger.<init>(OrcRawRecordMerger.java:464)
        at 
org.apache.hadoop.hive.ql.io.orc.OrcInputFormat.getRawReader(OrcInputFormat.java:1232)
        at 
org.apache.hadoop.hive.ql.txn.compactor.CompactorMR$CompactorMap.map(CompactorMR.java:510)
        at 
org.apache.hadoop.hive.ql.txn.compactor.CompactorMR$CompactorMap.map(CompactorMR.java:489)
        at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
        at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:450)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
        at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:163)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:415)
        at 
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
        at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)

2015-01-06 16:42:50,434 INFO [IPC Server handler 4 on 33406] 
org.apache.hadoop.mapred.TaskAttemptListenerImpl: Diagnostics report from 
attempt_1419291043936_1639_m_000002_3: Error: 
java.lang.IndexOutOfBoundsException
        at java.nio.Buffer.checkIndex(Buffer.java:532)
        at java.nio.HeapByteBuffer.get(HeapByteBuffer.java:139)
        at 
org.apache.hadoop.hive.ql.io.orc.ReaderImpl.extractMetaInfoFromFooter(ReaderImpl.java:369)
        at 
org.apache.hadoop.hive.ql.io.orc.ReaderImpl.<init>(ReaderImpl.java:311)
        at 
org.apache.hadoop.hive.ql.io.orc.OrcFile.createReader(OrcFile.java:228)
        at 
org.apache.hadoop.hive.ql.io.orc.OrcRawRecordMerger.<init>(OrcRawRecordMerger.java:464)
        at 
org.apache.hadoop.hive.ql.io.orc.OrcInputFormat.getRawReader(OrcInputFormat.java:1232)
        at 
org.apache.hadoop.hive.ql.txn.compactor.CompactorMR$CompactorMap.map(CompactorMR.java:510)
        at 
org.apache.hadoop.hive.ql.txn.compactor.CompactorMR$CompactorMap.map(CompactorMR.java:489)
        at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
        at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:450)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
        at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:163)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:415)
        at 
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
        at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)

2015-01-06 16:42:50,434 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics report 
from attempt_1419291043936_1639_m_000002_3: Error: 
java.lang.IndexOutOfBoundsException
        at java.nio.Buffer.checkIndex(Buffer.java:532)
        at java.nio.HeapByteBuffer.get(HeapByteBuffer.java:139)
        at 
org.apache.hadoop.hive.ql.io.orc.ReaderImpl.extractMetaInfoFromFooter(ReaderImpl.java:369)
        at 
org.apache.hadoop.hive.ql.io.orc.ReaderImpl.<init>(ReaderImpl.java:311)
        at 
org.apache.hadoop.hive.ql.io.orc.OrcFile.createReader(OrcFile.java:228)
        at 
org.apache.hadoop.hive.ql.io.orc.OrcRawRecordMerger.<init>(OrcRawRecordMerger.java:464)
        at 
org.apache.hadoop.hive.ql.io.orc.OrcInputFormat.getRawReader(OrcInputFormat.java:1232)
        at 
org.apache.hadoop.hive.ql.txn.compactor.CompactorMR$CompactorMap.map(CompactorMR.java:510)
        at 
org.apache.hadoop.hive.ql.txn.compactor.CompactorMR$CompactorMap.map(CompactorMR.java:489)
        at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
        at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:450)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
        at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:163)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:415)
        at 
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
        at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)

2015-01-06 16:42:50,435 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: 
attempt_1419291043936_1639_m_000002_3 TaskAttempt Transitioned from RUNNING to 
FAIL_CONTAINER_CLEANUP
2015-01-06 16:42:50,435 INFO [ContainerLauncher #2] 
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing 
the event EventType: CONTAINER_REMOTE_CLEANUP for container 
container_1419291043936_1639_01_000008 taskAttempt 
attempt_1419291043936_1639_m_000002_3
2015-01-06 16:42:50,435 INFO [ContainerLauncher #2] 
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: KILLING 
attempt_1419291043936_1639_m_000002_3
2015-01-06 16:42:50,435 INFO [ContainerLauncher #2] 
org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: 
Opening proxy : sfdmgctsn005.gid.gap.com:45454
2015-01-06 16:42:50,441 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: 
attempt_1419291043936_1639_m_000002_3 TaskAttempt Transitioned from 
FAIL_CONTAINER_CLEANUP to FAIL_TASK_CLEANUP
2015-01-06 16:42:50,441 INFO [CommitterEvent Processor #4] 
org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing the 
event EventType: TASK_ABORT
2015-01-06 16:42:50,442 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: 
attempt_1419291043936_1639_m_000002_3 TaskAttempt Transitioned from 
FAIL_TASK_CLEANUP to FAILED
2015-01-06 16:42:50,443 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: 
task_1419291043936_1639_m_000002 Task Transitioned from RUNNING to FAILED
2015-01-06 16:42:50,443 INFO [Thread-50] 
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: 1 failures on node 
sfdmgctsn005.gid.gap.com
2015-01-06 16:42:50,443 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Num completed Tasks: 4
2015-01-06 16:42:50,443 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Job failed as tasks 
failed. failedMaps:1 failedReduces:0
2015-01-06 16:42:50,444 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1419291043936_1639Job 
Transitioned from RUNNING to FAIL_ABORT
2015-01-06 16:42:50,444 INFO [CommitterEvent Processor #0] 
org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing the 
event EventType: JOB_ABORT
2015-01-06 16:42:50,455 INFO [AsyncDispatcher event handler] 
org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1419291043936_1639Job 
Transitioned from FAIL_ABORT to FAILED
2015-01-06 16:42:50,456 INFO [Thread-79] 
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: We are finishing cleanly so 
this is the last retry
2015-01-06 16:42:50,456 INFO [Thread-79] 
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Notify RMCommunicator 
isAMLastRetry: true
2015-01-06 16:42:50,456 INFO [Thread-79] 
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: RMCommunicator 
notified that shouldUnregistered is: true
2015-01-06 16:42:50,456 INFO [Thread-79] 
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Notify JHEH isAMLastRetry: true
2015-01-06 16:42:50,456 INFO [Thread-79] 
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: 
JobHistoryEventHandler notified that forceJobCompletion is true
2015-01-06 16:42:50,456 INFO [Thread-79] 
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Calling stop for all the 
services
2015-01-06 16:42:50,456 INFO [Thread-79] 
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Stopping 
JobHistoryEventHandler. Size of the outstanding queue size is 0
2015-01-06 16:42:50,485 INFO [eventHandlingThread] 
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copying 
hdfs://sfdmgct:8020/user/hive/.staging/job_1419291043936_1639/job_1419291043936_1639_1.jhist
 to 
hdfs://sfdmgct:8020/mr-history/tmp/hive/job_1419291043936_1639-1420580542797-hive-sfdmgctmn003.gid.gap.com%2D32%2Dcompactor%2Dds_infra.eve-1420580570443-3-0-FAILED-default-1420580548162.jhist_tmp
2015-01-06 16:42:50,504 INFO [eventHandlingThread] 
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copied to done 
location: 
hdfs://sfdmgct:8020/mr-history/tmp/hive/job_1419291043936_1639-1420580542797-hive-sfdmgctmn003.gid.gap.com%2D32%2Dcompactor%2Dds_infra.eve-1420580570443-3-0-FAILED-default-1420580548162.jhist_tmp
2015-01-06 16:42:50,507 INFO [eventHandlingThread] 
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copying 
hdfs://sfdmgct:8020/user/hive/.staging/job_1419291043936_1639/job_1419291043936_1639_1_conf.xml
 to hdfs://sfdmgct:8020/mr-history/tmp/hive/job_1419291043936_1639_conf.xml_tmp
2015-01-06 16:42:50,524 INFO [eventHandlingThread] 
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copied to done 
location: 
hdfs://sfdmgct:8020/mr-history/tmp/hive/job_1419291043936_1639_conf.xml_tmp
2015-01-06 16:42:50,530 INFO [eventHandlingThread] 
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved tmp to 
done: 
hdfs://sfdmgct:8020/mr-history/tmp/hive/job_1419291043936_1639.summary_tmp to 
hdfs://sfdmgct:8020/mr-history/tmp/hive/job_1419291043936_1639.summary
2015-01-06 16:42:50,531 INFO [eventHandlingThread] 
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved tmp to 
done: 
hdfs://sfdmgct:8020/mr-history/tmp/hive/job_1419291043936_1639_conf.xml_tmp to 
hdfs://sfdmgct:8020/mr-history/tmp/hive/job_1419291043936_1639_conf.xml
2015-01-06 16:42:50,533 INFO [eventHandlingThread] 
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved tmp to 
done: 
hdfs://sfdmgct:8020/mr-history/tmp/hive/job_1419291043936_1639-1420580542797-hive-sfdmgctmn003.gid.gap.com%2D32%2Dcompactor%2Dds_infra.eve-1420580570443-3-0-FAILED-default-1420580548162.jhist_tmp
 to 
hdfs://sfdmgct:8020/mr-history/tmp/hive/job_1419291043936_1639-1420580542797-hive-sfdmgctmn003.gid.gap.com%2D32%2Dcompactor%2Dds_infra.eve-1420580570443-3-0-FAILED-default-1420580548162.jhist
2015-01-06 16:42:50,533 INFO [Thread-79] 
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Stopped 
JobHistoryEventHandler. super.stop()
2015-01-06 16:42:50,535 INFO [Thread-79] 
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Setting job 
diagnostics to Task failed task_1419291043936_1639_m_000002
Job failed as tasks failed. failedMaps:1 failedReduces:0

2015-01-06 16:42:50,536 INFO [Thread-79] 
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: History url is 
http://sfdmgctmn004.gid.gap.com:19888/jobhistory/job/job_1419291043936_1639
2015-01-06 16:42:50,539 INFO [Thread-79] 
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Waiting for 
application to be successfully unregistered.
2015-01-06 16:42:51,540 INFO [Thread-79] 
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Final Stats: 
PendingReds:0 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:1 AssignedReds:0 
CompletedMaps:3 CompletedReds:0 ContAlloc:7 ContRel:0 HostLocal:4 RackLocal:0
2015-01-06 16:42:51,541 INFO [Thread-79] 
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Deleting staging directory 
hdfs://sfdmgct /user/hive/.staging/job_1419291043936_1639
2015-01-06 16:42:51,543 INFO [Thread-79] org.apache.hadoop.ipc.Server: Stopping 
server on 33406
2015-01-06 16:42:51,544 INFO [IPC Server listener on 33406] 
org.apache.hadoop.ipc.Server: Stopping IPC Server listener on 33406
2015-01-06 16:42:51,545 INFO [TaskHeartbeatHandler PingChecker] 
org.apache.hadoop.mapreduce.v2.app.TaskHeartbeatHandler: TaskHeartbeatHandler 
thread interrupted
2015-01-06 16:42:51,545 INFO [IPC Server Responder] 
org.apache.hadoop.ipc.Server: Stopping IPC Server Responder



> Delta files created by hive hcatalog streaming cannot be compacted
> ------------------------------------------------------------------
>
>                 Key: HIVE-8966
>                 URL: https://issues.apache.org/jira/browse/HIVE-8966
>             Project: Hive
>          Issue Type: Bug
>          Components: HCatalog
>    Affects Versions: 0.14.0
>         Environment: hive
>            Reporter: Jihong Liu
>            Assignee: Alan Gates
>            Priority: Critical
>             Fix For: 0.14.1
>
>         Attachments: HIVE-8966.2.patch, HIVE-8966.3.patch, HIVE-8966.patch
>
>
> hive hcatalog streaming will also create a file like bucket_n_flush_length in 
> each delta directory. Where "n" is the bucket number. But the 
> compactor.CompactorMR think this file also needs to compact. However this 
> file of course cannot be compacted, so compactor.CompactorMR will not 
> continue to do the compaction. 
> Did a test, after removed the bucket_n_flush_length file, then the "alter 
> table partition compact" finished successfully. If don't delete that file, 
> nothing will be compacted. 
> This is probably a very severity bug. Both 0.13 and 0.14 have this issue



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)