Re: Is kylin not support Hive ORC tables with ACID properties.

[suresh m]

Please find detail as requested,

Log Type: syslog

Log Upload Time: Fri Nov 25 15:16:35 +0530 2016

Log Length: 107891

2016-11-25 15:15:35,185 INFO [main]
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Created MRAppMaster
for application appattempt_1479580915733_0167_000001
2016-11-25 15:15:35,592 WARN [main]
org.apache.hadoop.util.NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where
applicable
2016-11-25 15:15:35,630 INFO [main]
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Executing with tokens:
2016-11-25 15:15:35,956 INFO [main]
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Kind:
YARN_AM_RM_TOKEN, Service: , Ident: (appAttemptId { application_id {
id: 167 cluster_timestamp: 1479580915733 } attemptId: 1 } keyId:
2128280969)
2016-11-25 15:15:35,974 INFO [main]
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Using mapred
newApiCommitter.
2016-11-25 15:15:35,976 INFO [main]
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: OutputCommitter set in
config null
2016-11-25 15:15:36,029 INFO [main]
org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: File
Output Committer Algorithm version is 1
2016-11-25 15:15:36,029 INFO [main]
org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter:
FileOutputCommitter skip cleanup _temporary folders under output
directory:false, ignore cleanup failures: false
2016-11-25 15:15:36,692 WARN [main]
org.apache.hadoop.hdfs.shortcircuit.DomainSocketFactory: The
short-circuit local reads feature cannot be used because libhadoop
cannot be loaded.
2016-11-25 15:15:36,702 INFO [main]
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: OutputCommitter is
org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter
2016-11-25 15:15:36,891 INFO [main]
org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
org.apache.hadoop.mapreduce.jobhistory.EventType for class
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler
2016-11-25 15:15:36,891 INFO [main]
org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
org.apache.hadoop.mapreduce.v2.app.job.event.JobEventType for class
org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobEventDispatcher
2016-11-25 15:15:36,892 INFO [main]
org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
org.apache.hadoop.mapreduce.v2.app.job.event.TaskEventType for class
org.apache.hadoop.mapreduce.v2.app.MRAppMaster$TaskEventDispatcher
2016-11-25 15:15:36,893 INFO [main]
org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
org.apache.hadoop.mapreduce.v2.app.job.event.TaskAttemptEventType for
class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$TaskAttemptEventDispatcher
2016-11-25 15:15:36,893 INFO [main]
org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventType for class
org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler
2016-11-25 15:15:36,894 INFO [main]
org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
org.apache.hadoop.mapreduce.v2.app.speculate.Speculator$EventType for
class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$SpeculatorEventDispatcher
2016-11-25 15:15:36,894 INFO [main]
org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
org.apache.hadoop.mapreduce.v2.app.rm.ContainerAllocator$EventType for
class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerAllocatorRouter
2016-11-25 15:15:36,895 INFO [main]
org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncher$EventType
for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerLauncherRouter
2016-11-25 15:15:36,923 INFO [main]
org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default
file system is set solely by core-default.xml therefore -  ignoring
2016-11-25 15:15:36,945 INFO [main]
org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default
file system is set solely by core-default.xml therefore -  ignoring
2016-11-25 15:15:36,967 INFO [main]
org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default
file system is set solely by core-default.xml therefore -  ignoring
2016-11-25 15:15:37,029 INFO [main]
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
Emitting job history data to the timeline server is not enabled
2016-11-25 15:15:37,064 INFO [main]
org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class
org.apache.hadoop.mapreduce.v2.app.job.event.JobFinishEvent$Type for
class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobFinishEventHandler
2016-11-25 15:15:37,204 WARN [main]
org.apache.hadoop.metrics2.impl.MetricsConfig: Cannot locate
configuration: tried
hadoop-metrics2-mrappmaster.properties,hadoop-metrics2.properties
2016-11-25 15:15:37,300 INFO [main]
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
period at 10 second(s).
2016-11-25 15:15:37,300 INFO [main]
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: MRAppMaster metrics
system started
2016-11-25 15:15:37,308 INFO [main]
org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Adding job token
for job_1479580915733_0167 to jobTokenSecretManager
2016-11-25 15:15:37,452 INFO [main]
org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Not uberizing
job_1479580915733_0167 because: not enabled; too much RAM;
2016-11-25 15:15:37,468 INFO [main]
org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Input size for
job job_1479580915733_0167 = 223589. Number of splits = 1
2016-11-25 15:15:37,469 INFO [main]
org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Number of reduces
for job job_1479580915733_0167 = 1
2016-11-25 15:15:37,469 INFO [main]
org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl:
job_1479580915733_0167Job Transitioned from NEW to INITED
2016-11-25 15:15:37,470 INFO [main]
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: MRAppMaster launching
normal, non-uberized, multi-container job job_1479580915733_0167.
2016-11-25 15:15:37,493 INFO [main]
org.apache.hadoop.ipc.CallQueueManager: Using callQueue: class
java.util.concurrent.LinkedBlockingQueue scheduler: class
org.apache.hadoop.ipc.DefaultRpcScheduler
2016-11-25 15:15:37,506 INFO [Socket Reader #1 for port 60945]
org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 60945
2016-11-25 15:15:37,525 INFO [main]
org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl:
Adding protocol org.apache.hadoop.mapreduce.v2.api.MRClientProtocolPB
to the server
2016-11-25 15:15:37,527 INFO [IPC Server Responder]
org.apache.hadoop.ipc.Server: IPC Server Responder: starting
2016-11-25 15:15:37,529 INFO [IPC Server listener on 60945]
org.apache.hadoop.ipc.Server: IPC Server listener on 60945: starting
2016-11-25 15:15:37,529 INFO [main]
org.apache.hadoop.mapreduce.v2.app.client.MRClientService:
Instantiated MRClientService at
hadoopclusterslic73.ad.infosys.com/10.122.97.73:60945
2016-11-25 15:15:37,614 INFO [main] org.mortbay.log: Logging to
org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
org.mortbay.log.Slf4jLog
2016-11-25 15:15:37,623 INFO [main]
org.apache.hadoop.security.authentication.server.AuthenticationFilter:
Unable to initialize FileSignerSecretProvider, falling back to use
random secrets.
2016-11-25 15:15:37,628 WARN [main]
org.apache.hadoop.http.HttpRequestLog: Jetty request log can only be
enabled using Log4j
2016-11-25 15:15:37,636 INFO [main]
org.apache.hadoop.http.HttpServer2: Added global filter 'safety'
(class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
2016-11-25 15:15:37,688 INFO [main]
org.apache.hadoop.http.HttpServer2: Added filter AM_PROXY_FILTER
(class=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter) to
context mapreduce
2016-11-25 15:15:37,688 INFO [main]
org.apache.hadoop.http.HttpServer2: Added filter AM_PROXY_FILTER
(class=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter) to
context static
2016-11-25 15:15:37,691 INFO [main]
org.apache.hadoop.http.HttpServer2: adding path spec: /mapreduce/*
2016-11-25 15:15:37,692 INFO [main]
org.apache.hadoop.http.HttpServer2: adding path spec: /ws/*
2016-11-25 15:15:38,181 INFO [main]
org.apache.hadoop.yarn.webapp.WebApps: Registered webapp guice modules
2016-11-25 15:15:38,183 INFO [main]
org.apache.hadoop.http.HttpServer2: Jetty bound to port 34311
2016-11-25 15:15:38,183 INFO [main] org.mortbay.log: jetty-6.1.26.hwx
2016-11-25 15:15:38,263 INFO [main] org.mortbay.log: Extract
jar:file:/hadoop/yarn/local/filecache/16/mapreduce.tar.gz/hadoop/share/hadoop/yarn/hadoop-yarn-common-2.7.3.2.5.0.0-1245.jar!/webapps/mapreduce
to 
/hadoop/yarn/local/usercache/hdfs/appcache/application_1479580915733_0167/container_e125_1479580915733_0167_01_000001/tmp/Jetty_0_0_0_0_34311_mapreduce____2ncvaf/webapp
2016-11-25 15:15:39,882 INFO [main] org.mortbay.log: Started
HttpServer2$SelectChannelConnectorWithSafeStartup@0.0.0.0:34311
2016-11-25 15:15:39,882 INFO [main]
org.apache.hadoop.yarn.webapp.WebApps: Web app mapreduce started at
34311
2016-11-25 15:15:39,933 INFO [main]
org.apache.hadoop.ipc.CallQueueManager: Using callQueue: class
java.util.concurrent.LinkedBlockingQueue scheduler: class
org.apache.hadoop.ipc.DefaultRpcScheduler
2016-11-25 15:15:39,936 INFO [Socket Reader #1 for port 57220]
org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 57220
2016-11-25 15:15:39,943 INFO [IPC Server listener on 57220]
org.apache.hadoop.ipc.Server: IPC Server listener on 57220: starting
2016-11-25 15:15:39,953 INFO [IPC Server Responder]
org.apache.hadoop.ipc.Server: IPC Server Responder: starting
2016-11-25 15:15:39,978 INFO [main]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor:
nodeBlacklistingEnabled:true
2016-11-25 15:15:39,978 INFO [main]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor:
maxTaskFailuresPerNode is 3
2016-11-25 15:15:39,978 INFO [main]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor:
blacklistDisablePercent is 33
2016-11-25 15:15:40,082 WARN [main] org.apache.hadoop.ipc.Client:
Failed to connect to server:
hadoopclusterslic71.ad.infosys.com/10.122.97.71:8030: retries get
failed due to exceeded maximum allowed retries number: 0
java.net.ConnectException: Connection refused
        at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
        at 
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
        at 
org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206)
        at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:531)
        at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:495)
        at 
org.apache.hadoop.ipc.Client$Connection.setupConnection(Client.java:650)
        at 
org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:745)
        at org.apache.hadoop.ipc.Client$Connection.access$3200(Client.java:397)
        at org.apache.hadoop.ipc.Client.getConnection(Client.java:1618)
        at org.apache.hadoop.ipc.Client.call(Client.java:1449)
        at org.apache.hadoop.ipc.Client.call(Client.java:1396)
        at 
org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:233)
        at com.sun.proxy.$Proxy80.registerApplicationMaster(Unknown Source)
        at 
org.apache.hadoop.yarn.api.impl.pb.client.ApplicationMasterProtocolPBClientImpl.registerApplicationMaster(ApplicationMasterProtocolPBClientImpl.java:106)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:497)
        at 
org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:278)
        at 
org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:194)
        at 
org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:176)
        at com.sun.proxy.$Proxy81.registerApplicationMaster(Unknown Source)
        at 
org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator.register(RMCommunicator.java:160)
        at 
org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator.serviceStart(RMCommunicator.java:121)
        at 
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator.serviceStart(RMContainerAllocator.java:250)
        at 
org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
        at 
org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerAllocatorRouter.serviceStart(MRAppMaster.java:881)
        at 
org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
        at 
org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120)
        at 
org.apache.hadoop.mapreduce.v2.app.MRAppMaster.serviceStart(MRAppMaster.java:1151)
        at 
org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
        at 
org.apache.hadoop.mapreduce.v2.app.MRAppMaster$5.run(MRAppMaster.java:1557)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at 
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1724)
        at 
org.apache.hadoop.mapreduce.v2.app.MRAppMaster.initAndStartAppMaster(MRAppMaster.java:1553)
        at 
org.apache.hadoop.mapreduce.v2.app.MRAppMaster.main(MRAppMaster.java:1486)
2016-11-25 15:15:40,089 INFO [main]
org.apache.hadoop.yarn.client.ConfiguredRMFailoverProxyProvider:
Failing over to rm2
2016-11-25 15:15:40,183 INFO [main]
org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator:
maxContainerCapability: <memory:28672, vCores:3>
2016-11-25 15:15:40,183 INFO [main]
org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: queue: default
2016-11-25 15:15:40,186 INFO [main]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
Upper limit on the thread pool size is 500
2016-11-25 15:15:40,186 INFO [main]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: The
thread pool initial size is 10
2016-11-25 15:15:40,189 INFO [main]
org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy:
yarn.client.max-cached-nodemanagers-proxies : 0
2016-11-25 15:15:40,202 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl:
job_1479580915733_0167Job Transitioned from INITED to SETUP
2016-11-25 15:15:40,212 INFO [CommitterEvent Processor #0]
org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler:
Processing the event EventType: JOB_SETUP
2016-11-25 15:15:40,226 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl:
job_1479580915733_0167Job Transitioned from SETUP to RUNNING
2016-11-25 15:15:40,291 INFO [AsyncDispatcher event handler]
org.apache.hadoop.yarn.util.RackResolver: Resolved
hadoopclusterslic72.ad.infosys.com to /default-rack
2016-11-25 15:15:40,328 INFO [eventHandlingThread]
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Event
Writer setup for JobId: job_1479580915733_0167, File:
hdfs://SLICHDP:8020/user/hdfs/.staging/job_1479580915733_0167/job_1479580915733_0167_1.jhist
2016-11-25 15:15:40,351 INFO [AsyncDispatcher event handler]
org.apache.hadoop.yarn.util.RackResolver: Resolved
hadoopclusterslic73.ad.infosys.com to /default-rack
2016-11-25 15:15:40,357 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1479580915733_0167_m_000000 Task Transitioned from NEW to
SCHEDULED
2016-11-25 15:15:40,358 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1479580915733_0167_r_000000 Task Transitioned from NEW to
SCHEDULED
2016-11-25 15:15:40,359 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1479580915733_0167_m_000000_0 TaskAttempt Transitioned from
NEW to UNASSIGNED
2016-11-25 15:15:40,359 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1479580915733_0167_r_000000_0 TaskAttempt Transitioned from
NEW to UNASSIGNED
2016-11-25 15:15:40,401 INFO [Thread-53]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator:
mapResourceRequest:<memory:3072, vCores:1>
2016-11-25 15:15:40,416 INFO [Thread-53]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator:
reduceResourceRequest:<memory:4096, vCores:1>
2016-11-25 15:15:41,191 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Before
Scheduling: PendingReds:1 ScheduledMaps:1 ScheduledReds:0
AssignedMaps:0 AssignedReds:0 CompletedMaps:0 CompletedReds:0
ContAlloc:0 ContRel:0 HostLocal:0 RackLocal:0
2016-11-25 15:15:41,225 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor:
getResources() for application_1479580915733_0167: ask=4 release= 0
newContainers=0 finishedContainers=0 resourcelimit=<memory:38912,
vCores:1> knownNMs=2
2016-11-25 15:15:41,225 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator:
Recalculating schedule, headroom=<memory:38912, vCores:1>
2016-11-25 15:15:41,226 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Reduce
slow start threshold not met. completedMapsForReduceSlowstart 1
2016-11-25 15:15:42,235 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Got
allocated containers 1
2016-11-25 15:15:42,237 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned
container container_e125_1479580915733_0167_01_000002 to
attempt_1479580915733_0167_m_000000_0
2016-11-25 15:15:42,238 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator:
Recalculating schedule, headroom=<memory:34816, vCores:0>
2016-11-25 15:15:42,238 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Reduce
slow start threshold not met. completedMapsForReduceSlowstart 1
2016-11-25 15:15:42,238 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After
Scheduling: PendingReds:1 ScheduledMaps:0 ScheduledReds:0
AssignedMaps:1 AssignedReds:0 CompletedMaps:0 CompletedReds:0
ContAlloc:1 ContRel:0 HostLocal:1 RackLocal:0
2016-11-25 15:15:42,286 INFO [AsyncDispatcher event handler]
org.apache.hadoop.yarn.util.RackResolver: Resolved
hadoopclusterslic73.ad.infosys.com to /default-rack
2016-11-25 15:15:42,311 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: The
job-jar file on the remote FS is
hdfs://SLICHDP/user/hdfs/.staging/job_1479580915733_0167/job.jar
2016-11-25 15:15:42,315 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: The
job-conf file on the remote FS is
/user/hdfs/.staging/job_1479580915733_0167/job.xml
2016-11-25 15:15:42,336 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Adding #0
tokens and #1 secret keys for NM use for launching container
2016-11-25 15:15:42,336 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Size of
containertokens_dob is 1
2016-11-25 15:15:42,336 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Putting
shuffle token in serviceData
2016-11-25 15:15:42,441 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1479580915733_0167_m_000000_0 TaskAttempt Transitioned from
UNASSIGNED to ASSIGNED
2016-11-25 15:15:42,455 INFO [ContainerLauncher #0]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container
container_e125_1479580915733_0167_01_000002 taskAttempt
attempt_1479580915733_0167_m_000000_0
2016-11-25 15:15:42,457 INFO [ContainerLauncher #0]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
Launching attempt_1479580915733_0167_m_000000_0
2016-11-25 15:15:42,457 INFO [ContainerLauncher #0]
org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy:
Opening proxy : hadoopclusterslic73.ad.infosys.com:45454
2016-11-25 15:15:42,531 INFO [ContainerLauncher #0]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
Shuffle port returned by ContainerManager for
attempt_1479580915733_0167_m_000000_0 : 13562
2016-11-25 15:15:42,533 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
TaskAttempt: [attempt_1479580915733_0167_m_000000_0] using
containerId: [container_e125_1479580915733_0167_01_000002 on NM:
[hadoopclusterslic73.ad.infosys.com:45454]
2016-11-25 15:15:42,536 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1479580915733_0167_m_000000_0 TaskAttempt Transitioned from
ASSIGNED to RUNNING
2016-11-25 15:15:42,536 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1479580915733_0167_m_000000 Task Transitioned from SCHEDULED to
RUNNING
2016-11-25 15:15:43,241 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor:
getResources() for application_1479580915733_0167: ask=4 release= 0
newContainers=0 finishedContainers=0 resourcelimit=<memory:34816,
vCores:0> knownNMs=2
2016-11-25 15:15:44,790 INFO [Socket Reader #1 for port 57220]
SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for
job_1479580915733_0167 (auth:SIMPLE)
2016-11-25 15:15:44,870 INFO [IPC Server handler 5 on 57220]
org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID :
jvm_1479580915733_0167_m_137438953472002 asked for a task
2016-11-25 15:15:44,870 INFO [IPC Server handler 5 on 57220]
org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID:
jvm_1479580915733_0167_m_137438953472002 given task:
attempt_1479580915733_0167_m_000000_0
2016-11-25 15:15:51,923 INFO [IPC Server handler 12 on 57220]
org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of
TaskAttempt attempt_1479580915733_0167_m_000000_0 is : 0.667
2016-11-25 15:15:52,099 INFO [IPC Server handler 5 on 57220]
org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of
TaskAttempt attempt_1479580915733_0167_m_000000_0 is : 0.667
2016-11-25 15:15:52,137 ERROR [IPC Server handler 12 on 57220]
org.apache.hadoop.mapred.TaskAttemptListenerImpl: Task:
attempt_1479580915733_0167_m_000000_0 - exited : java.io.IOException:
Failed to build cube in mapper 0
        at 
org.apache.kylin.engine.mr.steps.InMemCuboidMapper.cleanup(InMemCuboidMapper.java:145)
        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:149)
        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:787)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
        at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at 
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1724)
        at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:162)
Caused by: java.util.concurrent.ExecutionException:
java.lang.RuntimeException: java.io.IOException: java.io.IOException:
java.lang.IllegalArgumentException: Value not exists!
        at java.util.concurrent.FutureTask.report(FutureTask.java:122)
        at java.util.concurrent.FutureTask.get(FutureTask.java:192)
        at 
org.apache.kylin.engine.mr.steps.InMemCuboidMapper.cleanup(InMemCuboidMapper.java:143)
        ... 8 more
Caused by: java.lang.RuntimeException: java.io.IOException:
java.io.IOException: java.lang.IllegalArgumentException: Value not
exists!
        at 
org.apache.kylin.cube.inmemcubing.AbstractInMemCubeBuilder$1.run(AbstractInMemCubeBuilder.java:82)
        at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.IOException: java.io.IOException:
java.lang.IllegalArgumentException: Value not exists!
        at 
org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder$BuildOnce.build(DoggedCubeBuilder.java:126)
        at 
org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder.build(DoggedCubeBuilder.java:73)
        at 
org.apache.kylin.cube.inmemcubing.AbstractInMemCubeBuilder$1.run(AbstractInMemCubeBuilder.java:80)
        ... 5 more
Caused by: java.io.IOException: java.lang.IllegalArgumentException:
Value not exists!
        at 
org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder$BuildOnce.abort(DoggedCubeBuilder.java:194)
        at 
org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder$BuildOnce.checkException(DoggedCubeBuilder.java:167)
        at 
org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder$BuildOnce.build(DoggedCubeBuilder.java:114)
        ... 7 more
Caused by: java.lang.IllegalArgumentException: Value not exists!
        at 
org.apache.kylin.common.util.Dictionary.getIdFromValueBytes(Dictionary.java:162)
        at 
org.apache.kylin.dict.TrieDictionary.getIdFromValueImpl(TrieDictionary.java:167)
        at 
org.apache.kylin.common.util.Dictionary.getIdFromValue(Dictionary.java:98)
        at 
org.apache.kylin.dimension.DictionaryDimEnc$DictionarySerializer.serialize(DictionaryDimEnc.java:121)
        at 
org.apache.kylin.cube.gridtable.CubeCodeSystem.encodeColumnValue(CubeCodeSystem.java:121)
        at 
org.apache.kylin.cube.gridtable.CubeCodeSystem.encodeColumnValue(CubeCodeSystem.java:110)
        at org.apache.kylin.gridtable.GTRecord.setValues(GTRecord.java:93)
        at org.apache.kylin.gridtable.GTRecord.setValues(GTRecord.java:81)
        at 
org.apache.kylin.cube.inmemcubing.InMemCubeBuilderInputConverter.convert(InMemCubeBuilderInputConverter.java:74)
        at 
org.apache.kylin.cube.inmemcubing.InMemCubeBuilder$InputConverter$1.next(InMemCubeBuilder.java:542)
        at 
org.apache.kylin.cube.inmemcubing.InMemCubeBuilder$InputConverter$1.next(InMemCubeBuilder.java:523)
        at 
org.apache.kylin.gridtable.GTAggregateScanner.iterator(GTAggregateScanner.java:139)
        at 
org.apache.kylin.cube.inmemcubing.InMemCubeBuilder.createBaseCuboid(InMemCubeBuilder.java:339)
        at 
org.apache.kylin.cube.inmemcubing.InMemCubeBuilder.build(InMemCubeBuilder.java:166)
        at 
org.apache.kylin.cube.inmemcubing.InMemCubeBuilder.build(InMemCubeBuilder.java:135)
        at 
org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder$SplitThread.run(DoggedCubeBuilder.java:282)

2016-11-25 15:15:52,138 INFO [IPC Server handler 12 on 57220]
org.apache.hadoop.mapred.TaskAttemptListenerImpl: Diagnostics report
from attempt_1479580915733_0167_m_000000_0: Error:
java.io.IOException: Failed to build cube in mapper 0
        at 
org.apache.kylin.engine.mr.steps.InMemCuboidMapper.cleanup(InMemCuboidMapper.java:145)
        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:149)
        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:787)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
        at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at 
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1724)
        at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:162)
Caused by: java.util.concurrent.ExecutionException:
java.lang.RuntimeException: java.io.IOException: java.io.IOException:
java.lang.IllegalArgumentException: Value not exists!
        at java.util.concurrent.FutureTask.report(FutureTask.java:122)
        at java.util.concurrent.FutureTask.get(FutureTask.java:192)
        at 
org.apache.kylin.engine.mr.steps.InMemCuboidMapper.cleanup(InMemCuboidMapper.java:143)
        ... 8 more
Caused by: java.lang.RuntimeException: java.io.IOException:
java.io.IOException: java.lang.IllegalArgumentException: Value not
exists!
        at 
org.apache.kylin.cube.inmemcubing.AbstractInMemCubeBuilder$1.run(AbstractInMemCubeBuilder.java:82)
        at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.IOException: java.io.IOException:
java.lang.IllegalArgumentException: Value not exists!
        at 
org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder$BuildOnce.build(DoggedCubeBuilder.java:126)
        at 
org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder.build(DoggedCubeBuilder.java:73)
        at 
org.apache.kylin.cube.inmemcubing.AbstractInMemCubeBuilder$1.run(AbstractInMemCubeBuilder.java:80)
        ... 5 more
Caused by: java.io.IOException: java.lang.IllegalArgumentException:
Value not exists!
        at 
org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder$BuildOnce.abort(DoggedCubeBuilder.java:194)
        at 
org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder$BuildOnce.checkException(DoggedCubeBuilder.java:167)
        at 
org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder$BuildOnce.build(DoggedCubeBuilder.java:114)
        ... 7 more
Caused by: java.lang.IllegalArgumentException: Value not exists!
        at 
org.apache.kylin.common.util.Dictionary.getIdFromValueBytes(Dictionary.java:162)
        at 
org.apache.kylin.dict.TrieDictionary.getIdFromValueImpl(TrieDictionary.java:167)
        at 
org.apache.kylin.common.util.Dictionary.getIdFromValue(Dictionary.java:98)
        at 
org.apache.kylin.dimension.DictionaryDimEnc$DictionarySerializer.serialize(DictionaryDimEnc.java:121)
        at 
org.apache.kylin.cube.gridtable.CubeCodeSystem.encodeColumnValue(CubeCodeSystem.java:121)
        at 
org.apache.kylin.cube.gridtable.CubeCodeSystem.encodeColumnValue(CubeCodeSystem.java:110)
        at org.apache.kylin.gridtable.GTRecord.setValues(GTRecord.java:93)
        at org.apache.kylin.gridtable.GTRecord.setValues(GTRecord.java:81)
        at 
org.apache.kylin.cube.inmemcubing.InMemCubeBuilderInputConverter.convert(InMemCubeBuilderInputConverter.java:74)
        at 
org.apache.kylin.cube.inmemcubing.InMemCubeBuilder$InputConverter$1.next(InMemCubeBuilder.java:542)
        at 
org.apache.kylin.cube.inmemcubing.InMemCubeBuilder$InputConverter$1.next(InMemCubeBuilder.java:523)
        at 
org.apache.kylin.gridtable.GTAggregateScanner.iterator(GTAggregateScanner.java:139)
        at 
org.apache.kylin.cube.inmemcubing.InMemCubeBuilder.createBaseCuboid(InMemCubeBuilder.java:339)
        at 
org.apache.kylin.cube.inmemcubing.InMemCubeBuilder.build(InMemCubeBuilder.java:166)
        at 
org.apache.kylin.cube.inmemcubing.InMemCubeBuilder.build(InMemCubeBuilder.java:135)
        at 
org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder$SplitThread.run(DoggedCubeBuilder.java:282)

2016-11-25 15:15:52,141 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
Diagnostics report from attempt_1479580915733_0167_m_000000_0: Error:
java.io.IOException: Failed to build cube in mapper 0
        at 
org.apache.kylin.engine.mr.steps.InMemCuboidMapper.cleanup(InMemCuboidMapper.java:145)
        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:149)
        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:787)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
        at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at 
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1724)
        at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:162)
Caused by: java.util.concurrent.ExecutionException:
java.lang.RuntimeException: java.io.IOException: java.io.IOException:
java.lang.IllegalArgumentException: Value not exists!
        at java.util.concurrent.FutureTask.report(FutureTask.java:122)
        at java.util.concurrent.FutureTask.get(FutureTask.java:192)
        at 
org.apache.kylin.engine.mr.steps.InMemCuboidMapper.cleanup(InMemCuboidMapper.java:143)
        ... 8 more
Caused by: java.lang.RuntimeException: java.io.IOException:
java.io.IOException: java.lang.IllegalArgumentException: Value not
exists!
        at 
org.apache.kylin.cube.inmemcubing.AbstractInMemCubeBuilder$1.run(AbstractInMemCubeBuilder.java:82)
        at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.IOException: java.io.IOException:
java.lang.IllegalArgumentException: Value not exists!
        at 
org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder$BuildOnce.build(DoggedCubeBuilder.java:126)
        at 
org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder.build(DoggedCubeBuilder.java:73)
        at 
org.apache.kylin.cube.inmemcubing.AbstractInMemCubeBuilder$1.run(AbstractInMemCubeBuilder.java:80)
        ... 5 more
Caused by: java.io.IOException: java.lang.IllegalArgumentException:
Value not exists!
        at 
org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder$BuildOnce.abort(DoggedCubeBuilder.java:194)
        at 
org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder$BuildOnce.checkException(DoggedCubeBuilder.java:167)
        at 
org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder$BuildOnce.build(DoggedCubeBuilder.java:114)
        ... 7 more
Caused by: java.lang.IllegalArgumentException: Value not exists!
        at 
org.apache.kylin.common.util.Dictionary.getIdFromValueBytes(Dictionary.java:162)
        at 
org.apache.kylin.dict.TrieDictionary.getIdFromValueImpl(TrieDictionary.java:167)
        at 
org.apache.kylin.common.util.Dictionary.getIdFromValue(Dictionary.java:98)
        at 
org.apache.kylin.dimension.DictionaryDimEnc$DictionarySerializer.serialize(DictionaryDimEnc.java:121)
        at 
org.apache.kylin.cube.gridtable.CubeCodeSystem.encodeColumnValue(CubeCodeSystem.java:121)
        at 
org.apache.kylin.cube.gridtable.CubeCodeSystem.encodeColumnValue(CubeCodeSystem.java:110)
        at org.apache.kylin.gridtable.GTRecord.setValues(GTRecord.java:93)
        at org.apache.kylin.gridtable.GTRecord.setValues(GTRecord.java:81)
        at 
org.apache.kylin.cube.inmemcubing.InMemCubeBuilderInputConverter.convert(InMemCubeBuilderInputConverter.java:74)
        at 
org.apache.kylin.cube.inmemcubing.InMemCubeBuilder$InputConverter$1.next(InMemCubeBuilder.java:542)
        at 
org.apache.kylin.cube.inmemcubing.InMemCubeBuilder$InputConverter$1.next(InMemCubeBuilder.java:523)
        at 
org.apache.kylin.gridtable.GTAggregateScanner.iterator(GTAggregateScanner.java:139)
        at 
org.apache.kylin.cube.inmemcubing.InMemCubeBuilder.createBaseCuboid(InMemCubeBuilder.java:339)
        at 
org.apache.kylin.cube.inmemcubing.InMemCubeBuilder.build(InMemCubeBuilder.java:166)
        at 
org.apache.kylin.cube.inmemcubing.InMemCubeBuilder.build(InMemCubeBuilder.java:135)
        at 
org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder$SplitThread.run(DoggedCubeBuilder.java:282)

2016-11-25 15:15:52,142 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1479580915733_0167_m_000000_0 TaskAttempt Transitioned from
RUNNING to FAIL_CONTAINER_CLEANUP
2016-11-25 15:15:52,155 INFO [ContainerLauncher #1]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
Processing the event EventType: CONTAINER_REMOTE_CLEANUP for container
container_e125_1479580915733_0167_01_000002 taskAttempt
attempt_1479580915733_0167_m_000000_0
2016-11-25 15:15:52,156 INFO [ContainerLauncher #1]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
KILLING attempt_1479580915733_0167_m_000000_0
2016-11-25 15:15:52,156 INFO [ContainerLauncher #1]
org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy:
Opening proxy : hadoopclusterslic73.ad.infosys.com:45454
2016-11-25 15:15:52,195 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1479580915733_0167_m_000000_0 TaskAttempt Transitioned from
FAIL_CONTAINER_CLEANUP to FAIL_TASK_CLEANUP
2016-11-25 15:15:52,204 INFO [CommitterEvent Processor #1]
org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler:
Processing the event EventType: TASK_ABORT
2016-11-25 15:15:52,215 WARN [CommitterEvent Processor #1]
org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: Could not
delete 
hdfs://SLICHDP/kylin/kylin_metadata/kylin-b2f43555-7105-4912-b0bf-c40a0b405a05/ORC_ALERT_C/cuboid/_temporary/1/_temporary/attempt_1479580915733_0167_m_000000_0
2016-11-25 15:15:52,218 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1479580915733_0167_m_000000_0 TaskAttempt Transitioned from
FAIL_TASK_CLEANUP to FAILED
2016-11-25 15:15:52,224 INFO [AsyncDispatcher event handler]
org.apache.hadoop.yarn.util.RackResolver: Resolved
hadoopclusterslic72.ad.infosys.com to /default-rack
2016-11-25 15:15:52,224 INFO [AsyncDispatcher event handler]
org.apache.hadoop.yarn.util.RackResolver: Resolved
hadoopclusterslic73.ad.infosys.com to /default-rack
2016-11-25 15:15:52,226 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1479580915733_0167_m_000000_1 TaskAttempt Transitioned from
NEW to UNASSIGNED
2016-11-25 15:15:52,226 INFO [Thread-53]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: 1 failures
on node hadoopclusterslic73.ad.infosys.com
2016-11-25 15:15:52,230 INFO [Thread-53]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Added
attempt_1479580915733_0167_m_000000_1 to list of failed maps
2016-11-25 15:15:52,291 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Before
Scheduling: PendingReds:1 ScheduledMaps:1 ScheduledReds:0
AssignedMaps:1 AssignedReds:0 CompletedMaps:0 CompletedReds:0
ContAlloc:1 ContRel:0 HostLocal:1 RackLocal:0
2016-11-25 15:15:52,299 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor:
getResources() for application_1479580915733_0167: ask=1 release= 0
newContainers=0 finishedContainers=1 resourcelimit=<memory:38912,
vCores:1> knownNMs=2
2016-11-25 15:15:52,299 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Received
completed container container_e125_1479580915733_0167_01_000002
2016-11-25 15:15:52,300 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator:
Recalculating schedule, headroom=<memory:38912, vCores:1>
2016-11-25 15:15:52,300 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
Diagnostics report from attempt_1479580915733_0167_m_000000_0:
Container killed by the ApplicationMaster.
Container killed on request. Exit code is 143
Container exited with a non-zero exit code 143

2016-11-25 15:15:52,300 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Reduce
slow start threshold not met. completedMapsForReduceSlowstart 1
2016-11-25 15:15:52,300 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After
Scheduling: PendingReds:1 ScheduledMaps:1 ScheduledReds:0
AssignedMaps:0 AssignedReds:0 CompletedMaps:0 CompletedReds:0
ContAlloc:1 ContRel:0 HostLocal:1 RackLocal:0
2016-11-25 15:15:53,303 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Got
allocated containers 1
2016-11-25 15:15:53,303 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigning
container Container: [ContainerId:
container_e125_1479580915733_0167_01_000003, NodeId:
hadoopclusterslic72.ad.infosys.com:45454, NodeHttpAddress:
hadoopclusterslic72.ad.infosys.com:8042, Resource: <memory:4096,
vCores:1>, Priority: 5, Token: Token { kind: ContainerToken, service:
10.122.97.72:45454 }, ] to fast fail map
2016-11-25 15:15:53,303 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned
from earlierFailedMaps
2016-11-25 15:15:53,304 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned
container container_e125_1479580915733_0167_01_000003 to
attempt_1479580915733_0167_m_000000_1
2016-11-25 15:15:53,304 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator:
Recalculating schedule, headroom=<memory:34816, vCores:0>
2016-11-25 15:15:53,304 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Reduce
slow start threshold not met. completedMapsForReduceSlowstart 1
2016-11-25 15:15:53,304 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After
Scheduling: PendingReds:1 ScheduledMaps:0 ScheduledReds:0
AssignedMaps:1 AssignedReds:0 CompletedMaps:0 CompletedReds:0
ContAlloc:2 ContRel:0 HostLocal:1 RackLocal:0
2016-11-25 15:15:53,304 INFO [AsyncDispatcher event handler]
org.apache.hadoop.yarn.util.RackResolver: Resolved
hadoopclusterslic72.ad.infosys.com to /default-rack
2016-11-25 15:15:53,304 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1479580915733_0167_m_000000_1 TaskAttempt Transitioned from
UNASSIGNED to ASSIGNED
2016-11-25 15:15:53,305 INFO [ContainerLauncher #2]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container
container_e125_1479580915733_0167_01_000003 taskAttempt
attempt_1479580915733_0167_m_000000_1
2016-11-25 15:15:53,305 INFO [ContainerLauncher #2]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
Launching attempt_1479580915733_0167_m_000000_1
2016-11-25 15:15:53,305 INFO [ContainerLauncher #2]
org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy:
Opening proxy : hadoopclusterslic72.ad.infosys.com:45454
2016-11-25 15:15:53,318 INFO [ContainerLauncher #2]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
Shuffle port returned by ContainerManager for
attempt_1479580915733_0167_m_000000_1 : 13562
2016-11-25 15:15:53,318 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
TaskAttempt: [attempt_1479580915733_0167_m_000000_1] using
containerId: [container_e125_1479580915733_0167_01_000003 on NM:
[hadoopclusterslic72.ad.infosys.com:45454]
2016-11-25 15:15:53,318 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1479580915733_0167_m_000000_1 TaskAttempt Transitioned from
ASSIGNED to RUNNING
2016-11-25 15:15:54,309 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor:
getResources() for application_1479580915733_0167: ask=1 release= 0
newContainers=0 finishedContainers=0 resourcelimit=<memory:34816,
vCores:0> knownNMs=2
2016-11-25 15:15:55,797 INFO [Socket Reader #1 for port 57220]
SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for
job_1479580915733_0167 (auth:SIMPLE)
2016-11-25 15:15:55,819 INFO [IPC Server handler 13 on 57220]
org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID :
jvm_1479580915733_0167_m_137438953472003 asked for a task
2016-11-25 15:15:55,819 INFO [IPC Server handler 13 on 57220]
org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID:
jvm_1479580915733_0167_m_137438953472003 given task:
attempt_1479580915733_0167_m_000000_1
2016-11-25 15:16:02,857 INFO [IPC Server handler 8 on 57220]
org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of
TaskAttempt attempt_1479580915733_0167_m_000000_1 is : 0.667
2016-11-25 15:16:03,332 INFO [IPC Server handler 13 on 57220]
org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of
TaskAttempt attempt_1479580915733_0167_m_000000_1 is : 0.667
2016-11-25 15:16:03,347 ERROR [IPC Server handler 8 on 57220]
org.apache.hadoop.mapred.TaskAttemptListenerImpl: Task:
attempt_1479580915733_0167_m_000000_1 - exited : java.io.IOException:
Failed to build cube in mapper 0
        at 
org.apache.kylin.engine.mr.steps.InMemCuboidMapper.cleanup(InMemCuboidMapper.java:145)
        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:149)
        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:787)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
        at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at 
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1724)
        at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:162)
Caused by: java.util.concurrent.ExecutionException:
java.lang.RuntimeException: java.io.IOException: java.io.IOException:
java.lang.IllegalArgumentException: Value not exists!
        at java.util.concurrent.FutureTask.report(FutureTask.java:122)
        at java.util.concurrent.FutureTask.get(FutureTask.java:192)
        at 
org.apache.kylin.engine.mr.steps.InMemCuboidMapper.cleanup(InMemCuboidMapper.java:143)
        ... 8 more
Caused by: java.lang.RuntimeException: java.io.IOException:
java.io.IOException: java.lang.IllegalArgumentException: Value not
exists!
        at 
org.apache.kylin.cube.inmemcubing.AbstractInMemCubeBuilder$1.run(AbstractInMemCubeBuilder.java:82)
        at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.IOException: java.io.IOException:
java.lang.IllegalArgumentException: Value not exists!
        at 
org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder$BuildOnce.build(DoggedCubeBuilder.java:126)
        at 
org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder.build(DoggedCubeBuilder.java:73)
        at 
org.apache.kylin.cube.inmemcubing.AbstractInMemCubeBuilder$1.run(AbstractInMemCubeBuilder.java:80)
        ... 5 more
Caused by: java.io.IOException: java.lang.IllegalArgumentException:
Value not exists!
        at 
org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder$BuildOnce.abort(DoggedCubeBuilder.java:194)
        at 
org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder$BuildOnce.checkException(DoggedCubeBuilder.java:167)
        at 
org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder$BuildOnce.build(DoggedCubeBuilder.java:114)
        ... 7 more
Caused by: java.lang.IllegalArgumentException: Value not exists!
        at 
org.apache.kylin.common.util.Dictionary.getIdFromValueBytes(Dictionary.java:162)
        at 
org.apache.kylin.dict.TrieDictionary.getIdFromValueImpl(TrieDictionary.java:167)
        at 
org.apache.kylin.common.util.Dictionary.getIdFromValue(Dictionary.java:98)
        at 
org.apache.kylin.dimension.DictionaryDimEnc$DictionarySerializer.serialize(DictionaryDimEnc.java:121)
        at 
org.apache.kylin.cube.gridtable.CubeCodeSystem.encodeColumnValue(CubeCodeSystem.java:121)
        at 
org.apache.kylin.cube.gridtable.CubeCodeSystem.encodeColumnValue(CubeCodeSystem.java:110)
        at org.apache.kylin.gridtable.GTRecord.setValues(GTRecord.java:93)
        at org.apache.kylin.gridtable.GTRecord.setValues(GTRecord.java:81)
        at 
org.apache.kylin.cube.inmemcubing.InMemCubeBuilderInputConverter.convert(InMemCubeBuilderInputConverter.java:74)
        at 
org.apache.kylin.cube.inmemcubing.InMemCubeBuilder$InputConverter$1.next(InMemCubeBuilder.java:542)
        at 
org.apache.kylin.cube.inmemcubing.InMemCubeBuilder$InputConverter$1.next(InMemCubeBuilder.java:523)
        at 
org.apache.kylin.gridtable.GTAggregateScanner.iterator(GTAggregateScanner.java:139)
        at 
org.apache.kylin.cube.inmemcubing.InMemCubeBuilder.createBaseCuboid(InMemCubeBuilder.java:339)
        at 
org.apache.kylin.cube.inmemcubing.InMemCubeBuilder.build(InMemCubeBuilder.java:166)
        at 
org.apache.kylin.cube.inmemcubing.InMemCubeBuilder.build(InMemCubeBuilder.java:135)
        at 
org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder$SplitThread.run(DoggedCubeBuilder.java:282)

2016-11-25 15:16:03,347 INFO [IPC Server handler 8 on 57220]
org.apache.hadoop.mapred.TaskAttemptListenerImpl: Diagnostics report
from attempt_1479580915733_0167_m_000000_1: Error:
java.io.IOException: Failed to build cube in mapper 0
        at 
org.apache.kylin.engine.mr.steps.InMemCuboidMapper.cleanup(InMemCuboidMapper.java:145)
        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:149)
        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:787)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
        at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at 
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1724)
        at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:162)
Caused by: java.util.concurrent.ExecutionException:
java.lang.RuntimeException: java.io.IOException: java.io.IOException:
java.lang.IllegalArgumentException: Value not exists!
        at java.util.concurrent.FutureTask.report(FutureTask.java:122)
        at java.util.concurrent.FutureTask.get(FutureTask.java:192)
        at 
org.apache.kylin.engine.mr.steps.InMemCuboidMapper.cleanup(InMemCuboidMapper.java:143)
        ... 8 more
Caused by: java.lang.RuntimeException: java.io.IOException:
java.io.IOException: java.lang.IllegalArgumentException: Value not
exists!
        at 
org.apache.kylin.cube.inmemcubing.AbstractInMemCubeBuilder$1.run(AbstractInMemCubeBuilder.java:82)
        at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.IOException: java.io.IOException:
java.lang.IllegalArgumentException: Value not exists!
        at 
org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder$BuildOnce.build(DoggedCubeBuilder.java:126)
        at 
org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder.build(DoggedCubeBuilder.java:73)
        at 
org.apache.kylin.cube.inmemcubing.AbstractInMemCubeBuilder$1.run(AbstractInMemCubeBuilder.java:80)
        ... 5 more
Caused by: java.io.IOException: java.lang.IllegalArgumentException:
Value not exists!
        at 
org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder$BuildOnce.abort(DoggedCubeBuilder.java:194)
        at 
org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder$BuildOnce.checkException(DoggedCubeBuilder.java:167)
        at 
org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder$BuildOnce.build(DoggedCubeBuilder.java:114)
        ... 7 more
Caused by: java.lang.IllegalArgumentException: Value not exists!
        at 
org.apache.kylin.common.util.Dictionary.getIdFromValueBytes(Dictionary.java:162)
        at 
org.apache.kylin.dict.TrieDictionary.getIdFromValueImpl(TrieDictionary.java:167)
        at 
org.apache.kylin.common.util.Dictionary.getIdFromValue(Dictionary.java:98)
        at 
org.apache.kylin.dimension.DictionaryDimEnc$DictionarySerializer.serialize(DictionaryDimEnc.java:121)
        at 
org.apache.kylin.cube.gridtable.CubeCodeSystem.encodeColumnValue(CubeCodeSystem.java:121)
        at 
org.apache.kylin.cube.gridtable.CubeCodeSystem.encodeColumnValue(CubeCodeSystem.java:110)
        at org.apache.kylin.gridtable.GTRecord.setValues(GTRecord.java:93)
        at org.apache.kylin.gridtable.GTRecord.setValues(GTRecord.java:81)
        at 
org.apache.kylin.cube.inmemcubing.InMemCubeBuilderInputConverter.convert(InMemCubeBuilderInputConverter.java:74)
        at 
org.apache.kylin.cube.inmemcubing.InMemCubeBuilder$InputConverter$1.next(InMemCubeBuilder.java:542)
        at 
org.apache.kylin.cube.inmemcubing.InMemCubeBuilder$InputConverter$1.next(InMemCubeBuilder.java:523)
        at 
org.apache.kylin.gridtable.GTAggregateScanner.iterator(GTAggregateScanner.java:139)
        at 
org.apache.kylin.cube.inmemcubing.InMemCubeBuilder.createBaseCuboid(InMemCubeBuilder.java:339)
        at 
org.apache.kylin.cube.inmemcubing.InMemCubeBuilder.build(InMemCubeBuilder.java:166)
        at 
org.apache.kylin.cube.inmemcubing.InMemCubeBuilder.build(InMemCubeBuilder.java:135)
        at 
org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder$SplitThread.run(DoggedCubeBuilder.java:282)

2016-11-25 15:16:03,349 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
Diagnostics report from attempt_1479580915733_0167_m_000000_1: Error:
java.io.IOException: Failed to build cube in mapper 0
        at 
org.apache.kylin.engine.mr.steps.InMemCuboidMapper.cleanup(InMemCuboidMapper.java:145)
        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:149)
        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:787)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
        at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at 
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1724)
        at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:162)
Caused by: java.util.concurrent.ExecutionException:
java.lang.RuntimeException: java.io.IOException: java.io.IOException:
java.lang.IllegalArgumentException: Value not exists!
        at java.util.concurrent.FutureTask.report(FutureTask.java:122)
        at java.util.concurrent.FutureTask.get(FutureTask.java:192)
        at 
org.apache.kylin.engine.mr.steps.InMemCuboidMapper.cleanup(InMemCuboidMapper.java:143)
        ... 8 more
Caused by: java.lang.RuntimeException: java.io.IOException:
java.io.IOException: java.lang.IllegalArgumentException: Value not
exists!
        at 
org.apache.kylin.cube.inmemcubing.AbstractInMemCubeBuilder$1.run(AbstractInMemCubeBuilder.java:82)
        at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.IOException: java.io.IOException:
java.lang.IllegalArgumentException: Value not exists!
        at 
org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder$BuildOnce.build(DoggedCubeBuilder.java:126)
        at 
org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder.build(DoggedCubeBuilder.java:73)
        at 
org.apache.kylin.cube.inmemcubing.AbstractInMemCubeBuilder$1.run(AbstractInMemCubeBuilder.java:80)
        ... 5 more
Caused by: java.io.IOException: java.lang.IllegalArgumentException:
Value not exists!
        at 
org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder$BuildOnce.abort(DoggedCubeBuilder.java:194)
        at 
org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder$BuildOnce.checkException(DoggedCubeBuilder.java:167)
        at 
org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder$BuildOnce.build(DoggedCubeBuilder.java:114)
        ... 7 more
Caused by: java.lang.IllegalArgumentException: Value not exists!
        at 
org.apache.kylin.common.util.Dictionary.getIdFromValueBytes(Dictionary.java:162)
        at 
org.apache.kylin.dict.TrieDictionary.getIdFromValueImpl(TrieDictionary.java:167)
        at 
org.apache.kylin.common.util.Dictionary.getIdFromValue(Dictionary.java:98)
        at 
org.apache.kylin.dimension.DictionaryDimEnc$DictionarySerializer.serialize(DictionaryDimEnc.java:121)
        at 
org.apache.kylin.cube.gridtable.CubeCodeSystem.encodeColumnValue(CubeCodeSystem.java:121)
        at 
org.apache.kylin.cube.gridtable.CubeCodeSystem.encodeColumnValue(CubeCodeSystem.java:110)
        at org.apache.kylin.gridtable.GTRecord.setValues(GTRecord.java:93)
        at org.apache.kylin.gridtable.GTRecord.setValues(GTRecord.java:81)
        at 
org.apache.kylin.cube.inmemcubing.InMemCubeBuilderInputConverter.convert(InMemCubeBuilderInputConverter.java:74)
        at 
org.apache.kylin.cube.inmemcubing.InMemCubeBuilder$InputConverter$1.next(InMemCubeBuilder.java:542)
        at 
org.apache.kylin.cube.inmemcubing.InMemCubeBuilder$InputConverter$1.next(InMemCubeBuilder.java:523)
        at 
org.apache.kylin.gridtable.GTAggregateScanner.iterator(GTAggregateScanner.java:139)
        at 
org.apache.kylin.cube.inmemcubing.InMemCubeBuilder.createBaseCuboid(InMemCubeBuilder.java:339)
        at 
org.apache.kylin.cube.inmemcubing.InMemCubeBuilder.build(InMemCubeBuilder.java:166)
        at 
org.apache.kylin.cube.inmemcubing.InMemCubeBuilder.build(InMemCubeBuilder.java:135)
        at 
org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder$SplitThread.run(DoggedCubeBuilder.java:282)

2016-11-25 15:16:03,350 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1479580915733_0167_m_000000_1 TaskAttempt Transitioned from
RUNNING to FAIL_CONTAINER_CLEANUP
2016-11-25 15:16:03,351 INFO [ContainerLauncher #3]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
Processing the event EventType: CONTAINER_REMOTE_CLEANUP for container
container_e125_1479580915733_0167_01_000003 taskAttempt
attempt_1479580915733_0167_m_000000_1
2016-11-25 15:16:03,355 INFO [ContainerLauncher #3]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
KILLING attempt_1479580915733_0167_m_000000_1
2016-11-25 15:16:03,355 INFO [ContainerLauncher #3]
org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy:
Opening proxy : hadoopclusterslic72.ad.infosys.com:45454
2016-11-25 15:16:03,369 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1479580915733_0167_m_000000_1 TaskAttempt Transitioned from
FAIL_CONTAINER_CLEANUP to FAIL_TASK_CLEANUP
2016-11-25 15:16:03,369 INFO [CommitterEvent Processor #2]
org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler:
Processing the event EventType: TASK_ABORT
2016-11-25 15:16:03,375 WARN [CommitterEvent Processor #2]
org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: Could not
delete 
hdfs://SLICHDP/kylin/kylin_metadata/kylin-b2f43555-7105-4912-b0bf-c40a0b405a05/ORC_ALERT_C/cuboid/_temporary/1/_temporary/attempt_1479580915733_0167_m_000000_1
2016-11-25 15:16:03,375 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1479580915733_0167_m_000000_1 TaskAttempt Transitioned from
FAIL_TASK_CLEANUP to FAILED
2016-11-25 15:16:03,375 INFO [AsyncDispatcher event handler]
org.apache.hadoop.yarn.util.RackResolver: Resolved
hadoopclusterslic72.ad.infosys.com to /default-rack
2016-11-25 15:16:03,375 INFO [AsyncDispatcher event handler]
org.apache.hadoop.yarn.util.RackResolver: Resolved
hadoopclusterslic73.ad.infosys.com to /default-rack
2016-11-25 15:16:03,376 INFO [Thread-53]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: 1 failures
on node hadoopclusterslic72.ad.infosys.com
2016-11-25 15:16:03,376 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1479580915733_0167_m_000000_2 TaskAttempt Transitioned from
NEW to UNASSIGNED
2016-11-25 15:16:03,380 INFO [Thread-53]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Added
attempt_1479580915733_0167_m_000000_2 to list of failed maps
2016-11-25 15:16:04,341 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Before
Scheduling: PendingReds:1 ScheduledMaps:1 ScheduledReds:0
AssignedMaps:1 AssignedReds:0 CompletedMaps:0 CompletedReds:0
ContAlloc:2 ContRel:0 HostLocal:1 RackLocal:0
2016-11-25 15:16:04,344 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor:
getResources() for application_1479580915733_0167: ask=1 release= 0
newContainers=0 finishedContainers=0 resourcelimit=<memory:34816,
vCores:0> knownNMs=2
2016-11-25 15:16:04,344 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator:
Recalculating schedule, headroom=<memory:34816, vCores:0>
2016-11-25 15:16:04,344 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Reduce
slow start threshold not met. completedMapsForReduceSlowstart 1
2016-11-25 15:16:05,352 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Received
completed container container_e125_1479580915733_0167_01_000003
2016-11-25 15:16:05,352 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Got
allocated containers 1
2016-11-25 15:16:05,352 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigning
container Container: [ContainerId:
container_e125_1479580915733_0167_01_000004, NodeId:
hadoopclusterslic72.ad.infosys.com:45454, NodeHttpAddress:
hadoopclusterslic72.ad.infosys.com:8042, Resource: <memory:4096,
vCores:1>, Priority: 5, Token: Token { kind: ContainerToken, service:
10.122.97.72:45454 }, ] to fast fail map
2016-11-25 15:16:05,352 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned
from earlierFailedMaps
2016-11-25 15:16:05,352 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
Diagnostics report from attempt_1479580915733_0167_m_000000_1:
Container killed by the ApplicationMaster.
Container killed on request. Exit code is 143
Container exited with a non-zero exit code 143

2016-11-25 15:16:05,353 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned
container container_e125_1479580915733_0167_01_000004 to
attempt_1479580915733_0167_m_000000_2
2016-11-25 15:16:05,353 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator:
Recalculating schedule, headroom=<memory:34816, vCores:0>
2016-11-25 15:16:05,353 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Reduce
slow start threshold not met. completedMapsForReduceSlowstart 1
2016-11-25 15:16:05,353 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After
Scheduling: PendingReds:1 ScheduledMaps:0 ScheduledReds:0
AssignedMaps:1 AssignedReds:0 CompletedMaps:0 CompletedReds:0
ContAlloc:3 ContRel:0 HostLocal:1 RackLocal:0
2016-11-25 15:16:05,353 INFO [AsyncDispatcher event handler]
org.apache.hadoop.yarn.util.RackResolver: Resolved
hadoopclusterslic72.ad.infosys.com to /default-rack
2016-11-25 15:16:05,354 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1479580915733_0167_m_000000_2 TaskAttempt Transitioned from
UNASSIGNED to ASSIGNED
2016-11-25 15:16:05,356 INFO [ContainerLauncher #4]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container
container_e125_1479580915733_0167_01_000004 taskAttempt
attempt_1479580915733_0167_m_000000_2
2016-11-25 15:16:05,356 INFO [ContainerLauncher #4]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
Launching attempt_1479580915733_0167_m_000000_2
2016-11-25 15:16:05,357 INFO [ContainerLauncher #4]
org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy:
Opening proxy : hadoopclusterslic72.ad.infosys.com:45454
2016-11-25 15:16:05,371 INFO [ContainerLauncher #4]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
Shuffle port returned by ContainerManager for
attempt_1479580915733_0167_m_000000_2 : 13562
2016-11-25 15:16:05,371 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
TaskAttempt: [attempt_1479580915733_0167_m_000000_2] using
containerId: [container_e125_1479580915733_0167_01_000004 on NM:
[hadoopclusterslic72.ad.infosys.com:45454]
2016-11-25 15:16:05,372 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1479580915733_0167_m_000000_2 TaskAttempt Transitioned from
ASSIGNED to RUNNING
2016-11-25 15:16:06,362 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor:
getResources() for application_1479580915733_0167: ask=1 release= 0
newContainers=0 finishedContainers=0 resourcelimit=<memory:34816,
vCores:0> knownNMs=2
2016-11-25 15:16:07,537 INFO [Socket Reader #1 for port 57220]
SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for
job_1479580915733_0167 (auth:SIMPLE)
2016-11-25 15:16:07,567 INFO [IPC Server handler 24 on 57220]
org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID :
jvm_1479580915733_0167_m_137438953472004 asked for a task
2016-11-25 15:16:07,567 INFO [IPC Server handler 24 on 57220]
org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID:
jvm_1479580915733_0167_m_137438953472004 given task:
attempt_1479580915733_0167_m_000000_2
2016-11-25 15:16:14,753 INFO [IPC Server handler 6 on 57220]
org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of
TaskAttempt attempt_1479580915733_0167_m_000000_2 is : 0.667
2016-11-25 15:16:15,241 INFO [IPC Server handler 13 on 57220]
org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of
TaskAttempt attempt_1479580915733_0167_m_000000_2 is : 0.667
2016-11-25 15:16:15,258 ERROR [IPC Server handler 8 on 57220]
org.apache.hadoop.mapred.TaskAttemptListenerImpl: Task:
attempt_1479580915733_0167_m_000000_2 - exited : java.io.IOException:
Failed to build cube in mapper 0
        at 
org.apache.kylin.engine.mr.steps.InMemCuboidMapper.cleanup(InMemCuboidMapper.java:145)
        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:149)
        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:787)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
        at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at 
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1724)
        at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:162)
Caused by: java.util.concurrent.ExecutionException:
java.lang.RuntimeException: java.io.IOException: java.io.IOException:
java.lang.IllegalArgumentException: Value not exists!
        at java.util.concurrent.FutureTask.report(FutureTask.java:122)
        at java.util.concurrent.FutureTask.get(FutureTask.java:192)
        at 
org.apache.kylin.engine.mr.steps.InMemCuboidMapper.cleanup(InMemCuboidMapper.java:143)
        ... 8 more
Caused by: java.lang.RuntimeException: java.io.IOException:
java.io.IOException: java.lang.IllegalArgumentException: Value not
exists!
        at 
org.apache.kylin.cube.inmemcubing.AbstractInMemCubeBuilder$1.run(AbstractInMemCubeBuilder.java:82)
        at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.IOException: java.io.IOException:
java.lang.IllegalArgumentException: Value not exists!
        at 
org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder$BuildOnce.build(DoggedCubeBuilder.java:126)
        at 
org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder.build(DoggedCubeBuilder.java:73)
        at 
org.apache.kylin.cube.inmemcubing.AbstractInMemCubeBuilder$1.run(AbstractInMemCubeBuilder.java:80)
        ... 5 more
Caused by: java.io.IOException: java.lang.IllegalArgumentException:
Value not exists!
        at 
org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder$BuildOnce.abort(DoggedCubeBuilder.java:194)
        at 
org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder$BuildOnce.checkException(DoggedCubeBuilder.java:167)
        at 
org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder$BuildOnce.build(DoggedCubeBuilder.java:114)
        ... 7 more
Caused by: java.lang.IllegalArgumentException: Value not exists!
        at 
org.apache.kylin.common.util.Dictionary.getIdFromValueBytes(Dictionary.java:162)
        at 
org.apache.kylin.dict.TrieDictionary.getIdFromValueImpl(TrieDictionary.java:167)
        at 
org.apache.kylin.common.util.Dictionary.getIdFromValue(Dictionary.java:98)
        at 
org.apache.kylin.dimension.DictionaryDimEnc$DictionarySerializer.serialize(DictionaryDimEnc.java:121)
        at 
org.apache.kylin.cube.gridtable.CubeCodeSystem.encodeColumnValue(CubeCodeSystem.java:121)
        at 
org.apache.kylin.cube.gridtable.CubeCodeSystem.encodeColumnValue(CubeCodeSystem.java:110)
        at org.apache.kylin.gridtable.GTRecord.setValues(GTRecord.java:93)
        at org.apache.kylin.gridtable.GTRecord.setValues(GTRecord.java:81)
        at 
org.apache.kylin.cube.inmemcubing.InMemCubeBuilderInputConverter.convert(InMemCubeBuilderInputConverter.java:74)
        at 
org.apache.kylin.cube.inmemcubing.InMemCubeBuilder$InputConverter$1.next(InMemCubeBuilder.java:542)
        at 
org.apache.kylin.cube.inmemcubing.InMemCubeBuilder$InputConverter$1.next(InMemCubeBuilder.java:523)
        at 
org.apache.kylin.gridtable.GTAggregateScanner.iterator(GTAggregateScanner.java:139)
        at 
org.apache.kylin.cube.inmemcubing.InMemCubeBuilder.createBaseCuboid(InMemCubeBuilder.java:339)
        at 
org.apache.kylin.cube.inmemcubing.InMemCubeBuilder.build(InMemCubeBuilder.java:166)
        at 
org.apache.kylin.cube.inmemcubing.InMemCubeBuilder.build(InMemCubeBuilder.java:135)
        at 
org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder$SplitThread.run(DoggedCubeBuilder.java:282)

2016-11-25 15:16:15,258 INFO [IPC Server handler 8 on 57220]
org.apache.hadoop.mapred.TaskAttemptListenerImpl: Diagnostics report
from attempt_1479580915733_0167_m_000000_2: Error:
java.io.IOException: Failed to build cube in mapper 0
        at 
org.apache.kylin.engine.mr.steps.InMemCuboidMapper.cleanup(InMemCuboidMapper.java:145)
        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:149)
        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:787)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
        at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at 
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1724)
        at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:162)
Caused by: java.util.concurrent.ExecutionException:
java.lang.RuntimeException: java.io.IOException: java.io.IOException:
java.lang.IllegalArgumentException: Value not exists!
        at java.util.concurrent.FutureTask.report(FutureTask.java:122)
        at java.util.concurrent.FutureTask.get(FutureTask.java:192)
        at 
org.apache.kylin.engine.mr.steps.InMemCuboidMapper.cleanup(InMemCuboidMapper.java:143)
        ... 8 more
Caused by: java.lang.RuntimeException: java.io.IOException:
java.io.IOException: java.lang.IllegalArgumentException: Value not
exists!
        at 
org.apache.kylin.cube.inmemcubing.AbstractInMemCubeBuilder$1.run(AbstractInMemCubeBuilder.java:82)
        at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.IOException: java.io.IOException:
java.lang.IllegalArgumentException: Value not exists!
        at 
org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder$BuildOnce.build(DoggedCubeBuilder.java:126)
        at 
org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder.build(DoggedCubeBuilder.java:73)
        at 
org.apache.kylin.cube.inmemcubing.AbstractInMemCubeBuilder$1.run(AbstractInMemCubeBuilder.java:80)
        ... 5 more
Caused by: java.io.IOException: java.lang.IllegalArgumentException:
Value not exists!
        at 
org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder$BuildOnce.abort(DoggedCubeBuilder.java:194)
        at 
org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder$BuildOnce.checkException(DoggedCubeBuilder.java:167)
        at 
org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder$BuildOnce.build(DoggedCubeBuilder.java:114)
        ... 7 more
Caused by: java.lang.IllegalArgumentException: Value not exists!
        at 
org.apache.kylin.common.util.Dictionary.getIdFromValueBytes(Dictionary.java:162)
        at 
org.apache.kylin.dict.TrieDictionary.getIdFromValueImpl(TrieDictionary.java:167)
        at 
org.apache.kylin.common.util.Dictionary.getIdFromValue(Dictionary.java:98)
        at 
org.apache.kylin.dimension.DictionaryDimEnc$DictionarySerializer.serialize(DictionaryDimEnc.java:121)
        at 
org.apache.kylin.cube.gridtable.CubeCodeSystem.encodeColumnValue(CubeCodeSystem.java:121)
        at 
org.apache.kylin.cube.gridtable.CubeCodeSystem.encodeColumnValue(CubeCodeSystem.java:110)
        at org.apache.kylin.gridtable.GTRecord.setValues(GTRecord.java:93)
        at org.apache.kylin.gridtable.GTRecord.setValues(GTRecord.java:81)
        at 
org.apache.kylin.cube.inmemcubing.InMemCubeBuilderInputConverter.convert(InMemCubeBuilderInputConverter.java:74)
        at 
org.apache.kylin.cube.inmemcubing.InMemCubeBuilder$InputConverter$1.next(InMemCubeBuilder.java:542)
        at 
org.apache.kylin.cube.inmemcubing.InMemCubeBuilder$InputConverter$1.next(InMemCubeBuilder.java:523)
        at 
org.apache.kylin.gridtable.GTAggregateScanner.iterator(GTAggregateScanner.java:139)
        at 
org.apache.kylin.cube.inmemcubing.InMemCubeBuilder.createBaseCuboid(InMemCubeBuilder.java:339)
        at 
org.apache.kylin.cube.inmemcubing.InMemCubeBuilder.build(InMemCubeBuilder.java:166)
        at 
org.apache.kylin.cube.inmemcubing.InMemCubeBuilder.build(InMemCubeBuilder.java:135)
        at 
org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder$SplitThread.run(DoggedCubeBuilder.java:282)

2016-11-25 15:16:15,261 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
Diagnostics report from attempt_1479580915733_0167_m_000000_2: Error:
java.io.IOException: Failed to build cube in mapper 0
        at 
org.apache.kylin.engine.mr.steps.InMemCuboidMapper.cleanup(InMemCuboidMapper.java:145)
        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:149)
        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:787)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
        at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at 
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1724)
        at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:162)
Caused by: java.util.concurrent.ExecutionException:
java.lang.RuntimeException: java.io.IOException: java.io.IOException:
java.lang.IllegalArgumentException: Value not exists!
        at java.util.concurrent.FutureTask.report(FutureTask.java:122)
        at java.util.concurrent.FutureTask.get(FutureTask.java:192)
        at 
org.apache.kylin.engine.mr.steps.InMemCuboidMapper.cleanup(InMemCuboidMapper.java:143)
        ... 8 more
Caused by: java.lang.RuntimeException: java.io.IOException:
java.io.IOException: java.lang.IllegalArgumentException: Value not
exists!
        at 
org.apache.kylin.cube.inmemcubing.AbstractInMemCubeBuilder$1.run(AbstractInMemCubeBuilder.java:82)
        at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.IOException: java.io.IOException:
java.lang.IllegalArgumentException: Value not exists!
        at 
org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder$BuildOnce.build(DoggedCubeBuilder.java:126)
        at 
org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder.build(DoggedCubeBuilder.java:73)
        at 
org.apache.kylin.cube.inmemcubing.AbstractInMemCubeBuilder$1.run(AbstractInMemCubeBuilder.java:80)
        ... 5 more
Caused by: java.io.IOException: java.lang.IllegalArgumentException:
Value not exists!
        at 
org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder$BuildOnce.abort(DoggedCubeBuilder.java:194)
        at 
org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder$BuildOnce.checkException(DoggedCubeBuilder.java:167)
        at 
org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder$BuildOnce.build(DoggedCubeBuilder.java:114)
        ... 7 more
Caused by: java.lang.IllegalArgumentException: Value not exists!
        at 
org.apache.kylin.common.util.Dictionary.getIdFromValueBytes(Dictionary.java:162)
        at 
org.apache.kylin.dict.TrieDictionary.getIdFromValueImpl(TrieDictionary.java:167)
        at 
org.apache.kylin.common.util.Dictionary.getIdFromValue(Dictionary.java:98)
        at 
org.apache.kylin.dimension.DictionaryDimEnc$DictionarySerializer.serialize(DictionaryDimEnc.java:121)
        at 
org.apache.kylin.cube.gridtable.CubeCodeSystem.encodeColumnValue(CubeCodeSystem.java:121)
        at 
org.apache.kylin.cube.gridtable.CubeCodeSystem.encodeColumnValue(CubeCodeSystem.java:110)
        at org.apache.kylin.gridtable.GTRecord.setValues(GTRecord.java:93)
        at org.apache.kylin.gridtable.GTRecord.setValues(GTRecord.java:81)
        at 
org.apache.kylin.cube.inmemcubing.InMemCubeBuilderInputConverter.convert(InMemCubeBuilderInputConverter.java:74)
        at 
org.apache.kylin.cube.inmemcubing.InMemCubeBuilder$InputConverter$1.next(InMemCubeBuilder.java:542)
        at 
org.apache.kylin.cube.inmemcubing.InMemCubeBuilder$InputConverter$1.next(InMemCubeBuilder.java:523)
        at 
org.apache.kylin.gridtable.GTAggregateScanner.iterator(GTAggregateScanner.java:139)
        at 
org.apache.kylin.cube.inmemcubing.InMemCubeBuilder.createBaseCuboid(InMemCubeBuilder.java:339)
        at 
org.apache.kylin.cube.inmemcubing.InMemCubeBuilder.build(InMemCubeBuilder.java:166)
        at 
org.apache.kylin.cube.inmemcubing.InMemCubeBuilder.build(InMemCubeBuilder.java:135)
        at 
org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder$SplitThread.run(DoggedCubeBuilder.java:282)

2016-11-25 15:16:15,273 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1479580915733_0167_m_000000_2 TaskAttempt Transitioned from
RUNNING to FAIL_CONTAINER_CLEANUP
2016-11-25 15:16:15,274 INFO [ContainerLauncher #5]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
Processing the event EventType: CONTAINER_REMOTE_CLEANUP for container
container_e125_1479580915733_0167_01_000004 taskAttempt
attempt_1479580915733_0167_m_000000_2
2016-11-25 15:16:15,274 INFO [ContainerLauncher #5]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
KILLING attempt_1479580915733_0167_m_000000_2
2016-11-25 15:16:15,274 INFO [ContainerLauncher #5]
org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy:
Opening proxy : hadoopclusterslic72.ad.infosys.com:45454
2016-11-25 15:16:15,289 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1479580915733_0167_m_000000_2 TaskAttempt Transitioned from
FAIL_CONTAINER_CLEANUP to FAIL_TASK_CLEANUP
2016-11-25 15:16:15,292 INFO [CommitterEvent Processor #3]
org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler:
Processing the event EventType: TASK_ABORT
2016-11-25 15:16:15,300 WARN [CommitterEvent Processor #3]
org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: Could not
delete 
hdfs://SLICHDP/kylin/kylin_metadata/kylin-b2f43555-7105-4912-b0bf-c40a0b405a05/ORC_ALERT_C/cuboid/_temporary/1/_temporary/attempt_1479580915733_0167_m_000000_2
2016-11-25 15:16:15,300 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1479580915733_0167_m_000000_2 TaskAttempt Transitioned from
FAIL_TASK_CLEANUP to FAILED
2016-11-25 15:16:15,301 INFO [AsyncDispatcher event handler]
org.apache.hadoop.yarn.util.RackResolver: Resolved
hadoopclusterslic72.ad.infosys.com to /default-rack
2016-11-25 15:16:15,301 INFO [AsyncDispatcher event handler]
org.apache.hadoop.yarn.util.RackResolver: Resolved
hadoopclusterslic73.ad.infosys.com to /default-rack
2016-11-25 15:16:15,301 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1479580915733_0167_m_000000_3 TaskAttempt Transitioned from
NEW to UNASSIGNED
2016-11-25 15:16:15,301 INFO [Thread-53]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: 2 failures
on node hadoopclusterslic72.ad.infosys.com
2016-11-25 15:16:15,307 INFO [Thread-53]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Added
attempt_1479580915733_0167_m_000000_3 to list of failed maps
2016-11-25 15:16:15,412 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Before
Scheduling: PendingReds:1 ScheduledMaps:1 ScheduledReds:0
AssignedMaps:1 AssignedReds:0 CompletedMaps:0 CompletedReds:0
ContAlloc:3 ContRel:0 HostLocal:1 RackLocal:0
2016-11-25 15:16:15,420 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor:
getResources() for application_1479580915733_0167: ask=1 release= 0
newContainers=0 finishedContainers=1 resourcelimit=<memory:38912,
vCores:1> knownNMs=2
2016-11-25 15:16:15,420 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Received
completed container container_e125_1479580915733_0167_01_000004
2016-11-25 15:16:15,420 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator:
Recalculating schedule, headroom=<memory:38912, vCores:1>
2016-11-25 15:16:15,420 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Reduce
slow start threshold not met. completedMapsForReduceSlowstart 1
2016-11-25 15:16:15,420 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After
Scheduling: PendingReds:1 ScheduledMaps:1 ScheduledReds:0
AssignedMaps:0 AssignedReds:0 CompletedMaps:0 CompletedReds:0
ContAlloc:3 ContRel:0 HostLocal:1 RackLocal:0
2016-11-25 15:16:15,421 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
Diagnostics report from attempt_1479580915733_0167_m_000000_2:
Container killed by the ApplicationMaster.
Container killed on request. Exit code is 143
Container exited with a non-zero exit code 143

2016-11-25 15:16:16,432 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Got
allocated containers 1
2016-11-25 15:16:16,432 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigning
container Container: [ContainerId:
container_e125_1479580915733_0167_01_000005, NodeId:
hadoopclusterslic72.ad.infosys.com:45454, NodeHttpAddress:
hadoopclusterslic72.ad.infosys.com:8042, Resource: <memory:4096,
vCores:1>, Priority: 5, Token: Token { kind: ContainerToken, service:
10.122.97.72:45454 }, ] to fast fail map
2016-11-25 15:16:16,432 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned
from earlierFailedMaps
2016-11-25 15:16:16,433 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned
container container_e125_1479580915733_0167_01_000005 to
attempt_1479580915733_0167_m_000000_3
2016-11-25 15:16:16,433 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator:
Recalculating schedule, headroom=<memory:34816, vCores:0>
2016-11-25 15:16:16,433 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Reduce
slow start threshold not met. completedMapsForReduceSlowstart 1
2016-11-25 15:16:16,433 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After
Scheduling: PendingReds:1 ScheduledMaps:0 ScheduledReds:0
AssignedMaps:1 AssignedReds:0 CompletedMaps:0 CompletedReds:0
ContAlloc:4 ContRel:0 HostLocal:1 RackLocal:0
2016-11-25 15:16:16,433 INFO [AsyncDispatcher event handler]
org.apache.hadoop.yarn.util.RackResolver: Resolved
hadoopclusterslic72.ad.infosys.com to /default-rack
2016-11-25 15:16:16,434 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1479580915733_0167_m_000000_3 TaskAttempt Transitioned from
UNASSIGNED to ASSIGNED
2016-11-25 15:16:16,436 INFO [ContainerLauncher #6]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container
container_e125_1479580915733_0167_01_000005 taskAttempt
attempt_1479580915733_0167_m_000000_3
2016-11-25 15:16:16,436 INFO [ContainerLauncher #6]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
Launching attempt_1479580915733_0167_m_000000_3
2016-11-25 15:16:16,436 INFO [ContainerLauncher #6]
org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy:
Opening proxy : hadoopclusterslic72.ad.infosys.com:45454
2016-11-25 15:16:16,516 INFO [ContainerLauncher #6]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
Shuffle port returned by ContainerManager for
attempt_1479580915733_0167_m_000000_3 : 13562
2016-11-25 15:16:16,517 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
TaskAttempt: [attempt_1479580915733_0167_m_000000_3] using
containerId: [container_e125_1479580915733_0167_01_000005 on NM:
[hadoopclusterslic72.ad.infosys.com:45454]
2016-11-25 15:16:16,517 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1479580915733_0167_m_000000_3 TaskAttempt Transitioned from
ASSIGNED to RUNNING
2016-11-25 15:16:17,436 INFO [RMCommunicator Allocator]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor:
getResources() for application_1479580915733_0167: ask=1 release= 0
newContainers=0 finishedContainers=0 resourcelimit=<memory:34816,
vCores:0> knownNMs=2
2016-11-25 15:16:19,664 INFO [Socket Reader #1 for port 57220]
SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for
job_1479580915733_0167 (auth:SIMPLE)
2016-11-25 15:16:19,692 INFO [IPC Server handler 6 on 57220]
org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID :
jvm_1479580915733_0167_m_137438953472005 asked for a task
2016-11-25 15:16:19,692 INFO [IPC Server handler 6 on 57220]
org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID:
jvm_1479580915733_0167_m_137438953472005 given task:
attempt_1479580915733_0167_m_000000_3
2016-11-25 15:16:27,222 INFO [IPC Server handler 13 on 57220]
org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of
TaskAttempt attempt_1479580915733_0167_m_000000_3 is : 0.667
2016-11-25 15:16:27,952 INFO [IPC Server handler 7 on 57220]
org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of
TaskAttempt attempt_1479580915733_0167_m_000000_3 is : 0.667
2016-11-25 15:16:27,971 ERROR [IPC Server handler 11 on 57220]
org.apache.hadoop.mapred.TaskAttemptListenerImpl: Task:
attempt_1479580915733_0167_m_000000_3 - exited : java.io.IOException:
Failed to build cube in mapper 0
        at 
org.apache.kylin.engine.mr.steps.InMemCuboidMapper.cleanup(InMemCuboidMapper.java:145)
        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:149)
        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:787)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
        at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at 
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1724)
        at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:162)
Caused by: java.util.concurrent.ExecutionException:
java.lang.RuntimeException: java.io.IOException: java.io.IOException:
java.lang.IllegalArgumentException: Value not exists!
        at java.util.concurrent.FutureTask.report(FutureTask.java:122)
        at java.util.concurrent.FutureTask.get(FutureTask.java:192)
        at 
org.apache.kylin.engine.mr.steps.InMemCuboidMapper.cleanup(InMemCuboidMapper.java:143)
        ... 8 more
Caused by: java.lang.RuntimeException: java.io.IOException:
java.io.IOException: java.lang.IllegalArgumentException: Value not
exists!
        at 
org.apache.kylin.cube.inmemcubing.AbstractInMemCubeBuilder$1.run(AbstractInMemCubeBuilder.java:82)
        at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.IOException: java.io.IOException:
java.lang.IllegalArgumentException: Value not exists!
        at 
org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder$BuildOnce.build(DoggedCubeBuilder.java:126)
        at 
org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder.build(DoggedCubeBuilder.java:73)
        at 
org.apache.kylin.cube.inmemcubing.AbstractInMemCubeBuilder$1.run(AbstractInMemCubeBuilder.java:80)
        ... 5 more
Caused by: java.io.IOException: java.lang.IllegalArgumentException:
Value not exists!
        at 
org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder$BuildOnce.abort(DoggedCubeBuilder.java:194)
        at 
org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder$BuildOnce.checkException(DoggedCubeBuilder.java:167)
        at 
org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder$BuildOnce.build(DoggedCubeBuilder.java:114)
        ... 7 more
Caused by: java.lang.IllegalArgumentException: Value not exists!
        at 
org.apache.kylin.common.util.Dictionary.getIdFromValueBytes(Dictionary.java:162)
        at 
org.apache.kylin.dict.TrieDictionary.getIdFromValueImpl(TrieDictionary.java:167)
        at 
org.apache.kylin.common.util.Dictionary.getIdFromValue(Dictionary.java:98)
        at 
org.apache.kylin.dimension.DictionaryDimEnc$DictionarySerializer.serialize(DictionaryDimEnc.java:121)
        at 
org.apache.kylin.cube.gridtable.CubeCodeSystem.encodeColumnValue(CubeCodeSystem.java:121)
        at 
org.apache.kylin.cube.gridtable.CubeCodeSystem.encodeColumnValue(CubeCodeSystem.java:110)
        at org.apache.kylin.gridtable.GTRecord.setValues(GTRecord.java:93)
        at org.apache.kylin.gridtable.GTRecord.setValues(GTRecord.java:81)
        at 
org.apache.kylin.cube.inmemcubing.InMemCubeBuilderInputConverter.convert(InMemCubeBuilderInputConverter.java:74)
        at 
org.apache.kylin.cube.inmemcubing.InMemCubeBuilder$InputConverter$1.next(InMemCubeBuilder.java:542)
        at 
org.apache.kylin.cube.inmemcubing.InMemCubeBuilder$InputConverter$1.next(InMemCubeBuilder.java:523)
        at 
org.apache.kylin.gridtable.GTAggregateScanner.iterator(GTAggregateScanner.java:139)
        at 
org.apache.kylin.cube.inmemcubing.InMemCubeBuilder.createBaseCuboid(InMemCubeBuilder.java:339)
        at 
org.apache.kylin.cube.inmemcubing.InMemCubeBuilder.build(InMemCubeBuilder.java:166)
        at 
org.apache.kylin.cube.inmemcubing.InMemCubeBuilder.build(InMemCubeBuilder.java:135)
        at 
org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder$SplitThread.run(DoggedCubeBuilder.java:282)

2016-11-25 15:16:27,971 INFO [IPC Server handler 11 on 57220]
org.apache.hadoop.mapred.TaskAttemptListenerImpl: Diagnostics report
from attempt_1479580915733_0167_m_000000_3: Error:
java.io.IOException: Failed to build cube in mapper 0
        at 
org.apache.kylin.engine.mr.steps.InMemCuboidMapper.cleanup(InMemCuboidMapper.java:145)
        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:149)
        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:787)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
        at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at 
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1724)
        at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:162)
Caused by: java.util.concurrent.ExecutionException:
java.lang.RuntimeException: java.io.IOException: java.io.IOException:
java.lang.IllegalArgumentException: Value not exists!
        at java.util.concurrent.FutureTask.report(FutureTask.java:122)
        at java.util.concurrent.FutureTask.get(FutureTask.java:192)
        at 
org.apache.kylin.engine.mr.steps.InMemCuboidMapper.cleanup(InMemCuboidMapper.java:143)
        ... 8 more
Caused by: java.lang.RuntimeException: java.io.IOException:
java.io.IOException: java.lang.IllegalArgumentException: Value not
exists!
        at 
org.apache.kylin.cube.inmemcubing.AbstractInMemCubeBuilder$1.run(AbstractInMemCubeBuilder.java:82)
        at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.IOException: java.io.IOException:
java.lang.IllegalArgumentException: Value not exists!
        at 
org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder$BuildOnce.build(DoggedCubeBuilder.java:126)
        at 
org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder.build(DoggedCubeBuilder.java:73)
        at 
org.apache.kylin.cube.inmemcubing.AbstractInMemCubeBuilder$1.run(AbstractInMemCubeBuilder.java:80)
        ... 5 more
Caused by: java.io.IOException: java.lang.IllegalArgumentException:
Value not exists!
        at 
org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder$BuildOnce.abort(DoggedCubeBuilder.java:194)
        at 
org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder$BuildOnce.checkException(DoggedCubeBuilder.java:167)
        at 
org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder$BuildOnce.build(DoggedCubeBuilder.java:114)
        ... 7 more
Caused by: java.lang.IllegalArgumentException: Value not exists!
        at 
org.apache.kylin.common.util.Dictionary.getIdFromValueBytes(Dictionary.java:162)
        at 
org.apache.kylin.dict.TrieDictionary.getIdFromValueImpl(TrieDictionary.java:167)
        at 
org.apache.kylin.common.util.Dictionary.getIdFromValue(Dictionary.java:98)
        at 
org.apache.kylin.dimension.DictionaryDimEnc$DictionarySerializer.serialize(DictionaryDimEnc.java:121)
        at 
org.apache.kylin.cube.gridtable.CubeCodeSystem.encodeColumnValue(CubeCodeSystem.java:121)
        at 
org.apache.kylin.cube.gridtable.CubeCodeSystem.encodeColumnValue(CubeCodeSystem.java:110)
        at org.apache.kylin.gridtable.GTRecord.setValues(GTRecord.java:93)
        at org.apache.kylin.gridtable.GTRecord.setValues(GTRecord.java:81)
        at 
org.apache.kylin.cube.inmemcubing.InMemCubeBuilderInputConverter.convert(InMemCubeBuilderInputConverter.java:74)
        at 
org.apache.kylin.cube.inmemcubing.InMemCubeBuilder$InputConverter$1.next(InMemCubeBuilder.java:542)
        at 
org.apache.kylin.cube.inmemcubing.InMemCubeBuilder$InputConverter$1.next(InMemCubeBuilder.java:523)
        at 
org.apache.kylin.gridtable.GTAggregateScanner.iterator(GTAggregateScanner.java:139)
        at 
org.apache.kylin.cube.inmemcubing.InMemCubeBuilder.createBaseCuboid(InMemCubeBuilder.java:339)
        at 
org.apache.kylin.cube.inmemcubing.InMemCubeBuilder.build(InMemCubeBuilder.java:166)
        at 
org.apache.kylin.cube.inmemcubing.InMemCubeBuilder.build(InMemCubeBuilder.java:135)
        at 
org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder$SplitThread.run(DoggedCubeBuilder.java:282)

2016-11-25 15:16:27,974 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
Diagnostics report from attempt_1479580915733_0167_m_000000_3: Error:
java.io.IOException: Failed to build cube in mapper 0
        at 
org.apache.kylin.engine.mr.steps.InMemCuboidMapper.cleanup(InMemCuboidMapper.java:145)
        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:149)
        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:787)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
        at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at 
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1724)
        at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:162)
Caused by: java.util.concurrent.ExecutionException:
java.lang.RuntimeException: java.io.IOException: java.io.IOException:
java.lang.IllegalArgumentException: Value not exists!
        at java.util.concurrent.FutureTask.report(FutureTask.java:122)
        at java.util.concurrent.FutureTask.get(FutureTask.java:192)
        at 
org.apache.kylin.engine.mr.steps.InMemCuboidMapper.cleanup(InMemCuboidMapper.java:143)
        ... 8 more
Caused by: java.lang.RuntimeException: java.io.IOException:
java.io.IOException: java.lang.IllegalArgumentException: Value not
exists!
        at 
org.apache.kylin.cube.inmemcubing.AbstractInMemCubeBuilder$1.run(AbstractInMemCubeBuilder.java:82)
        at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.IOException: java.io.IOException:
java.lang.IllegalArgumentException: Value not exists!
        at 
org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder$BuildOnce.build(DoggedCubeBuilder.java:126)
        at 
org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder.build(DoggedCubeBuilder.java:73)
        at 
org.apache.kylin.cube.inmemcubing.AbstractInMemCubeBuilder$1.run(AbstractInMemCubeBuilder.java:80)
        ... 5 more
Caused by: java.io.IOException: java.lang.IllegalArgumentException:
Value not exists!
        at 
org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder$BuildOnce.abort(DoggedCubeBuilder.java:194)
        at 
org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder$BuildOnce.checkException(DoggedCubeBuilder.java:167)
        at 
org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder$BuildOnce.build(DoggedCubeBuilder.java:114)
        ... 7 more
Caused by: java.lang.IllegalArgumentException: Value not exists!
        at 
org.apache.kylin.common.util.Dictionary.getIdFromValueBytes(Dictionary.java:162)
        at 
org.apache.kylin.dict.TrieDictionary.getIdFromValueImpl(TrieDictionary.java:167)
        at 
org.apache.kylin.common.util.Dictionary.getIdFromValue(Dictionary.java:98)
        at 
org.apache.kylin.dimension.DictionaryDimEnc$DictionarySerializer.serialize(DictionaryDimEnc.java:121)
        at 
org.apache.kylin.cube.gridtable.CubeCodeSystem.encodeColumnValue(CubeCodeSystem.java:121)
        at 
org.apache.kylin.cube.gridtable.CubeCodeSystem.encodeColumnValue(CubeCodeSystem.java:110)
        at org.apache.kylin.gridtable.GTRecord.setValues(GTRecord.java:93)
        at org.apache.kylin.gridtable.GTRecord.setValues(GTRecord.java:81)
        at 
org.apache.kylin.cube.inmemcubing.InMemCubeBuilderInputConverter.convert(InMemCubeBuilderInputConverter.java:74)
        at 
org.apache.kylin.cube.inmemcubing.InMemCubeBuilder$InputConverter$1.next(InMemCubeBuilder.java:542)
        at 
org.apache.kylin.cube.inmemcubing.InMemCubeBuilder$InputConverter$1.next(InMemCubeBuilder.java:523)
        at 
org.apache.kylin.gridtable.GTAggregateScanner.iterator(GTAggregateScanner.java:139)
        at 
org.apache.kylin.cube.inmemcubing.InMemCubeBuilder.createBaseCuboid(InMemCubeBuilder.java:339)
        at 
org.apache.kylin.cube.inmemcubing.InMemCubeBuilder.build(InMemCubeBuilder.java:166)
        at 
org.apache.kylin.cube.inmemcubing.InMemCubeBuilder.build(InMemCubeBuilder.java:135)
        at 
org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder$SplitThread.run(DoggedCubeBuilder.java:282)

2016-11-25 15:16:27,975 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1479580915733_0167_m_000000_3 TaskAttempt Transitioned from
RUNNING to FAIL_CONTAINER_CLEANUP
2016-11-25 15:16:27,976 INFO [ContainerLauncher #7]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
Processing the event EventType: CONTAINER_REMOTE_CLEANUP for container
container_e125_1479580915733_0167_01_000005 taskAttempt
attempt_1479580915733_0167_m_000000_3
2016-11-25 15:16:27,997 INFO [ContainerLauncher #7]
org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl:
KILLING attempt_1479580915733_0167_m_000000_3
2016-11-25 15:16:27,997 INFO [ContainerLauncher #7]
org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy:
Opening proxy : hadoopclusterslic72.ad.infosys.com:45454
2016-11-25 15:16:28,009 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1479580915733_0167_m_000000_3 TaskAttempt Transitioned from
FAIL_CONTAINER_CLEANUP to FAIL_TASK_CLEANUP
2016-11-25 15:16:28,011 INFO [CommitterEvent Processor #4]
org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler:
Processing the event EventType: TASK_ABORT
2016-11-25 15:16:28,013 WARN [CommitterEvent Processor #4]
org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: Could not
delete 
hdfs://SLICHDP/kylin/kylin_metadata/kylin-b2f43555-7105-4912-b0bf-c40a0b405a05/ORC_ALERT_C/cuboid/_temporary/1/_temporary/attempt_1479580915733_0167_m_000000_3
2016-11-25 15:16:28,014 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1479580915733_0167_m_000000_3 TaskAttempt Transitioned from
FAIL_TASK_CLEANUP to FAILED
2016-11-25 15:16:28,026 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1479580915733_0167_m_000000 Task Transitioned from RUNNING to
FAILED
2016-11-25 15:16:28,026 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Num completed
Tasks: 1
2016-11-25 15:16:28,027 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Job failed as
tasks failed. failedMaps:1 failedReduces:0
2016-11-25 15:16:28,027 INFO [Thread-53]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: 3 failures
on node hadoopclusterslic72.ad.infosys.com
2016-11-25 15:16:28,027 INFO [Thread-53]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor:
Blacklisted host hadoopclusterslic72.ad.infosys.com
2016-11-25 15:16:28,032 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl:
job_1479580915733_0167Job Transitioned from RUNNING to FAIL_WAIT
2016-11-25 15:16:28,033 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1479580915733_0167_r_000000 Task Transitioned from SCHEDULED to
KILL_WAIT
2016-11-25 15:16:28,033 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1479580915733_0167_r_000000_0 TaskAttempt Transitioned from
UNASSIGNED to KILLED
2016-11-25 15:16:28,034 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1479580915733_0167_r_000000 Task Transitioned from KILL_WAIT to
KILLED
2016-11-25 15:16:28,034 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl:
job_1479580915733_0167Job Transitioned from FAIL_WAIT to FAIL_ABORT
2016-11-25 15:16:28,037 INFO [Thread-53]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Processing
the event EventType: CONTAINER_DEALLOCATE
2016-11-25 15:16:28,037 ERROR [Thread-53]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Could not
deallocate container for task attemptId
attempt_1479580915733_0167_r_000000_0
2016-11-25 15:16:28,043 INFO [CommitterEvent Processor #0]
org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler:
Processing the event EventType: JOB_ABORT
2016-11-25 15:16:28,058 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl:
job_1479580915733_0167Job Transitioned from FAIL_ABORT to FAILED
2016-11-25 15:16:28,092 INFO [Thread-74]
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: We are finishing
cleanly so this is the last retry
2016-11-25 15:16:28,092 INFO [Thread-74]
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Notify RMCommunicator
isAMLastRetry: true
2016-11-25 15:16:28,092 INFO [Thread-74]
org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: RMCommunicator
notified that shouldUnregistered is: true
2016-11-25 15:16:28,092 INFO [Thread-74]
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Notify JHEH
isAMLastRetry: true
2016-11-25 15:16:28,092 INFO [Thread-74]
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
JobHistoryEventHandler notified that forceJobCompletion is true
2016-11-25 15:16:28,092 INFO [Thread-74]
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Calling stop for all
the services
2016-11-25 15:16:28,093 INFO [Thread-74]
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
Stopping JobHistoryEventHandler. Size of the outstanding queue size is
2
2016-11-25 15:16:28,097 INFO [Thread-74]
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: In
stop, writing event TASK_FAILED
2016-11-25 15:16:28,099 INFO [Thread-74]
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: In
stop, writing event JOB_FAILED
2016-11-25 15:16:28,177 INFO [Thread-74]
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copying
hdfs://SLICHDP:8020/user/hdfs/.staging/job_1479580915733_0167/job_1479580915733_0167_1.jhist
to 
hdfs://SLICHDP:8020/mr-history/tmp/hdfs/job_1479580915733_0167-1480067133013-hdfs-Kylin_Cube_Builder_ORC_ALERT_C-1480067188027-0-0-FAILED-default-1480067140199.jhist_tmp
2016-11-25 15:16:28,248 INFO [Thread-74]
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copied
to done location:
hdfs://SLICHDP:8020/mr-history/tmp/hdfs/job_1479580915733_0167-1480067133013-hdfs-Kylin_Cube_Builder_ORC_ALERT_C-1480067188027-0-0-FAILED-default-1480067140199.jhist_tmp
2016-11-25 15:16:28,253 INFO [Thread-74]
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copying
hdfs://SLICHDP:8020/user/hdfs/.staging/job_1479580915733_0167/job_1479580915733_0167_1_conf.xml
to hdfs://SLICHDP:8020/mr-history/tmp/hdfs/job_1479580915733_0167_conf.xml_tmp
2016-11-25 15:16:28,320 INFO [Thread-74]
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copied
to done location:
hdfs://SLICHDP:8020/mr-history/tmp/hdfs/job_1479580915733_0167_conf.xml_tmp
2016-11-25 15:16:28,338 INFO [Thread-74]
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved
tmp to done: 
hdfs://SLICHDP:8020/mr-history/tmp/hdfs/job_1479580915733_0167.summary_tmp
to hdfs://SLICHDP:8020/mr-history/tmp/hdfs/job_1479580915733_0167.summary
2016-11-25 15:16:28,350 INFO [Thread-74]
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved
tmp to done: 
hdfs://SLICHDP:8020/mr-history/tmp/hdfs/job_1479580915733_0167_conf.xml_tmp
to hdfs://SLICHDP:8020/mr-history/tmp/hdfs/job_1479580915733_0167_conf.xml
2016-11-25 15:16:28,353 INFO [Thread-74]
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved
tmp to done: 
hdfs://SLICHDP:8020/mr-history/tmp/hdfs/job_1479580915733_0167-1480067133013-hdfs-Kylin_Cube_Builder_ORC_ALERT_C-1480067188027-0-0-FAILED-default-1480067140199.jhist_tmp
to 
hdfs://SLICHDP:8020/mr-history/tmp/hdfs/job_1479580915733_0167-1480067133013-hdfs-Kylin_Cube_Builder_ORC_ALERT_C-1480067188027-0-0-FAILED-default-1480067140199.jhist
2016-11-25 15:16:28,353 INFO [Thread-74]
org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Stopped
JobHistoryEventHandler. super.stop()
2016-11-25 15:16:28,357 INFO [Thread-74]
org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: Setting job
diagnostics to Task failed task_1479580915733_0167_m_000000
Job failed as tasks failed. failedMaps:1 failedReduces:0

2016-11-25 15:16:28,357 INFO [Thread-74]
org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: History url is
http://hadoopclusterslic73.ad.infosys.com:19888/jobhistory/job/job_1479580915733_0167
2016-11-25 15:16:28,373 INFO [Thread-74]
org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: Waiting for
application to be successfully unregistered.
2016-11-25 15:16:29,375 INFO [Thread-74]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Final
Stats: PendingReds:1 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:1
AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:4 ContRel:0
HostLocal:1 RackLocal:0
2016-11-25 15:16:29,377 INFO [Thread-74]
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Deleting staging
directory hdfs://SLICHDP /user/hdfs/.staging/job_1479580915733_0167
2016-11-25 15:16:29,380 INFO [Thread-74] org.apache.hadoop.ipc.Server:
Stopping server on 57220
2016-11-25 15:16:29,387 INFO [TaskHeartbeatHandler PingChecker]
org.apache.hadoop.mapreduce.v2.app.TaskHeartbeatHandler:
TaskHeartbeatHandler thread interrupted
2016-11-25 15:16:29,387 INFO [IPC Server listener on 57220]
org.apache.hadoop.ipc.Server: Stopping IPC Server listener on 57220


On Fri, Nov 25, 2016 at 7:36 PM, ShaoFeng Shi <shaofeng...@apache.org>
wrote:

> Didn't hear of that. Hive table's file format is transparent for Kylin;
> Even if the table is a view, Kylin can build from it.
>
> What's the detail error you got when using ORC table? If you can provide
> the detail information, that would be better.
>
> 2016-11-25 18:22 GMT+08:00 suresh m <suresh.m8...@gmail.com>:
>
> > Hi Facing an issue where i can able to build cube with text format but
> > unable to building cube with ORC tables.
> >
> > Let me know kylin having any issues with ORC format.?
> >
> >  Hive having limitation that Text format tables not having possibility to
> > enabling ACID properties since text format not supporting ACID. But for
> me
> > ACID properties is important to handle my data, this i can do with ORC
> but
> > kylin throwing errors with ORC format.
> >
> >
> > Regards,
> > Suresh
> >
>
>
>
> --
> Best regards,
>
> Shaofeng Shi 史少锋
>