See <https://builds.apache.org/job/Tajo-master-nightly/384/changes>
Changes:
[hyunsik] TAJO-884: complex join conditions should be supported in ON clause.
[hyunsik] TAJO-881: JOIN with union query occurs NPE. (Hyoungjun Kim via
hyunsik)
------------------------------------------
[...truncated 144422 lines...]
JOIN(7)(INNER)
=> Join Cond: default.lineitem.l_partkey (INT4) = default.part.p_partkey
(INT4)
=> target list: CASE WHEN default.part.p_type (TEXT)LIKE'PROMO%' THEN
default.lineitem.l_extendedprice (FLOAT8) ELSE 0.0 END as ?casewhen,
?multiply_2 (FLOAT8)
=> out schema: {(2) ?casewhen (FLOAT8),?multiply_2 (FLOAT8)}
=> in schema: {(5) default.lineitem.l_partkey
(INT4),default.lineitem.l_extendedprice (FLOAT8),?multiply_2
(FLOAT8),default.part.p_partkey (INT4),default.part.p_type (TEXT)}
SCAN(1) on default.part
=> target list: default.part.p_partkey (INT4), default.part.p_type
(TEXT)
=> out schema: {(2) default.part.p_partkey (INT4),default.part.p_type
(TEXT)}
=> in schema: {(9) default.part.p_partkey (INT4),default.part.p_name
(TEXT),default.part.p_mfgr (TEXT),default.part.p_brand
(TEXT),default.part.p_type (TEXT),default.part.p_size
(INT4),default.part.p_container (TEXT),default.part.p_retailprice
(FLOAT8),default.part.p_comment (TEXT)}
SCAN(0) on default.lineitem
=> target list: default.lineitem.l_partkey (INT4),
default.lineitem.l_extendedprice (FLOAT8), default.lineitem.l_extendedprice
(FLOAT8) * 1.0 - default.lineitem.l_discount (FLOAT8) as ?multiply_2
=> out schema: {(3) default.lineitem.l_partkey
(INT4),default.lineitem.l_extendedprice (FLOAT8),?multiply_2 (FLOAT8)}
=> in schema: {(16) default.lineitem.l_orderkey
(INT4),default.lineitem.l_partkey (INT4),default.lineitem.l_suppkey
(INT4),default.lineitem.l_linenumber (INT4),default.lineitem.l_quantity
(FLOAT8),default.lineitem.l_extendedprice (FLOAT8),default.lineitem.l_discount
(FLOAT8),default.lineitem.l_tax (FLOAT8),default.lineitem.l_returnflag
(TEXT),default.lineitem.l_linestatus (TEXT),default.lineitem.l_shipdate
(TEXT),default.lineitem.l_commitdate (TEXT),default.lineitem.l_receiptdate
(TEXT),default.lineitem.l_shipinstruct (TEXT),default.lineitem.l_shipmode
(TEXT),default.lineitem.l_comment (TEXT)}
=======================================================
Block Id: eb_1403834780683_0445_000004 [ROOT]
=======================================================
[Incoming]
[q_1403834780683_0445] 3 => 4 (type=HASH_SHUFFLE, key=, num=1)
PROJECTION(3)
=> Targets: 100.0 * ?sum_1 (FLOAT8) / ?sum_3 (FLOAT8) as promo_revenue
=> out schema: {(1) promo_revenue (FLOAT8)}
=> in schema: {(2) ?sum_1 (FLOAT8),?sum_3 (FLOAT8)}
GROUP_BY(5)()
=> exprs: (sum(?sum_6 (FLOAT8)),sum(?sum_7 (FLOAT8)))
=> target list: ?sum_1 (FLOAT8), ?sum_3 (FLOAT8)
=> out schema:{(2) ?sum_1 (FLOAT8),?sum_3 (FLOAT8)}
=> in schema:{(2) ?sum_6 (FLOAT8),?sum_7 (FLOAT8)}
SCAN(10) on eb_1403834780683_0445_000003
=> out schema: {(2) ?sum_6 (FLOAT8),?sum_7 (FLOAT8)}
=> in schema: {(2) ?sum_6 (FLOAT8),?sum_7 (FLOAT8)}
=======================================================
Block Id: eb_1403834780683_0445_000005 [TERMINAL]
=======================================================
2014-06-27 02:13:12,560 INFO: org.apache.tajo.master.TajoAsyncDispatcher
(start(101)) - AsyncDispatcher started:q_1403834780683_0445
2014-06-27 02:13:12,560 INFO: org.apache.tajo.master.querymaster.Query
(handle(688)) - Processing q_1403834780683_0445 of type START
2014-06-27 02:13:12,560 INFO: org.apache.tajo.master.querymaster.SubQuery
(initTaskScheduler(677)) - org.apache.tajo.master.DefaultTaskScheduler is
chosen for the task scheduling for eb_1403834780683_0445_000003
2014-06-27 02:13:12,562 INFO: org.apache.tajo.storage.AbstractStorageManager
(listStatus(386)) - Total input paths to process : 1
2014-06-27 02:13:12,564 INFO: org.apache.tajo.storage.AbstractStorageManager
(getSplits(615)) - Total # of splits: 1
2014-06-27 02:13:12,565 INFO: org.apache.tajo.storage.AbstractStorageManager
(listStatus(386)) - Total input paths to process : 1
2014-06-27 02:13:12,566 INFO: org.apache.tajo.storage.AbstractStorageManager
(getSplits(615)) - Total # of splits: 1
2014-06-27 02:13:12,566 INFO: org.apache.tajo.master.querymaster.Repartitioner
(scheduleFragmentsForJoinQuery(150)) - [Distributed Join Strategy] : Broadcast
Join with all tables, base_table=default.lineitem, base_volume=604
2014-06-27 02:13:12,568 INFO: org.apache.tajo.storage.AbstractStorageManager
(listStatus(386)) - Total input paths to process : 1
2014-06-27 02:13:12,569 INFO: org.apache.tajo.storage.AbstractStorageManager
(getSplits(615)) - Total # of splits: 1
2014-06-27 02:13:12,570 INFO: org.apache.tajo.storage.AbstractStorageManager
(listStatus(386)) - Total input paths to process : 1
2014-06-27 02:13:12,571 INFO: org.apache.tajo.storage.AbstractStorageManager
(getSplits(615)) - Total # of splits: 1
2014-06-27 02:13:12,571 INFO: org.apache.tajo.master.querymaster.SubQuery
(transition(647)) - 1 objects are scheduled
2014-06-27 02:13:12,571 INFO: org.apache.tajo.master.DefaultTaskScheduler
(start(87)) - Start TaskScheduler
2014-06-27 02:13:12,572 INFO: org.apache.tajo.worker.TajoResourceAllocator
(calculateNumRequestContainers(100)) - CalculateNumberRequestContainer - Number
of Tasks=1, Number of Cluster Slots=1
2014-06-27 02:13:12,572 INFO: org.apache.tajo.master.querymaster.SubQuery
(allocateContainers(884)) - Request Container for eb_1403834780683_0445_000003
containers=1
2014-06-27 02:13:12,572 INFO: org.apache.tajo.master.querymaster.Query
(handle(705)) - q_1403834780683_0445 Query Transitioned from QUERY_NEW to
QUERY_RUNNING
2014-06-27 02:13:12,572 INFO: org.apache.tajo.worker.TajoResourceAllocator
(run(217)) - Start TajoWorkerAllocationThread
2014-06-27 02:13:12,573 INFO: org.apache.tajo.worker.TajoResourceAllocator
(run(336)) - Stop TajoWorkerAllocationThread
2014-06-27 02:13:12,574 INFO: org.apache.tajo.master.querymaster.SubQuery
(transition(993)) - SubQuery (eb_1403834780683_0445_000003) has 1 containers!
2014-06-27 02:13:12,575 INFO: org.apache.tajo.worker.TaskRunner (<init>(122)) -
Tajo Root Dir: hdfs://localhost:33598/tajo
2014-06-27 02:13:12,575 INFO: org.apache.tajo.worker.TaskRunner (<init>(123)) -
Worker Local Dir:
file://<https://builds.apache.org/job/Tajo-master-nightly/ws/tajo-core/target/test-data/9229509d-36f4-4aec-892c-bc6b3494f3c9/tajo-localdir>
2014-06-27 02:13:12,575 INFO: org.apache.tajo.worker.TaskRunner (<init>(138)) -
QueryMaster Address:asf011.sp2.ygridcore.net/67.195.138.20:20456
2014-06-27 02:13:12,576 INFO: org.apache.tajo.worker.TaskRunnerManager
(run(156)) - Start
TaskRunner:eb_1403834780683_0445_000003,container_1403834780683_0445_01_001567
2014-06-27 02:13:12,577 INFO: org.apache.tajo.worker.TaskRunner (init(191)) -
TaskRunner basedir is created (q_1403834780683_0445/output/3)
2014-06-27 02:13:12,577 INFO: org.apache.tajo.worker.TaskRunner (run(327)) -
TaskRunner startup
2014-06-27 02:13:12,578 INFO: org.apache.tajo.worker.TaskRunner (run(346)) -
Request GetTask:
eb_1403834780683_0445_000003,container_1403834780683_0445_01_001567
2014-06-27 02:13:12,579 INFO: org.apache.tajo.master.DefaultTaskScheduler
(allocateRackTask(707)) - Assigned Local/Rack/Total: (0/1/1), Locality: 0.00%,
Rack host: 67.195.138.20
2014-06-27 02:13:12,582 INFO: org.apache.tajo.worker.TaskRunner (run(385)) -
Accumulated Received Task: 1
2014-06-27 02:13:12,582 INFO: org.apache.tajo.worker.TaskRunner (run(394)) -
Initializing: ta_1403834780683_0445_000003_000000_00
2014-06-27 02:13:12,585 INFO: org.apache.tajo.worker.TaskAttemptContext
(setState(115)) - Query status of ta_1403834780683_0445_000003_000000_00 is
changed to TA_PENDING
2014-06-27 02:13:12,585 INFO: org.apache.tajo.worker.Task (<init>(188)) -
==================================
2014-06-27 02:13:12,585 INFO: org.apache.tajo.worker.Task (<init>(189)) - *
Subquery ta_1403834780683_0445_000003_000000_00 is initialized
2014-06-27 02:13:12,585 INFO: org.apache.tajo.worker.Task (<init>(190)) - *
InterQuery: true, Use HASH_SHUFFLE shuffle
2014-06-27 02:13:12,585 INFO: org.apache.tajo.worker.Task (<init>(193)) - *
Fragments (num: 2)
2014-06-27 02:13:12,585 INFO: org.apache.tajo.worker.Task (<init>(194)) - *
Fetches (total:0) :
2014-06-27 02:13:12,585 INFO: org.apache.tajo.worker.Task (<init>(198)) - *
Local task dir:
<https://builds.apache.org/job/Tajo-master-nightly/ws/tajo-core/target/test-data/9229509d-36f4-4aec-892c-bc6b3494f3c9/tajo-localdir/q_1403834780683_0445/output/3/0_0>
2014-06-27 02:13:12,585 INFO: org.apache.tajo.worker.Task (<init>(203)) -
==================================
2014-06-27 02:13:12,586 INFO: org.apache.tajo.worker.TaskAttemptContext
(setState(115)) - Query status of ta_1403834780683_0445_000003_000000_00 is
changed to TA_RUNNING
2014-06-27 02:13:12,586 INFO:
org.apache.tajo.engine.planner.PhysicalPlannerImpl
(checkIfInMemoryInnerJoinIsPossible(256)) -
[ta_1403834780683_0445_000003_000000_00] the volume of Left relations
(default.lineitem) is 604 B and is fit to main maemory.
2014-06-27 02:13:12,586 INFO:
org.apache.tajo.engine.planner.PhysicalPlannerImpl
(createBestInnerJoinPlan(409)) - Join (7) chooses [In-memory Hash Join]
2014-06-27 02:13:12,586 INFO:
org.apache.tajo.engine.planner.PhysicalPlannerImpl
(switchJoinSidesIfNecessary(389)) - [ta_1403834780683_0445_000003_000000_00]
Right relations default.part (368 B) is smaller than Left relations
default.lineitem (604 B).
2014-06-27 02:13:12,587 INFO:
org.apache.tajo.engine.planner.PhysicalPlannerImpl
(createInMemoryHashAggregation(912)) - The planner chooses [Hash Aggregation]
2014-06-27 02:13:12,597 INFO: org.apache.tajo.worker.TaskAttemptContext
(setState(115)) - Query status of ta_1403834780683_0445_000003_000000_00 is
changed to TA_SUCCEEDED
2014-06-27 02:13:12,597 INFO: org.apache.tajo.worker.Task (run(452)) - Worker's
task counter - total:1, succeeded: 1, killed: 1, failed: 0
2014-06-27 02:13:12,597 INFO: org.apache.tajo.worker.TaskRunner (run(346)) -
Request GetTask:
eb_1403834780683_0445_000003,container_1403834780683_0445_01_001567
2014-06-27 02:13:12,598 INFO: org.apache.tajo.master.querymaster.SubQuery
(transition(1070)) - [eb_1403834780683_0445_000003] Task Completion Event
(Total: 1, Success: 1, Killed: 0, Failed: 0)
2014-06-27 02:13:12,598 INFO: org.apache.tajo.master.querymaster.SubQuery
(transition(1110)) - subQuery completed - eb_1403834780683_0445_000003
(total=1, success=1, killed=0)
2014-06-27 02:13:12,598 INFO: org.apache.tajo.master.DefaultTaskScheduler
(run(102)) - TaskScheduler schedulingThread stopped
2014-06-27 02:13:12,598 INFO: org.apache.tajo.worker.TaskRunner (run(376)) -
Received ShouldDie
flag:eb_1403834780683_0445_000003,container_1403834780683_0445_01_001567
2014-06-27 02:13:12,598 INFO: org.apache.tajo.master.DefaultTaskScheduler
(stop(143)) - Task Scheduler stopped
2014-06-27 02:13:12,598 INFO: org.apache.tajo.worker.TaskRunner (stop(239)) -
Stop TaskRunner: eb_1403834780683_0445_000003
2014-06-27 02:13:12,599 INFO: org.apache.tajo.worker.TaskRunnerManager
(stopTask(89)) - Stop
Task:eb_1403834780683_0445_000003,container_1403834780683_0445_01_001567
2014-06-27 02:13:12,599 INFO: org.apache.tajo.master.querymaster.Query
(handle(688)) - Processing q_1403834780683_0445 of type SUBQUERY_COMPLETED
2014-06-27 02:13:12,599 INFO: org.apache.tajo.master.querymaster.SubQuery
(initTaskScheduler(677)) - org.apache.tajo.master.DefaultTaskScheduler is
chosen for the task scheduling for eb_1403834780683_0445_000004
2014-06-27 02:13:12,599 INFO: org.apache.tajo.master.querymaster.SubQuery
(getNonLeafTaskNum(833)) - Table's volume is approximately 1 MB
2014-06-27 02:13:12,599 INFO: org.apache.tajo.master.querymaster.SubQuery
(getNonLeafTaskNum(836)) - The determined number of non-leaf tasks is 1
2014-06-27 02:13:12,599 INFO:
org.apache.tajo.master.rm.TajoWorkerResourceManager
(releaseWorkerResource(518)) - Release Resource: 0.5,512
2014-06-27 02:13:12,599 INFO: org.apache.tajo.master.querymaster.Repartitioner
(scheduleHashShuffledFetches(546)) - eb_1403834780683_0445_000004,
ScheduleHashShuffledFetches - Max num=1, finalFetchURI=1
2014-06-27 02:13:12,600 INFO: org.apache.tajo.master.querymaster.Repartitioner
(scheduleHashShuffledFetches(550)) - eb_1403834780683_0445_000004, No Grouping
Column - determinedTaskNum is set to 1
2014-06-27 02:13:12,600 INFO: org.apache.tajo.master.querymaster.Repartitioner
(scheduleHashShuffledFetches(562)) - eb_1403834780683_0445_000004,
DeterminedTaskNum : 1
2014-06-27 02:13:12,600 INFO: org.apache.tajo.master.querymaster.SubQuery
(transition(647)) - 1 objects are scheduled
2014-06-27 02:13:12,600 INFO: org.apache.tajo.master.DefaultTaskScheduler
(start(87)) - Start TaskScheduler
2014-06-27 02:13:12,601 INFO: org.apache.tajo.worker.TajoResourceAllocator
(calculateNumRequestContainers(100)) - CalculateNumberRequestContainer - Number
of Tasks=1, Number of Cluster Slots=1
2014-06-27 02:13:12,601 INFO: org.apache.tajo.master.querymaster.SubQuery
(allocateContainers(884)) - Request Container for eb_1403834780683_0445_000004
containers=1
2014-06-27 02:13:12,601 INFO: org.apache.tajo.master.querymaster.Query
(executeNextBlock(609)) - Scheduling SubQuery:eb_1403834780683_0445_000004
2014-06-27 02:13:12,601 INFO: org.apache.tajo.worker.TajoResourceAllocator
(run(217)) - Start TajoWorkerAllocationThread
2014-06-27 02:13:12,602 INFO: org.apache.tajo.worker.TajoResourceAllocator
(run(336)) - Stop TajoWorkerAllocationThread
2014-06-27 02:13:12,602 INFO: org.apache.tajo.master.querymaster.SubQuery
(transition(993)) - SubQuery (eb_1403834780683_0445_000004) has 1 containers!
2014-06-27 02:13:12,603 INFO: org.apache.tajo.worker.TaskRunner (<init>(122)) -
Tajo Root Dir: hdfs://localhost:33598/tajo
2014-06-27 02:13:12,603 INFO: org.apache.tajo.worker.TaskRunner (<init>(123)) -
Worker Local Dir:
file://<https://builds.apache.org/job/Tajo-master-nightly/ws/tajo-core/target/test-data/9229509d-36f4-4aec-892c-bc6b3494f3c9/tajo-localdir>
2014-06-27 02:13:12,604 INFO: org.apache.tajo.worker.TaskRunner (<init>(138)) -
QueryMaster Address:asf011.sp2.ygridcore.net/67.195.138.20:20456
2014-06-27 02:13:12,604 INFO: org.apache.tajo.worker.TaskRunnerManager
(run(156)) - Start
TaskRunner:eb_1403834780683_0445_000004,container_1403834780683_0445_01_001568
2014-06-27 02:13:12,605 INFO: org.apache.tajo.worker.TaskRunner (init(191)) -
TaskRunner basedir is created (q_1403834780683_0445/output/4)
2014-06-27 02:13:12,605 INFO: org.apache.tajo.worker.TaskRunner (run(327)) -
TaskRunner startup
2014-06-27 02:13:12,605 INFO: org.apache.tajo.worker.TaskRunner (run(346)) -
Request GetTask:
eb_1403834780683_0445_000004,container_1403834780683_0445_01_001568
2014-06-27 02:13:12,607 INFO: org.apache.tajo.worker.TaskRunner (run(385)) -
Accumulated Received Task: 1
2014-06-27 02:13:12,607 INFO: org.apache.tajo.worker.TaskRunner (run(394)) -
Initializing: ta_1403834780683_0445_000004_000000_00
2014-06-27 02:13:12,609 INFO: org.apache.tajo.worker.Task (<init>(183)) -
Output File Path:
hdfs://localhost:33598/tmp/tajo-jenkins/staging/q_1403834780683_0445/RESULT/part-04-000000
2014-06-27 02:13:12,609 INFO: org.apache.tajo.worker.TaskAttemptContext
(setState(115)) - Query status of ta_1403834780683_0445_000004_000000_00 is
changed to TA_PENDING
2014-06-27 02:13:12,609 INFO: org.apache.tajo.worker.Task (<init>(188)) -
==================================
2014-06-27 02:13:12,609 INFO: org.apache.tajo.worker.Task (<init>(189)) - *
Subquery ta_1403834780683_0445_000004_000000_00 is initialized
2014-06-27 02:13:12,609 INFO: org.apache.tajo.worker.Task (<init>(190)) - *
InterQuery: false
2014-06-27 02:13:12,609 INFO: org.apache.tajo.worker.Task (<init>(193)) - *
Fragments (num: 1)
2014-06-27 02:13:12,610 INFO: org.apache.tajo.worker.Task (<init>(194)) - *
Fetches (total:1) :
2014-06-27 02:13:12,610 INFO: org.apache.tajo.worker.Task (<init>(196)) - Table
Id: eb_1403834780683_0445_000003, Simple URIs:
[http://67.195.138.20:35051/?qid=q_1403834780683_0445&sid=3&p=0&type=h]
2014-06-27 02:13:12,610 INFO: org.apache.tajo.worker.Task (<init>(198)) - *
Local task dir:
<https://builds.apache.org/job/Tajo-master-nightly/ws/tajo-core/target/test-data/9229509d-36f4-4aec-892c-bc6b3494f3c9/tajo-localdir/q_1403834780683_0445/output/4/0_0>
2014-06-27 02:13:12,610 INFO: org.apache.tajo.worker.Task (<init>(203)) -
==================================
2014-06-27 02:13:12,612 INFO: org.apache.tajo.worker.Task (init(219)) - the
directory is created
<https://builds.apache.org/job/Tajo-master-nightly/ws/tajo-core/target/test-data/9229509d-36f4-4aec-892c-bc6b3494f3c9/tajo-localdir/q_1403834780683_0445/in/eb_1403834780683_0445_000004/0/0/eb_1403834780683_0445_000003>
2014-06-27 02:13:12,614 INFO: org.apache.tajo.worker.TaskAttemptContext
(setState(115)) - Query status of ta_1403834780683_0445_000004_000000_00 is
changed to TA_RUNNING
2014-06-27 02:13:12,615 INFO: org.apache.tajo.pullserver.TajoPullServerService
(channelOpen(349)) - Current number of shuffle connections (2)
2014-06-27 02:13:12,615 INFO: org.apache.tajo.worker.Fetcher (get(126)) -
Fetch:
http://67.195.138.20:35051/?qid=q_1403834780683_0445&sid=3&p=0&type=h&ta=0_0
2014-06-27 02:13:12,616 INFO: org.apache.tajo.pullserver.TajoPullServerService
(messageReceived(394)) - PullServer request param: shuffleType=h, sid=3,
partId=0, taskIds=[0_0]
2014-06-27 02:13:12,616 INFO: org.apache.tajo.pullserver.TajoPullServerService
(messageReceived(400)) - PullServer baseDir:
file://<https://builds.apache.org/job/Tajo-master-nightly/ws/tajo-core/target/test-data/9229509d-36f4-4aec-892c-bc6b3494f3c9/tajo-localdir/q_1403834780683_0445/output>
2014-06-27 02:13:12,617 INFO: org.apache.tajo.worker.Task (waitForFetch(360)) -
ta_1403834780683_0445_000004_000000_00 All fetches are done!
2014-06-27 02:13:12,619 INFO:
org.apache.tajo.engine.planner.PhysicalPlannerImpl
(createInMemoryHashAggregation(912)) - The planner chooses [Hash Aggregation]
2014-06-27 02:13:12,629 INFO: BlockStateChange (logAddStoredBlock(2300)) -
BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:51394 is added to
blk_1073742496_1672{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1,
replicas=[ReplicaUnderConstruction[[DISK]DS-9c310fe1-6abe-4a1f-9a14-d00c53c8118d:NORMAL|RBW]]}
size 0
2014-06-27 02:13:12,632 INFO: org.apache.tajo.worker.TaskAttemptContext
(setState(115)) - Query status of ta_1403834780683_0445_000004_000000_00 is
changed to TA_SUCCEEDED
2014-06-27 02:13:12,633 INFO: org.apache.tajo.worker.Task (run(452)) - Worker's
task counter - total:1, succeeded: 1, killed: 1, failed: 0
2014-06-27 02:13:12,633 INFO: org.apache.tajo.worker.TaskRunner (run(346)) -
Request GetTask:
eb_1403834780683_0445_000004,container_1403834780683_0445_01_001568
2014-06-27 02:13:12,633 INFO: org.apache.tajo.master.querymaster.SubQuery
(transition(1070)) - [eb_1403834780683_0445_000004] Task Completion Event
(Total: 1, Success: 1, Killed: 0, Failed: 0)
2014-06-27 02:13:12,633 INFO: org.apache.tajo.master.querymaster.SubQuery
(transition(1110)) - subQuery completed - eb_1403834780683_0445_000004
(total=1, success=1, killed=0)
2014-06-27 02:13:12,634 INFO: org.apache.tajo.master.DefaultTaskScheduler
(run(102)) - TaskScheduler schedulingThread stopped
2014-06-27 02:13:12,634 INFO: org.apache.tajo.master.DefaultTaskScheduler
(stop(143)) - Task Scheduler stopped
2014-06-27 02:13:12,634 INFO: org.apache.tajo.worker.TaskRunner (run(376)) -
Received ShouldDie
flag:eb_1403834780683_0445_000004,container_1403834780683_0445_01_001568
2014-06-27 02:13:12,634 INFO: org.apache.tajo.worker.TaskRunner (stop(239)) -
Stop TaskRunner: eb_1403834780683_0445_000004
2014-06-27 02:13:12,634 INFO: org.apache.tajo.master.querymaster.Query
(handle(688)) - Processing q_1403834780683_0445 of type SUBQUERY_COMPLETED
2014-06-27 02:13:12,634 INFO: org.apache.tajo.worker.TaskRunnerManager
(stopTask(89)) - Stop
Task:eb_1403834780683_0445_000004,container_1403834780683_0445_01_001568
2014-06-27 02:13:12,634 INFO: org.apache.tajo.master.querymaster.Query
(handle(688)) - Processing q_1403834780683_0445 of type QUERY_COMPLETED
2014-06-27 02:13:12,635 INFO:
org.apache.tajo.master.rm.TajoWorkerResourceManager
(releaseWorkerResource(518)) - Release Resource: 0.5,512
2014-06-27 02:13:12,636 INFO: org.apache.tajo.master.querymaster.Query
(handle(705)) - q_1403834780683_0445 Query Transitioned from QUERY_RUNNING to
QUERY_SUCCEEDED
2014-06-27 02:13:12,636 INFO:
org.apache.tajo.master.querymaster.QueryMasterTask (handle(297)) - Query
completion notified from q_1403834780683_0445
2014-06-27 02:13:12,636 INFO:
org.apache.tajo.master.querymaster.QueryMasterTask (handle(308)) - Query final
state: QUERY_SUCCEEDED
2014-06-27 02:13:12,636 INFO:
org.apache.tajo.master.querymaster.QueryMasterTask (stop(187)) - Stopping
QueryMasterTask:q_1403834780683_0445
2014-06-27 02:13:12,637 INFO:
org.apache.tajo.master.querymaster.QueryInProgress (heartbeat(265)) - Received
QueryMaster heartbeat:q_1403834780683_0445,state=QUERY_SUCCEEDED,progress=1.0,
queryMaster=asf011.sp2.ygridcore.net
2014-06-27 02:13:12,637 INFO:
org.apache.tajo.master.querymaster.QueryJobManager (stopQuery(203)) - Stop
QueryInProgress:q_1403834780683_0445
2014-06-27 02:13:12,637 INFO:
org.apache.tajo.master.querymaster.QueryInProgress (stop(116)) -
=========================================================
2014-06-27 02:13:12,637 INFO:
org.apache.tajo.master.querymaster.QueryInProgress (stop(117)) - Stop
query:q_1403834780683_0445
2014-06-27 02:13:12,637 WARN: org.apache.tajo.master.TajoAsyncDispatcher
(stop(115)) - Interrupted Exception while stopping
2014-06-27 02:13:12,637 INFO:
org.apache.tajo.master.rm.TajoWorkerResourceManager
(releaseWorkerResource(518)) - Release Resource: 0.0,512
2014-06-27 02:13:12,637 INFO: org.apache.tajo.master.TajoAsyncDispatcher
(stop(122)) - AsyncDispatcher stopped:q_1403834780683_0445
2014-06-27 02:13:12,637 INFO:
org.apache.tajo.master.rm.TajoWorkerResourceManager (stopQueryMaster(540)) -
Released QueryMaster (q_1403834780683_0445) resource.
2014-06-27 02:13:12,638 INFO:
org.apache.tajo.master.querymaster.QueryInProgress (stop(125)) -
q_1403834780683_0445 QueryMaster stopped
2014-06-27 02:13:12,638 INFO:
org.apache.tajo.master.querymaster.QueryMasterTask (stop(217)) - Stopped
QueryMasterTask:q_1403834780683_0445
2014-06-27 02:13:12,638 INFO: org.apache.tajo.master.querymaster.QueryMaster
(cleanup(166)) - cleanup query resources : q_1403834780683_0445
2014-06-27 02:13:12,638 WARN: org.apache.tajo.master.TajoAsyncDispatcher
(stop(115)) - Interrupted Exception while stopping
2014-06-27 02:13:12,638 INFO: org.apache.tajo.master.TajoAsyncDispatcher
(stop(122)) - AsyncDispatcher stopped:QueryInProgress:q_1403834780683_0445
2014-06-27 02:13:13,007 INFO: org.apache.tajo.worker.TajoWorkerClientService
(closeQuery(231)) - Stop Query:q_1403834780683_0445
2014-06-27 02:13:13,008 INFO: org.apache.tajo.master.session.SessionManager
(removeSession(80)) - Session c362e249-8308-4f32-9360-e6d5a3325b0a is removed.
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.924 sec
2014-06-27 02:13:13,014 INFO: org.apache.tajo.worker.TajoWorker (run(492)) -
============================================
2014-06-27 02:13:13,014 INFO: org.apache.tajo.worker.TajoWorker (run(493)) -
TajoWorker received SIGINT Signal
2014-06-27 02:13:13,014 INFO: org.apache.tajo.worker.TajoWorker (run(494)) -
============================================
2014-06-27 02:13:13,019 ERROR: org.apache.tajo.rpc.RpcProtos
(exceptionCaught(225)) - RPC Exception:Worker has already been shutdown
2014-06-27 02:13:13,019 ERROR: org.apache.tajo.client.TajoClient (close(141)) -
java.io.IOException: Connect error to localhost/127.0.0.1:20453 cause
java.util.concurrent.RejectedExecutionException: Worker has already been
shutdown
2014-06-27 02:13:13,019 ERROR: org.apache.tajo.rpc.RpcProtos
(exceptionCaught(225)) - RPC Exception:Worker has already been shutdown
2014-06-27 02:13:13,020 ERROR: org.apache.tajo.client.TajoClient (close(141)) -
java.io.IOException: Connect error to localhost/127.0.0.1:20453 cause
java.util.concurrent.RejectedExecutionException: Worker has already been
shutdown
2014-06-27 02:13:13,021 ERROR: org.apache.tajo.rpc.RpcProtos
(exceptionCaught(225)) - RPC Exception:Worker has already been shutdown
2014-06-27 02:13:13,021 ERROR: org.apache.tajo.client.TajoClient (close(141)) -
java.io.IOException: Connect error to localhost/127.0.0.1:20453 cause
java.util.concurrent.RejectedExecutionException: Worker has already been
shutdown
2014-06-27 02:13:13,021 ERROR: org.apache.tajo.rpc.RpcProtos
(exceptionCaught(225)) - RPC Exception:Worker has already been shutdown
2014-06-27 02:13:13,021 INFO: org.apache.tajo.master.session.SessionManager
(removeSession(80)) - Session fac9ec9f-7a47-4e8a-84e3-c4813abf29d3 is removed.
2014-06-27 02:13:13,021 ERROR: org.apache.tajo.rpc.RpcProtos
(exceptionCaught(225)) - RPC Exception:Worker has already been shutdown
2014-06-27 02:13:13,022 ERROR: org.apache.tajo.rpc.RpcProtos
(exceptionCaught(225)) - RPC Exception:Worker has already been shutdown
2014-06-27 02:13:13,021 ERROR: org.apache.tajo.rpc.RpcProtos
(exceptionCaught(225)) - RPC Exception:Worker has already been shutdown
2014-06-27 02:13:13,021 ERROR: org.apache.tajo.client.TajoClient (close(141)) -
java.io.IOException: Connect error to localhost/127.0.0.1:20453 cause
java.util.concurrent.RejectedExecutionException: Worker has already been
shutdown
2014-06-27 02:13:13,022 ERROR: org.apache.tajo.client.TajoClient (close(141)) -
java.io.IOException: Connect error to localhost/127.0.0.1:20453 cause
java.util.concurrent.RejectedExecutionException: Worker has already been
shutdown
2014-06-27 02:13:13,022 ERROR: org.apache.tajo.client.TajoClient (close(141)) -
java.io.IOException: Connect error to localhost/127.0.0.1:20453 cause
java.util.concurrent.RejectedExecutionException: Worker has already been
shutdown
2014-06-27 02:13:13,022 INFO: org.apache.tajo.master.session.SessionManager
(removeSession(80)) - Session f6e06348-d7a5-4665-a71a-a4c49985aca9 is removed.
2014-06-27 02:13:13,022 ERROR: org.apache.tajo.client.TajoClient (close(141)) -
java.io.IOException: Connect error to localhost/127.0.0.1:20453 cause
java.util.concurrent.RejectedExecutionException: Worker has already been
shutdown
2014-06-27 02:13:13,028 INFO: org.apache.tajo.worker.WorkerHeartbeatService
(run(260)) - Worker Resource Heartbeat Thread stopped.
2014-06-27 02:13:13,054 INFO: org.apache.tajo.rpc.NettyServerBase
(shutdown(128)) - Rpc (TajoWorkerProtocol) listened on 0:0:0:0:0:0:0:0:20457)
shutdown
2014-06-27 02:13:13,055 INFO: org.apache.tajo.worker.TajoWorkerManagerService
(stop(95)) - TajoWorkerManagerService stopped
2014-06-27 02:13:13,056 INFO: org.apache.tajo.rpc.NettyServerBase
(shutdown(128)) - Rpc (QueryMasterProtocol) listened on 0:0:0:0:0:0:0:0:20456)
shutdown
2014-06-27 02:13:13,056 INFO:
org.apache.tajo.master.querymaster.QueryMasterManagerService (stop(111)) -
QueryMasterManagerService stopped
2014-06-27 02:13:13,057 INFO: org.apache.tajo.master.querymaster.QueryMaster
(run(433)) - QueryMaster heartbeat thread stopped
2014-06-27 02:13:13,057 INFO: org.apache.tajo.master.TajoAsyncDispatcher
(stop(122)) - AsyncDispatcher stopped:querymaster_1403834781283
2014-06-27 02:13:13,057 INFO: org.apache.tajo.master.querymaster.QueryMaster
(stop(159)) - QueryMaster stop
2014-06-27 02:13:13,057 INFO: org.apache.tajo.worker.TajoWorkerClientService
(stop(110)) - TajoWorkerClientService stopping
2014-06-27 02:13:13,058 INFO: org.apache.tajo.rpc.NettyServerBase
(shutdown(128)) - Rpc (QueryMasterClientProtocol) listened on
0:0:0:0:0:0:0:0:20455) shutdown
2014-06-27 02:13:13,059 INFO: org.apache.tajo.worker.TajoWorkerClientService
(stop(114)) - TajoWorkerClientService stopped
2014-06-27 02:13:13,059 INFO: org.apache.tajo.worker.TajoWorker (stop(334)) -
TajoWorker main thread exiting
Results :
Failed tests: testTaskHistory(org.apache.tajo.worker.TestHistory):
expected:<TA_SUCCEEDED> but was:<TA_KILLED>
Tests run: 851, Failures: 1, Errors: 0, Skipped: 0
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Tajo Main ......................................... SUCCESS [36.227s]
[INFO] Tajo Project POM .................................. SUCCESS [1.542s]
[INFO] Tajo Maven Plugins ................................ SUCCESS [4.046s]
[INFO] Tajo Common ....................................... SUCCESS [56.246s]
[INFO] Tajo Algebra ...................................... SUCCESS [2.202s]
[INFO] Tajo Catalog Common ............................... SUCCESS [5.629s]
[INFO] Tajo Rpc .......................................... SUCCESS [21.757s]
[INFO] Tajo Catalog Client ............................... SUCCESS [1.090s]
[INFO] Tajo Catalog Server ............................... SUCCESS [7.770s]
[INFO] Tajo Storage ...................................... SUCCESS [58.300s]
[INFO] Tajo Core PullServer .............................. SUCCESS [1.289s]
[INFO] Tajo Client ....................................... SUCCESS [3.875s]
[INFO] Tajo JDBC Driver .................................. SUCCESS [1.256s]
[INFO] Tajo Catalog Drivers HCatalog ..................... SUCCESS [14.555s]
[INFO] Tajo Core ......................................... FAILURE [7:25.003s]
[INFO] Tajo Catalog Drivers .............................. SKIPPED
[INFO] Tajo Catalog ...................................... SKIPPED
[INFO] Tajo Distribution ................................. SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 11:01.940s
[INFO] Finished at: Fri Jun 27 02:13:13 UTC 2014
[INFO] Final Memory: 52M/388M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-surefire-plugin:2.12.4:test (default-test) on
project tajo-core: There are test failures.
[ERROR]
[ERROR] Please refer to
<https://builds.apache.org/job/Tajo-master-nightly/ws/tajo-core/target/surefire-reports>
for the individual test results.
[ERROR] -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please
read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :tajo-core
Build step 'Execute shell' marked build as failure
Recording test results
