See <https://builds.apache.org/job/Tajo-master-build/790/changes>
Changes: [hyunsik] TAJO-1737: Implement SQL Parser rule for Map type. [hyunsik] TAJO-1723: INSERT INTO statement should allow nested fields as target columns. ------------------------------------------ [...truncated 674650 lines...] 2015-08-04 09:35:52,971 INFO: org.apache.tajo.querymaster.Repartitioner (scheduleHashShuffledFetches(866)) - eb_1438679719788_1979_000002, ScheduleHashShuffledFetches - Max num=1, finalFetchURI=1 2015-08-04 09:35:52,972 INFO: org.apache.tajo.querymaster.Repartitioner (scheduleHashShuffledFetches(886)) - eb_1438679719788_1979_000002, DeterminedTaskNum : 1 2015-08-04 09:35:52,972 INFO: org.apache.tajo.querymaster.Stage (run(833)) - 1 objects are scheduled 2015-08-04 09:35:52,972 INFO: org.apache.tajo.querymaster.DefaultTaskScheduler (start(104)) - Start TaskScheduler 2015-08-04 09:35:52,974 INFO: org.apache.tajo.worker.TaskManager (createExecutionBlock(112)) - QueryMaster Address:asf901.gq1.ygridcore.net:35991 2015-08-04 09:35:52,976 INFO: org.apache.tajo.worker.ExecutionBlockContext (init(119)) - Tajo Root Dir: hdfs://localhost:33196/tajo 2015-08-04 09:35:52,976 INFO: org.apache.tajo.worker.ExecutionBlockContext (init(120)) - Worker Local Dir: file://<https://builds.apache.org/job/Tajo-master-build/ws/tajo-core/target/test-data/89dbab43-4d28-4c11-9e75-3b8f2e4b4d27/tajo-localdir> 2015-08-04 09:35:52,976 INFO: org.apache.tajo.worker.TaskManager (handle(182)) - Running ExecutionBlocks: 1, running tasks:0, availableResource: (Memory:1000, Disks:3, vCores:2) 2015-08-04 09:35:52,977 INFO: org.apache.tajo.worker.TaskImpl (<init>(114)) - Task basedir is created (<https://builds.apache.org/job/Tajo-master-build/ws/tajo-core/target/test-data/89dbab43-4d28-4c11-9e75-3b8f2e4b4d27/tajo-localdir/q_1438679719788_1979/output/2)> 2015-08-04 09:35:52,977 INFO: org.apache.tajo.worker.TaskAttemptContext (setState(142)) - Query status of ta_1438679719788_1979_000002_000000_00 is changed to TA_PENDING 2015-08-04 09:35:52,977 INFO: org.apache.tajo.worker.TaskImpl (init(195)) - Initializing: ta_1438679719788_1979_000002_000000_00 2015-08-04 09:35:52,977 INFO: org.apache.tajo.storage.FileTablespace (getAppenderFilePath(310)) - Output File Path: hdfs://localhost:33196/tmp/tajo-jenkins/staging/q_1438679719788_1979/RESULT/part-02-000000-000 2015-08-04 09:35:52,977 INFO: org.apache.tajo.worker.TaskImpl (initPlan(145)) - Output File Path: hdfs://localhost:33196/tmp/tajo-jenkins/staging/q_1438679719788_1979/RESULT/part-02-000000-000 2015-08-04 09:35:52,978 INFO: org.apache.tajo.worker.TaskImpl (initPlan(150)) - ================================== 2015-08-04 09:35:52,978 INFO: org.apache.tajo.worker.TaskImpl (initPlan(151)) - * Stage ta_1438679719788_1979_000002_000000_00 is initialized 2015-08-04 09:35:52,978 INFO: org.apache.tajo.worker.TaskImpl (initPlan(152)) - * InterQuery: false, Fragments (num: 1), Fetches (total:1) : 2015-08-04 09:35:52,978 INFO: org.apache.tajo.worker.TaskImpl (initPlan(162)) - * Local task dir: <https://builds.apache.org/job/Tajo-master-build/ws/tajo-core/target/test-data/89dbab43-4d28-4c11-9e75-3b8f2e4b4d27/tajo-localdir/q_1438679719788_1979/output/2/0_0> 2015-08-04 09:35:52,978 INFO: org.apache.tajo.worker.TaskImpl (initPlan(167)) - ================================== 2015-08-04 09:35:52,979 INFO: org.apache.tajo.worker.TaskImpl (init(214)) - the directory is created <https://builds.apache.org/job/Tajo-master-build/ws/tajo-core/target/test-data/89dbab43-4d28-4c11-9e75-3b8f2e4b4d27/tajo-localdir/q_1438679719788_1979/in/eb_1438679719788_1979_000002/0/0/eb_1438679719788_1979_000001> 2015-08-04 09:35:52,980 INFO: org.apache.tajo.worker.TaskImpl (getFetchRunners(692)) - Try to get local file chunk at local host 2015-08-04 09:35:52,980 INFO: org.apache.tajo.worker.TaskImpl (getLocalStoredFileChunk(734)) - getLocalStoredFileChunk starts 2015-08-04 09:35:52,980 INFO: org.apache.tajo.worker.TaskImpl (getLocalStoredFileChunk(769)) - PullServer request param: shuffleType=h, sid=1, partId=0, taskIds=null 2015-08-04 09:35:52,981 INFO: org.apache.tajo.worker.TaskImpl (getFetchRunners(720)) - Create a new Fetcher with storeChunk: (start=0, length=24, fromRemote=false, ebId=eb_1438679719788_1979_000001) <https://builds.apache.org/job/Tajo-master-build/ws/tajo-core/target/test-data/89dbab43-4d28-4c11-9e75-3b8f2e4b4d27/tajo-localdir/q_1438679719788_1979/output/1/hash-shuffle/0/0> 2015-08-04 09:35:52,981 INFO: org.apache.tajo.worker.TaskAttemptContext (setState(142)) - Query status of ta_1438679719788_1979_000002_000000_00 is changed to TA_RUNNING 2015-08-04 09:35:52,981 INFO: org.apache.tajo.worker.Fetcher (get(128)) - Get pseudo fetch from local host 2015-08-04 09:35:52,981 INFO: org.apache.tajo.worker.TaskImpl (run(616)) - Add a new FileChunk to local chunk list 2015-08-04 09:35:52,982 INFO: org.apache.tajo.worker.TaskImpl (waitForFetch(362)) - ta_1438679719788_1979_000002_000000_00 All fetches are done! 2015-08-04 09:35:52,982 INFO: org.apache.tajo.worker.TaskImpl (localizeFetchedData(572)) - One local chunk is added to listTablets 2015-08-04 09:35:52,982 INFO: org.apache.tajo.engine.planner.PhysicalPlannerImpl (createBestAggregationPlan(1031)) - Aggregation:estimatedSize=24, threshold=268435456 2015-08-04 09:35:52,983 INFO: org.apache.tajo.engine.planner.PhysicalPlannerImpl (createBestAggregationPlan(1033)) - The planner chooses [Hash Aggregation] 2015-08-04 09:35:52,983 INFO: org.apache.tajo.engine.planner.PhysicalPlannerImpl (createInMemoryHashAggregation(975)) - The planner chooses [Hash Aggregation] 2015-08-04 09:35:52,990 INFO: BlockStateChange (logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:54529 is added to blk_1073748253_7429{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-cdc28f6e-9116-4b1a-8641-ee086055a716:NORMAL:127.0.0.1:54529|RBW]]} size 0 2015-08-04 09:35:52,990 INFO: org.apache.tajo.worker.TaskAttemptContext (setState(142)) - Query status of ta_1438679719788_1979_000002_000000_00 is changed to TA_SUCCEEDED 2015-08-04 09:35:52,991 INFO: org.apache.tajo.worker.TaskImpl (run(460)) - ta_1438679719788_1979_000002_000000_00 completed. Worker's task counter - total:1, succeeded: 1, killed: 0, failed: 0 2015-08-04 09:35:52,991 INFO: org.apache.tajo.querymaster.Stage (transition(1297)) - Stage - eb_1438679719788_1979_000002 finalize NONE_SHUFFLE (total=1, success=1, killed=0) 2015-08-04 09:35:52,991 INFO: org.apache.tajo.querymaster.DefaultTaskScheduler (stop(158)) - Task Scheduler stopped 2015-08-04 09:35:52,991 INFO: org.apache.tajo.querymaster.DefaultTaskScheduler (run(139)) - TaskScheduler schedulingThread stopped 2015-08-04 09:35:52,991 INFO: org.apache.tajo.querymaster.Stage (transition(1355)) - Stage completed - eb_1438679719788_1979_000002 (total=1, success=1, killed=0) 2015-08-04 09:35:52,992 INFO: org.apache.tajo.querymaster.Query (handle(860)) - Processing q_1438679719788_1979 of type STAGE_COMPLETED 2015-08-04 09:35:52,992 INFO: org.apache.tajo.engine.planner.global.ParallelExecutionQueue (next(95)) - Next executable block eb_1438679719788_1979_000003 2015-08-04 09:35:52,992 INFO: org.apache.tajo.worker.TaskManager (stopExecutionBlock(161)) - Stopped execution block:eb_1438679719788_1979_000002 2015-08-04 09:35:52,992 INFO: org.apache.tajo.querymaster.Query (transition(807)) - Complete Stage[eb_1438679719788_1979_000002], State: SUCCEEDED, 2/2. 2015-08-04 09:35:52,992 INFO: org.apache.tajo.querymaster.Query (handle(860)) - Processing q_1438679719788_1979 of type QUERY_COMPLETED 2015-08-04 09:35:52,993 INFO: org.apache.tajo.querymaster.Query (finalizeQuery(532)) - Can't find partitions for adding. 2015-08-04 09:35:52,993 INFO: org.apache.tajo.querymaster.Query (handle(878)) - q_1438679719788_1979 Query Transitioned from QUERY_RUNNING to QUERY_SUCCEEDED 2015-08-04 09:35:52,993 INFO: org.apache.tajo.querymaster.QueryMasterTask (handle(294)) - Query completion notified from q_1438679719788_1979 final state: QUERY_SUCCEEDED 2015-08-04 09:35:52,993 INFO: org.apache.tajo.master.QueryInProgress (heartbeat(252)) - Received QueryMaster heartbeat:q_1438679719788_1979,state=QUERY_SUCCEEDED,progress=1.0, queryMaster=asf901.gq1.ygridcore.net 2015-08-04 09:35:52,994 INFO: org.apache.tajo.master.QueryManager (stopQuery(275)) - Stop QueryInProgress:q_1438679719788_1979 2015-08-04 09:35:52,994 INFO: org.apache.tajo.master.QueryInProgress (stopProgress(117)) - ========================================================= 2015-08-04 09:35:52,994 INFO: org.apache.tajo.querymaster.QueryMasterTask (serviceStop(171)) - Stopping QueryMasterTask:q_1438679719788_1979 2015-08-04 09:35:52,994 INFO: org.apache.tajo.master.QueryInProgress (stopProgress(118)) - Stop query:q_1438679719788_1979 2015-08-04 09:35:52,994 INFO: org.apache.tajo.querymaster.QueryMasterTask (cleanupQuery(470)) - Cleanup resources of all workers. Query: q_1438679719788_1979, workers: 1 2015-08-04 09:35:52,994 INFO: org.apache.tajo.querymaster.QueryMasterTask (serviceStop(187)) - Stopped QueryMasterTask:q_1438679719788_1979 2015-08-04 09:35:52,995 INFO: org.apache.tajo.session.SessionManager (removeSession(86)) - Session e37f00ad-ca60-469b-bf4e-f56193c00fcb is removed. Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.327 sec - in org.apache.tajo.querymaster.TestQueryProgress Running org.apache.tajo.TestQueryIdFactory Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec - in org.apache.tajo.TestQueryIdFactory Running org.apache.tajo.resource.TestResources Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in org.apache.tajo.resource.TestResources 2015-08-04 09:35:53,004 INFO: org.apache.tajo.master.TajoMaster (run(534)) - ============================================ 2015-08-04 09:35:53,010 INFO: org.apache.tajo.master.TajoMaster (run(535)) - TajoMaster received SIGINT Signal 2015-08-04 09:35:53,010 INFO: org.apache.tajo.session.SessionManager (removeSession(86)) - Session dca45380-932e-4e83-aa06-2b65f916770d is removed. 2015-08-04 09:35:53,010 INFO: org.apache.tajo.session.SessionManager (removeSession(86)) - Session 0ccba45d-90b4-4870-a96b-040e7a4b4ca8 is removed. 2015-08-04 09:35:53,010 INFO: org.apache.tajo.master.TajoMaster (run(536)) - ============================================ 2015-08-04 09:35:53,015 INFO: org.mortbay.log (info(67)) - Shutdown hook executing 2015-08-04 09:35:53,011 INFO: org.apache.tajo.worker.TajoWorker (run(567)) - ============================================ 2015-08-04 09:35:53,016 INFO: org.mortbay.log (info(67)) - Shutdown hook complete 2015-08-04 09:35:53,016 INFO: org.apache.tajo.worker.TajoWorker (run(568)) - TajoWorker received SIGINT Signal 2015-08-04 09:35:53,016 INFO: org.apache.tajo.worker.TajoWorker (run(569)) - ============================================ 2015-08-04 09:35:53,016 INFO: org.apache.tajo.rpc.NettyServerBase (shutdown(173)) - Rpc (Tajo-REST) listened on 0:0:0:0:0:0:0:0:35988) shutdown 2015-08-04 09:35:53,018 INFO: org.apache.tajo.util.history.HistoryWriter (run(268)) - HistoryWriter_asf901.gq1.ygridcore.net_35989 stopped. 2015-08-04 09:35:53,018 INFO: org.apache.tajo.util.history.HistoryCleaner (run(136)) - History cleaner stopped 2015-08-04 09:35:53,018 INFO: org.apache.tajo.ws.rs.TajoRestService (serviceStop(129)) - Tajo Rest Service stopped. 2015-08-04 09:35:53,019 INFO: org.apache.tajo.catalog.CatalogServer (serviceStop(193)) - Catalog Server (127.0.0.1:35985) shutdown 2015-08-04 09:35:53,019 INFO: org.apache.tajo.rpc.NettyServerBase (shutdown(173)) - Rpc (CatalogProtocol) listened on 127.0.0.1:35985) shutdown 2015-08-04 09:35:53,021 INFO: org.apache.tajo.util.history.HistoryWriter (run(268)) - HistoryWriter_127.0.0.1_35987 stopped. 2015-08-04 09:35:53,025 INFO: BlockStateChange (logAddStoredBlock(2473)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:54529 is added to blk_1073741834_1010{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-907a773a-528a-413b-87b5-7515433d0d7d:NORMAL:127.0.0.1:54529|RBW]]} size 524 2015-08-04 09:35:53,025 INFO: org.apache.tajo.util.history.HistoryCleaner (run(136)) - History cleaner stopped 2015-08-04 09:35:53,026 INFO: org.apache.tajo.rpc.NettyServerBase (shutdown(173)) - Rpc (QueryCoordinatorProtocol) listened on 127.0.0.1:35987) shutdown 2015-08-04 09:35:53,026 INFO: org.apache.tajo.rpc.NettyServerBase (shutdown(173)) - Rpc (TajoMasterClientProtocol) listened on 127.0.0.1:35986) shutdown 2015-08-04 09:35:53,029 INFO: org.apache.tajo.rpc.NettyServerBase (shutdown(173)) - Rpc (TajoResourceTrackerProtocol) listened on 127.0.0.1:35984) shutdown 2015-08-04 09:35:53,029 INFO: org.apache.tajo.master.TajoMaster (serviceStop(402)) - Tajo Master main thread exiting 2015-08-04 09:35:53,085 INFO: org.apache.tajo.worker.NodeStatusUpdater (serviceStop(111)) - NodeStatusUpdater stopped. 2015-08-04 09:35:53,085 INFO: org.apache.tajo.worker.NodeStatusUpdater (run(262)) - Heartbeat Thread stopped. 2015-08-04 09:35:53,086 INFO: org.apache.tajo.rpc.NettyServerBase (shutdown(173)) - Rpc (QueryMasterProtocol) listened on 0:0:0:0:0:0:0:0:35991) shutdown 2015-08-04 09:35:53,086 INFO: org.apache.tajo.querymaster.QueryMasterManagerService (serviceStop(106)) - QueryMasterManagerService stopped 2015-08-04 09:35:53,087 INFO: org.apache.tajo.querymaster.QueryMaster (run(417)) - QueryMaster heartbeat thread stopped 2015-08-04 09:35:53,088 INFO: org.apache.tajo.querymaster.QueryMaster (serviceStop(168)) - QueryMaster stopped 2015-08-04 09:35:53,088 INFO: org.apache.tajo.worker.TajoWorkerClientService (stop(99)) - TajoWorkerClientService stopping 2015-08-04 09:35:53,090 INFO: org.apache.tajo.rpc.NettyServerBase (shutdown(173)) - Rpc (QueryMasterClientProtocol) listened on 0:0:0:0:0:0:0:0:35990) shutdown 2015-08-04 09:35:53,090 INFO: org.apache.tajo.worker.TajoWorkerClientService (stop(103)) - TajoWorkerClientService stopped 2015-08-04 09:35:53,090 INFO: org.apache.tajo.rpc.NettyServerBase (shutdown(173)) - Rpc (TajoWorkerProtocol) listened on 0:0:0:0:0:0:0:0:35989) shutdown 2015-08-04 09:35:53,090 INFO: org.apache.tajo.worker.TajoWorkerManagerService (serviceStop(93)) - TajoWorkerManagerService stopped 2015-08-04 09:35:53,091 INFO: org.apache.tajo.worker.TajoWorker (serviceStop(377)) - TajoWorker main thread exiting Results : Failed tests: TestSQLAnalyzer.testCreateTableWithNested1:797->assertParseResult:58 expected:<...D", "Record": [[ { "ColumnDefName": "d", "DataTypeName": "TEXT", "OpType": "DataType" }, { "ColumnDefName": "e", "DataTypeName": "INT8", "OpType": "DataType" } ]], "OpType": "D...> but was:<...D", "Record": [{ "Schema": [ { "ColumnDefName": "d", "DataTypeName": "TEXT", "OpType": "DataType" }, { "ColumnDefName": "e", "DataTypeName": "INT8", "OpType": "DataType" } ] }], "OpType": "D...> TestSQLAnalyzer.testCreateTableWithNested2:802->assertParseResult:58 expected:<...D", "Record": [[ { "ColumnDefName": "d", "DataTypeName": "TEXT", "OpType": "DataType" }, { "ColumnDefName": "e", "DataTypeName": "INT8", "OpType": "DataType" }, { "ColumnDefName": "f", "DataTypeName": "RECORD", "Record": [ { "ColumnDefName": "g", "DataTypeName": "INT1", "OpType": "DataType" }, { "ColumnDefName": "h", "DataTypeName": "FLOAT4", "OpType": "DataType" } ], "OpType": "DataType" } ]], "OpType": "D...> but was:<...D", "Record": [{ "Schema": [ { "ColumnDefName": "d", "DataTypeName": "TEXT", "OpType": "DataType" }, { "ColumnDefName": "e", "DataTypeName": "INT8", "OpType": "DataType" }, { "ColumnDefName": "f", "DataTypeName": "RECORD", "Record": { "Schema": [ { "ColumnDefName": "g", "DataTypeName": "INT1", "OpType": "DataType" }, { "ColumnDefName": "h", "DataTypeName": "FLOAT4", "OpType": "DataType" } ] }, "OpType": "DataType" } ] }], "OpType": "D...> Tests run: 1594, Failures: 2, Errors: 0, Skipped: 0 [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] Tajo Main ......................................... SUCCESS [ 1.556 s] [INFO] Tajo Project POM .................................. SUCCESS [ 1.100 s] [INFO] Tajo Maven Plugins ................................ SUCCESS [ 2.665 s] [INFO] Tajo Common ....................................... SUCCESS [ 28.894 s] [INFO] Tajo Algebra ...................................... SUCCESS [ 1.362 s] [INFO] Tajo Catalog Common ............................... SUCCESS [ 4.663 s] [INFO] Tajo Plan ......................................... SUCCESS [ 5.054 s] [INFO] Tajo Rpc Common ................................... SUCCESS [ 0.366 s] [INFO] Tajo Protocol Buffer Rpc .......................... SUCCESS [ 48.070 s] [INFO] Tajo Catalog Client ............................... SUCCESS [ 1.285 s] [INFO] Tajo Catalog Server ............................... SUCCESS [ 10.191 s] [INFO] Tajo Storage Common ............................... SUCCESS [ 10.049 s] [INFO] Tajo HDFS Storage ................................. SUCCESS [01:04 min] [INFO] Tajo HBase Storage ................................ SUCCESS [ 4.088 s] [INFO] Tajo PullServer ................................... SUCCESS [ 1.021 s] [INFO] Tajo Client ....................................... SUCCESS [ 1.906 s] [INFO] Tajo CLI tools .................................... SUCCESS [ 1.209 s] [INFO] Tajo JDBC Driver .................................. SUCCESS [ 3.174 s] [INFO] ASM (thirdparty) .................................. SUCCESS [ 0.691 s] [INFO] Tajo RESTful Container ............................ SUCCESS [ 3.031 s] [INFO] Tajo Metrics ...................................... SUCCESS [ 0.907 s] [INFO] Tajo Core ......................................... FAILURE [21:03 min] [INFO] Tajo RPC .......................................... SKIPPED [INFO] Tajo Catalog Drivers Hive ......................... SKIPPED [INFO] Tajo Catalog Drivers .............................. SKIPPED [INFO] Tajo Catalog ...................................... SKIPPED [INFO] Tajo Storage ...................................... SKIPPED [INFO] Tajo Distribution ................................. SKIPPED [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 24:19 min [INFO] Finished at: 2015-08-04T09:35:54+00:00 [INFO] Final Memory: 64M/455M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.17:test (default-test) on project tajo-core: There are test failures. [ERROR] [ERROR] Please refer to <https://builds.apache.org/job/Tajo-master-build/ws/tajo-core/target/surefire-reports> for the individual test results. [ERROR] -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn <goals> -rf :tajo-core Build step 'Execute shell' marked build as failure Updating TAJO-1737 Updating TAJO-1723
