Juan Yu created IMPALA-6026: ------------------------------- Summary: Refresh table failed with "UnsupportedOperationException: null" Key: IMPALA-6026 URL: https://issues.apache.org/jira/browse/IMPALA-6026 Project: IMPALA Issue Type: Bug Components: Catalog Affects Versions: Impala 2.9.0 Reporter: Juan Yu
Invalidate metadata ts_part_200; then refresh ts_part_200; it failed with following error. The table has ~1.8K partitions, one file per partition. and it's an s3 table. Note that each partition is under a different location, not all under the same directory. {code} I1006 20:05:57.034777 20373 TableLoader.java:97] Loaded metadata for: default.ts_part_200 I1006 20:05:57.035403 6470 jni-util.cc:176] org.apache.impala.catalog.TableLoadingException: Failed to load metadata for table: ts_part_200 at org.apache.impala.catalog.HdfsTable.load(HdfsTable.java:1091) at org.apache.impala.catalog.HdfsTable.load(HdfsTable.java:1019) at org.apache.impala.catalog.TableLoader.load(TableLoader.java:80) at org.apache.impala.catalog.TableLoadingMgr$2.call(TableLoadingMgr.java:237) at org.apache.impala.catalog.TableLoadingMgr$2.call(TableLoadingMgr.java:234) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) Caused by: java.lang.UnsupportedOperationException at com.google.common.collect.ImmutableCollection.add(ImmutableCollection.java:91) at org.apache.impala.catalog.HdfsTable.synthesizeBlockMetadata(HdfsTable.java:386) at org.apache.impala.catalog.HdfsTable.loadBlockMetadata(HdfsTable.java:297) at org.apache.impala.catalog.HdfsTable.loadMetadataAndDiskIds(HdfsTable.java:771) at org.apache.impala.catalog.HdfsTable.loadAllPartitions(HdfsTable.java:689) at org.apache.impala.catalog.HdfsTable.load(HdfsTable.java:1082) ... 8 more I1006 20:05:57.037637 6470 status.cc:122] TableLoadingException: Failed to load metadata for table: ts_part_200 CAUSED BY: UnsupportedOperationException: null @ 0x83d879 impala::Status::Status() @ 0xb98610 impala::JniUtil::GetJniExceptionMsg() @ 0x8302eb impala::Catalog::ResetMetadata() @ 0x82366b CatalogServiceThriftIf::ResetMetadata() @ 0x8f69dd impala::CatalogServiceProcessor::process_ResetMetadata() @ 0x8f2b39 impala::CatalogServiceProcessor::dispatchCall() @ 0x80e08c apache::thrift::TDispatchProcessor::process() @ 0xa0124f apache::thrift::server::TAcceptQueueServer::Task::run() @ 0x9fb939 impala::ThriftThread::RunRunnable() @ 0x9fc392 boost::detail::function::void_function_obj_invoker0<>::invoke() @ 0xbef309 impala::Thread::SuperviseThread() @ 0xbefcc4 boost::detail::thread_data<>::run() @ 0xe5810a (unknown) @ 0x30e5c07aa1 (unknown) @ 0x30e58e8bcd (unknown) E1006 20:05:57.037645 6470 catalog-server.cc:82] TableLoadingException: Failed to load metadata for table: ts_part_200 CAUSED BY: UnsupportedOperationException: null I1006 20:05:57.041628 6470 catalog-server.cc:86] ResetMetadata(): response=TResetMetadataResponse { 01: result (struct) = TCatalogUpdateResult { 01: catalog_service_id (struct) = TUniqueId { 01: hi (i64) = 0, 02: lo (i64) = 0, }, 02: version (i64) = 0, 03: status (struct) = TStatus { 01: status_code (i32) = 2, 02: error_msgs (list) = list<string>[1] { [0] = "TableLoadingException: Failed to load metadata for table: ts_part_200\nCAUSED BY: UnsupportedOperationException: null", }, }, }, } I1006 20:05:57.041652 6470 rpc-trace.cc:200] RPC call: catalog-server:CatalogService.ResetMetadata from 10.0.0.240:55490 took 30s715ms I1006 20:05:57.346750 4595 rpc-trace.cc:190] RPC call: StatestoreSubscriber.Heartbeat(from 10.0.0.200:52383) {code} -- This message was sent by Atlassian JIRA (v6.4.14#64029)