[ https://issues.apache.org/jira/browse/KUDU-2375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16414097#comment-16414097 ]
Todd Lipcon commented on KUDU-2375: ----------------------------------- You sure that table 467d365fffbe4485a3249079c48f42a9 is the one you pasted? My guess is that it's one that has a DECIMAL type column in its 5th (0-indexed) position, and when you downgrade to 1.6.0 it doesn't know what to make of the DECIMAL. Agreed the error message and behavior could be a lot better. [~granthenke] what do you think? > Can't parse message of type "kudu.master.SysTablesEntryPB" because it is > missing required fields: schema.columns[5].type > ------------------------------------------------------------------------------------------------------------------------ > > Key: KUDU-2375 > URL: https://issues.apache.org/jira/browse/KUDU-2375 > Project: Kudu > Issue Type: Bug > Components: master > Affects Versions: 1.7.0 > Reporter: Michael Brown > Priority: Blocker > > A downgrade from 1.7.0 to 1.6 results in a dcheck when 1.6 starts. I see the > same dcheck on both 1.6.0 and 1.6.x. A "revert" back to 1.7.0 makes the > problem go away. > Although the symptom is in 1.6, I've filed this against 1.7.0 assuming the > backward incompatibility was not intended. > {noformat} > I0324 17:45:10.681015 105716 catalog_manager.cc:306] Loaded metadata for > table impala::tpcds_1000_kudu.web_returns > [id=40c35b333fa84bb8ad331fab02e03fdf] > F0324 17:45:10.681808 105716 catalog_manager.cc:935] Loading table and tablet > metadata into memory failed: Corruption: Failed while visiting tables in sys > catalog: unable to parse metadata field for row > 467d365fffbe4485a3249079c48f42a9: Error parsing msg: Can't parse message of > type "kudu.master.SysTablesEntryPB" because it is missing required fields: > schema.columns[5].type > {noformat} > {noformat} > #0 0x0000003355e32625 in raise () from /lib64/libc.so.6 > #1 0x0000003355e33e05 in abort () from /lib64/libc.so.6 > #2 0x0000000001cea129 in ?? () > #3 0x00000000009268cd in google::LogMessage::Fail() () > #4 0x000000000092878d in google::LogMessage::SendToLog() () > #5 0x0000000000926409 in google::LogMessage::Flush() () > #6 0x000000000092922f in google::LogMessageFatal::~LogMessageFatal() () > #7 0x00000000008f05de in ?? () > #8 0x00000000008f6039 in > kudu::master::CatalogManager::PrepareForLeadershipTask() () > #9 0x0000000001d297d7 in kudu::ThreadPool::DispatchThread() () > #10 0x0000000001d20151 in kudu::Thread::SuperviseThread(void*) () > #11 0x0000003356207aa1 in start_thread () from /lib64/libpthread.so.0 > #12 0x0000003355ee893d in clone () from /lib64/libc.so.6 > {noformat} > This is on a long-lived cluster that has had Impala and Kudu slowly upgrading > with mostly dev releases over time for a few months. Here's the Impala {{SHOW > CREATE TABLE}}: > {noformat} > | CREATE TABLE tpcds_1000_kudu.web_returns ( > | > | wr_returned_date_sk INT NOT NULL ENCODING AUTO_ENCODING COMPRESSION > DEFAULT_COMPRESSION, | > | wr_order_number BIGINT NOT NULL ENCODING AUTO_ENCODING COMPRESSION > DEFAULT_COMPRESSION, | > | wr_item_sk BIGINT NOT NULL ENCODING AUTO_ENCODING COMPRESSION > DEFAULT_COMPRESSION, | > | wr_returned_time_sk INT NULL ENCODING AUTO_ENCODING COMPRESSION > DEFAULT_COMPRESSION, | > | wr_refunded_customer_sk INT NULL ENCODING AUTO_ENCODING COMPRESSION > DEFAULT_COMPRESSION, | > | wr_refunded_cdemo_sk INT NULL ENCODING AUTO_ENCODING COMPRESSION > DEFAULT_COMPRESSION, | > | wr_refunded_hdemo_sk INT NULL ENCODING AUTO_ENCODING COMPRESSION > DEFAULT_COMPRESSION, | > | wr_refunded_addr_sk INT NULL ENCODING AUTO_ENCODING COMPRESSION > DEFAULT_COMPRESSION, | > | wr_returning_customer_sk INT NULL ENCODING AUTO_ENCODING COMPRESSION > DEFAULT_COMPRESSION, | > | wr_returning_cdemo_sk INT NULL ENCODING AUTO_ENCODING COMPRESSION > DEFAULT_COMPRESSION, | > | wr_returning_hdemo_sk INT NULL ENCODING AUTO_ENCODING COMPRESSION > DEFAULT_COMPRESSION, | > | wr_returning_addr_sk INT NULL ENCODING AUTO_ENCODING COMPRESSION > DEFAULT_COMPRESSION, | > | wr_web_page_sk INT NULL ENCODING AUTO_ENCODING COMPRESSION > DEFAULT_COMPRESSION, | > | wr_reason_sk INT NULL ENCODING AUTO_ENCODING COMPRESSION > DEFAULT_COMPRESSION, | > | wr_return_quantity INT NULL ENCODING AUTO_ENCODING COMPRESSION > DEFAULT_COMPRESSION, | > | wr_return_amt DOUBLE NULL ENCODING AUTO_ENCODING COMPRESSION > DEFAULT_COMPRESSION, | > | wr_return_tax DOUBLE NULL ENCODING AUTO_ENCODING COMPRESSION > DEFAULT_COMPRESSION, | > | wr_return_amt_inc_tax DOUBLE NULL ENCODING AUTO_ENCODING COMPRESSION > DEFAULT_COMPRESSION, | > | wr_fee DOUBLE NULL ENCODING AUTO_ENCODING COMPRESSION > DEFAULT_COMPRESSION, | > | wr_return_ship_cost DOUBLE NULL ENCODING AUTO_ENCODING COMPRESSION > DEFAULT_COMPRESSION, | > | wr_refunded_cash DOUBLE NULL ENCODING AUTO_ENCODING COMPRESSION > DEFAULT_COMPRESSION, | > | wr_reversed_charge DOUBLE NULL ENCODING AUTO_ENCODING COMPRESSION > DEFAULT_COMPRESSION, | > | wr_account_credit DOUBLE NULL ENCODING AUTO_ENCODING COMPRESSION > DEFAULT_COMPRESSION, | > | wr_net_loss DOUBLE NULL ENCODING AUTO_ENCODING COMPRESSION > DEFAULT_COMPRESSION, | > | PRIMARY KEY (wr_returned_date_sk, wr_order_number, wr_item_sk) > | > | ) > | > | PARTITION BY HASH (wr_order_number, wr_item_sk) PARTITIONS 140 > | > | STORED AS KUDU > | > | TBLPROPERTIES ('STATS_GENERATED_VIA_STATS_TASK'='true', > 'kudu.master_addresses'='redacted', 'numRows'='68758263') | > {noformat} -- This message was sent by Atlassian JIRA (v7.6.3#76005)