[
https://issues.apache.org/jira/browse/KUDU-2375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Brown updated KUDU-2375:
Description:
A downgrade from 1.7.0 to 1.6 results in a dcheck when 1.6 starts. I see the
same dcheck on both 1.6.0 and 1.6.x. A "revert" back to 1.7.0 makes the problem
go away.
Although the symptom is in 1.6, I've filed this against 1.7.0 assuming the
backward incompatibility was not intended.
{noformat}
F0324 17:45:10.681808 105716 catalog_manager.cc:935] Loading table and tablet
metadata into memory failed: Corruption: Failed while visiting tables in sys
catalog: unable to parse metadata field for row
467d365fffbe4485a3249079c48f42a9: Error parsing msg: Can't parse message of
type "kudu.master.SysTablesEntryPB" because it is missing required fields:
schema.columns[5].type
{noformat}
{noformat}
#0 0x003355e32625 in raise () from /lib64/libc.so.6
#1 0x003355e33e05 in abort () from /lib64/libc.so.6
#2 0x01cea129 in ?? ()
#3 0x009268cd in google::LogMessage::Fail() ()
#4 0x0092878d in google::LogMessage::SendToLog() ()
#5 0x00926409 in google::LogMessage::Flush() ()
#6 0x0092922f in google::LogMessageFatal::~LogMessageFatal() ()
#7 0x008f05de in ?? ()
#8 0x008f6039 in
kudu::master::CatalogManager::PrepareForLeadershipTask() ()
#9 0x01d297d7 in kudu::ThreadPool::DispatchThread() ()
#10 0x01d20151 in kudu::Thread::SuperviseThread(void*) ()
#11 0x003356207aa1 in start_thread () from /lib64/libpthread.so.0
#12 0x003355ee893d in clone () from /lib64/libc.so.6
{noformat}
was:
A downgrade from 1.7.0 to 1.6 results in a dcheck when 1.6 starts. I see the
same dcheck on both 1.6.0 and 1.6.x. A "revert" back to 1.7.0 makes the problem
go away.
Although the symptom is in 1.6, I've filed this against 1.7.0 assuming the
backward incompatibility was not intended.
{noformat}
I0324 17:45:10.681015 105716 catalog_manager.cc:306] Loaded metadata for table
impala::tpcds_1000_kudu.web_returns [id=40c35b333fa84bb8ad331fab02e03fdf]
F0324 17:45:10.681808 105716 catalog_manager.cc:935] Loading table and tablet
metadata into memory failed: Corruption: Failed while visiting tables in sys
catalog: unable to parse metadata field for row
467d365fffbe4485a3249079c48f42a9: Error parsing msg: Can't parse message of
type "kudu.master.SysTablesEntryPB" because it is missing required fields:
schema.columns[5].type
{noformat}
{noformat}
#0 0x003355e32625 in raise () from /lib64/libc.so.6
#1 0x003355e33e05 in abort () from /lib64/libc.so.6
#2 0x01cea129 in ?? ()
#3 0x009268cd in google::LogMessage::Fail() ()
#4 0x0092878d in google::LogMessage::SendToLog() ()
#5 0x00926409 in google::LogMessage::Flush() ()
#6 0x0092922f in google::LogMessageFatal::~LogMessageFatal() ()
#7 0x008f05de in ?? ()
#8 0x008f6039 in
kudu::master::CatalogManager::PrepareForLeadershipTask() ()
#9 0x01d297d7 in kudu::ThreadPool::DispatchThread() ()
#10 0x01d20151 in kudu::Thread::SuperviseThread(void*) ()
#11 0x003356207aa1 in start_thread () from /lib64/libpthread.so.0
#12 0x003355ee893d in clone () from /lib64/libc.so.6
{noformat}
This is on a long-lived cluster that has had Impala and Kudu slowly upgrading
with mostly dev releases over time for a few months. Here's the Impala {{SHOW
CREATE TABLE}}:
{noformat}
| CREATE TABLE tpcds_1000_kudu.web_returns (
|
| wr_returned_date_sk INT NOT NULL ENCODING AUTO_ENCODING COMPRESSION
DEFAULT_COMPRESSION, |
| wr_order_number BIGINT NOT NULL ENCODING AUTO_ENCODING COMPRESSION
DEFAULT_COMPRESSION, |
| wr_item_sk BIGINT NOT NULL ENCODING AUTO_ENCODING COMPRESSION
DEFAULT_COMPRESSION, |
| wr_returned_time_sk INT NULL ENCODING AUTO_ENCODING COMPRESSION
DEFAULT_COMPRESSION, |
| wr_refunded_customer_sk INT NULL ENCODING AUTO_ENCODING COMPRESSION
DEFAULT_COMPRESSION, |
| wr_refunded_cdemo_sk INT NULL ENCODING AUTO_ENCODING COMPRESSION
DEFAULT_COMPRESSION,|
| wr_refunded_hdemo_sk INT NULL ENCODING AUTO_ENCODING COMPRESSION
DEFAULT_COMPRESSION,|
| wr_refunded_addr_sk INT NULL ENCODING AUTO_ENCODING COMPRESSION
DEFAULT_COMPRESSION, |
| wr_returning_customer_sk INT NULL ENCODING AUTO_ENCODING COMPRESSION
DEFAULT_COMPRESSION,|
| wr_returning_cdemo_sk INT NULL ENCODING AUTO_ENCODING COMPRESSION
DEFAULT_COMPRESSION,
