[ 
https://issues.apache.org/jira/browse/KUDU-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15374821#comment-15374821
 ] 

Todd Lipcon commented on KUDU-1529:
-----------------------------------

Can you share the WAL segment? Either here or email me it off-list? The WAL 
entries should have checksums which would prevent reading a partial entry, 
although maybe on the header we have some problem.

> kudu-tserver cannot restart after server crash due to partial write .
> ---------------------------------------------------------------------
>
>                 Key: KUDU-1529
>                 URL: https://issues.apache.org/jira/browse/KUDU-1529
>             Project: Kudu
>          Issue Type: Bug
>    Affects Versions: 0.9.1
>            Reporter: zhangsong
>            Priority: Critical
>
> After server crash , kudu-tserver cannot be restarted successfully.
> From fatal log , there is a check failed:
> Check failed: schema.has_column_ids()
> and backtrace:
> #0  0x0000003296632925 in raise () from 
> /export/servers/kudu/0.9-rc/lib64/libc.so.6
> #1  0x0000003296634105 in abort () from 
> /export/servers/kudu/0.9-rc/lib64/libc.so.6
> #2  0x0000000000797196 in google::DumpStackTraceAndExit () at 
> src/utilities.cc:150
> #3  0x000000000078d02d in google::LogMessage::Fail () at src/logging.cc:1478
> #4  0x000000000078ef2d in google::LogMessage::SendToLog (this=<optimized 
> out>) at src/logging.cc:1432
> #5  0x000000000078cb69 in google::LogMessage::Flush 
> (this=this@entry=0x7f39869edd10) at src/logging.cc:1301
> #6  0x000000000078f9cf in google::LogMessageFatal::~LogMessageFatal 
> (this=0x7f39869edd10, __in_chrg=<optimized out>) at src/logging.cc:2013
> #7  0x00000000008be7a7 in kudu::tablet::MemRowSet::MemRowSet 
> (this=0x5b11c960, id=<optimized out>, schema=..., 
> log_anchor_registry=0x324f640, parent_tracker=...)
>     at /export/ldb/kudu_build/kudu-gitlab/src/kudu/tablet/memrowset.cc:102
> #8  0x0000000000867ce9 in kudu::tablet::Tablet::RewindSchemaForBootstrap 
> (this=0x5d2ccdc0, new_schema=..., schema_version=<optimized out>)
>     at /export/ldb/kudu_build/kudu-gitlab/src/kudu/tablet/tablet.cc:870
> #9  0x000000000087d6a4 in kudu::tablet::TabletBootstrap::PlaySegments 
> (this=this@entry=0x7f39869ee590, 
> consensus_info=consensus_info@entry=0x7f39869ee990)
>     at 
> /export/ldb/kudu_build/kudu-gitlab/src/kudu/tablet/tablet_bootstrap.cc:1023
> #10 0x000000000087ef56 in kudu::tablet::TabletBootstrap::Bootstrap 
> (this=this@entry=0x7f39869ee590, 
> rebuilt_tablet=rebuilt_tablet@entry=0x7f39869ee8a0, 
>     rebuilt_log=rebuilt_log@entry=0x7f39869ee710, 
> consensus_info=consensus_info@entry=0x7f39869ee990) at 
> /export/ldb/kudu_build/kudu-gitlab/src/kudu/tablet/tablet_bootstrap.cc:498
> #11 0x000000000087f684 in kudu::tablet::BootstrapTablet (meta=..., clock=..., 
> mem_tracker=..., metric_registry=metric_registry@entry=0x31a0dc0, 
> listener=listener@entry=0x598efce0, 
>     rebuilt_tablet=0x7f39869ee8a0, rebuilt_log=0x7f39869ee710, 
> log_anchor_registry=..., consensus_info=0x7f39869ee990)
>     at 
> /export/ldb/kudu_build/kudu-gitlab/src/kudu/tablet/tablet_bootstrap.cc:395
> #12 0x000000000075321f in kudu::tserver::TSTabletManager::OpenTablet 
> (this=0x3162160, meta=..., deleter=...) at 
> /export/ldb/kudu_build/kudu-gitlab/src/kudu/tserver/ts_tablet_manager.cc:647
> #13 0x0000000001901c1e in boost::function0<void>::operator() (this=<optimized 
> out>) at /usr/local/include/boost/function/function_template.hpp:767
> #14 kudu::FunctionRunnable::Run (this=<optimized out>) at 
> /export/ldb/kudu_build/kudu-gitlab/src/kudu/util/threadpool.cc:48
> #15 kudu::ThreadPool::DispatchThread (this=0x31d9b00, permanent=false) at 
> /export/ldb/kudu_build/kudu-gitlab/src/kudu/util/threadpool.cc:343
> #16 0x00000000018fc79a in boost::function0<void>::operator() 
> (this=0x521e56e8) at 
> /usr/local/include/boost/function/function_template.hpp:767
> #17 kudu::Thread::SuperviseThread (arg=0x521e56c0) at 
> /export/ldb/kudu_build/kudu-gitlab/src/kudu/util/thread.cc:586
> #18 0x0000003296a079d1 in start_thread () from 
> /export/servers/kudu/0.9-rc/lib64/libpthread.so.0
> #19 0x00000032966e8b6d in clone () from 
> /export/servers/kudu/0.9-rc/lib64/libc.so.6



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to