[ https://issues.apache.org/jira/browse/IMPALA-8257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tim Armstrong updated IMPALA-8257: ---------------------------------- Description: Encountered while doing a large insert into Parquet. {code} create table customer like tpcds_300_text.customer stored as parquetfile insert overwrite table customer select * from tpcds_300_text.customer {code} {noformat} F0227 01:34:53.052708 131295 parquet-column-stats.inline.h:213] 794c051ae3f3913c:71f00bc400000001] Check failed: static_cast<void*>(prev_page_min_value_.ptr) != static_cast<void*>(cs->min_value_.ptr) (0 vs. 0) *** Check failure stack trace: *** @ 0x47ec7ec google::LogMessage::Fail() @ 0x47ee091 google::LogMessage::SendToLog() @ 0x47ec1c6 google::LogMessage::Flush() @ 0x47ef78d google::LogMessageFatal::~LogMessageFatal() @ 0x27e973c impala::ColumnStats<>::Merge() @ 0x27e3c74 impala::HdfsParquetTableWriter::BaseColumnWriter::FinalizeCurrentPage() @ 0x27ee65f impala::HdfsParquetTableWriter::BaseColumnWriter::AppendRow() @ 0x27e653b impala::HdfsParquetTableWriter::AppendRows() @ 0x23177fc impala::HdfsTableSink::WriteRowsToPartition() @ 0x231aeeb impala::HdfsTableSink::Send() @ 0x1f53888 impala::FragmentInstanceState::ExecInternal() @ 0x1f4fefa impala::FragmentInstanceState::Exec() @ 0x1f63333 impala::QueryState::ExecFInstance() @ 0x1f61615 _ZZN6impala10QueryState15StartFInstancesEvENKUlvE_clEv @ 0x1f64774 _ZN5boost6detail8function26void_function_obj_invoker0IZN6impala10QueryState15StartFInstancesEvEUlvE_vE6invokeERNS1_15function_bufferE @ 0x1d76b9f boost::function0<>::operator()() @ 0x22245ee impala::Thread::SuperviseThread() @ 0x222c972 boost::_bi::list5<>::operator()<>() @ 0x222c896 boost::_bi::bind_t<>::operator()() @ 0x222c859 boost::detail::thread_data<>::run() @ 0x3716329 thread_proxy @ 0x7fba207e8dd4 start_thread @ 0x7fba20511eac __clone {noformat} This actually happened on multiple machines at almost exactly the same time: {noformat} Running on machine: vc1328.halxg.cloudera.com Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg F0227 01:34:53.025667 133025 parquet-column-stats.inline.h:213] 794c051ae3f3913c:71f00bc400000005] Check failed: static_cast<void*>(prev_page_min_value_.ptr) != static_cast<void*>(cs->min_value_.ptr) (0 vs. 0) ... F0227 01:34:53.025352 131082 parquet-column-stats.inline.h:213] 794c051ae3f3913c:71f00bc400000007] Check failed: static_cast<void*>(prev_page_min_value_.ptr) != static_cast<void*>(cs->min_value_.ptr) (0 vs. 0) {noformat} was: Encountered while doing a large insert into Parquet. {code} create table customer like tpcds_300_text.customer stored as parquetfile insert overwrite table customer select * from tpcds_300_text.customer {code} {noformat} F0227 01:34:53.052708 131295 parquet-column-stats.inline.h:213] 794c051ae3f3913c:71f00bc400000001] Check failed: static_cast<void*>(prev_page_min_value_.ptr) != static_cast<void*>(cs->min_value_.ptr) (0 vs. 0) *** Check failure stack trace: *** @ 0x47ec7ec google::LogMessage::Fail() @ 0x47ee091 google::LogMessage::SendToLog() @ 0x47ec1c6 google::LogMessage::Flush() @ 0x47ef78d google::LogMessageFatal::~LogMessageFatal() @ 0x27e973c impala::ColumnStats<>::Merge() @ 0x27e3c74 impala::HdfsParquetTableWriter::BaseColumnWriter::FinalizeCurrentPage() @ 0x27ee65f impala::HdfsParquetTableWriter::BaseColumnWriter::AppendRow() @ 0x27e653b impala::HdfsParquetTableWriter::AppendRows() @ 0x23177fc impala::HdfsTableSink::WriteRowsToPartition() @ 0x231aeeb impala::HdfsTableSink::Send() @ 0x1f53888 impala::FragmentInstanceState::ExecInternal() @ 0x1f4fefa impala::FragmentInstanceState::Exec() @ 0x1f63333 impala::QueryState::ExecFInstance() @ 0x1f61615 _ZZN6impala10QueryState15StartFInstancesEvENKUlvE_clEv @ 0x1f64774 _ZN5boost6detail8function26void_function_obj_invoker0IZN6impala10QueryState15StartFInstancesEvEUlvE_vE6invokeERNS1_15function_bufferE @ 0x1d76b9f boost::function0<>::operator()() @ 0x22245ee impala::Thread::SuperviseThread() @ 0x222c972 boost::_bi::list5<>::operator()<>() @ 0x222c896 boost::_bi::bind_t<>::operator()() @ 0x222c859 boost::detail::thread_data<>::run() @ 0x3716329 thread_proxy @ 0x7fba207e8dd4 start_thread @ 0x7fba20511eac __clone {noformat} > Check failed: static_cast<void*>(prev_page_min_value_.ptr) != > static_cast<void*>(cs->min_value_.ptr) when inserting into parquet > -------------------------------------------------------------------------------------------------------------------------------- > > Key: IMPALA-8257 > URL: https://issues.apache.org/jira/browse/IMPALA-8257 > Project: IMPALA > Issue Type: Bug > Reporter: Tim Armstrong > Assignee: Tim Armstrong > Priority: Blocker > Labels: crash > > Encountered while doing a large insert into Parquet. > {code} > create table customer like tpcds_300_text.customer stored as parquetfile > insert overwrite table customer select * from tpcds_300_text.customer > {code} > {noformat} > F0227 01:34:53.052708 131295 parquet-column-stats.inline.h:213] > 794c051ae3f3913c:71f00bc400000001] Check failed: > static_cast<void*>(prev_page_min_value_.ptr) != > static_cast<void*>(cs->min_value_.ptr) (0 vs. 0) > *** Check failure stack trace: *** > @ 0x47ec7ec google::LogMessage::Fail() > @ 0x47ee091 google::LogMessage::SendToLog() > @ 0x47ec1c6 google::LogMessage::Flush() > @ 0x47ef78d google::LogMessageFatal::~LogMessageFatal() > @ 0x27e973c impala::ColumnStats<>::Merge() > @ 0x27e3c74 > impala::HdfsParquetTableWriter::BaseColumnWriter::FinalizeCurrentPage() > @ 0x27ee65f > impala::HdfsParquetTableWriter::BaseColumnWriter::AppendRow() > @ 0x27e653b impala::HdfsParquetTableWriter::AppendRows() > @ 0x23177fc impala::HdfsTableSink::WriteRowsToPartition() > @ 0x231aeeb impala::HdfsTableSink::Send() > @ 0x1f53888 impala::FragmentInstanceState::ExecInternal() > @ 0x1f4fefa impala::FragmentInstanceState::Exec() > @ 0x1f63333 impala::QueryState::ExecFInstance() > @ 0x1f61615 > _ZZN6impala10QueryState15StartFInstancesEvENKUlvE_clEv > @ 0x1f64774 > _ZN5boost6detail8function26void_function_obj_invoker0IZN6impala10QueryState15StartFInstancesEvEUlvE_vE6invokeERNS1_15function_bufferE > @ 0x1d76b9f boost::function0<>::operator()() > @ 0x22245ee impala::Thread::SuperviseThread() > @ 0x222c972 boost::_bi::list5<>::operator()<>() > @ 0x222c896 boost::_bi::bind_t<>::operator()() > @ 0x222c859 boost::detail::thread_data<>::run() > @ 0x3716329 thread_proxy > @ 0x7fba207e8dd4 start_thread > @ 0x7fba20511eac __clone > {noformat} > This actually happened on multiple machines at almost exactly the same time: > {noformat} > Running on machine: vc1328.halxg.cloudera.com > Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg > F0227 01:34:53.025667 133025 parquet-column-stats.inline.h:213] > 794c051ae3f3913c:71f00bc400000005] Check failed: > static_cast<void*>(prev_page_min_value_.ptr) != > static_cast<void*>(cs->min_value_.ptr) (0 vs. 0) > ... > F0227 01:34:53.025352 131082 parquet-column-stats.inline.h:213] > 794c051ae3f3913c:71f00bc400000007] Check failed: > static_cast<void*>(prev_page_min_value_.ptr) != > static_cast<void*>(cs->min_value_.ptr) (0 vs. 0) > {noformat} -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-all-unsubscr...@impala.apache.org For additional commands, e-mail: issues-all-h...@impala.apache.org