[jira] [Updated] (IMPALA-9111) Sorting 'Decimal16Value's with codegen enabled but codegen optimizations disabled fails

2020-07-01 Thread Daniel Becker (Jira)


 [ 
https://issues.apache.org/jira/browse/IMPALA-9111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Daniel Becker updated IMPALA-9111:
--
Labels: crash  (was: )

> Sorting 'Decimal16Value's with codegen enabled but codegen optimizations 
> disabled fails
> ---
>
> Key: IMPALA-9111
> URL: https://issues.apache.org/jira/browse/IMPALA-9111
> Project: IMPALA
>  Issue Type: Bug
>  Components: Backend
>Reporter: Daniel Becker
>Assignee: Daniel Becker
>Priority: Minor
>  Labels: crash
>
> Starting the Impala cluster with
> {code:java}
> bin/start-impala-cluster.py 
> --impalad_args="-disable_optimization_passes"{code}
>  
> the following query fails and Impala crashes:
>  
> {code:java}
> SELECT d28_1
>  FROM functional.decimal_rtf_tbl ORDER BY d28_1;{code}
>  
> This error happens if the inlining pass in OptimizeModule in 
> be/src/codegen/llvm-codegen.cc is not run. It seems the problem only happens 
> with decimals that need to be stored on 16 bytes. Maybe it is some ABI 
> incompatibility with Decimal16Value.
> Stack trace:
> {code:java}
> #0 0x7fda6e63e428 in __GI_raise (sig=sig@entry=6) at 
> ../sysdeps/unix/sysv/linux/raise.c:54
> #1 0x7fda6e64002a in __GI_abort () at abort.c:89
> #2 0x7fda71707149 in os::abort(bool) () from 
> /usr/lib/jvm/java-8-openjdk-amd64/jre/lib/amd64/server/libjvm.so
> #3 0x7fda718bad27 in VMError::report_and_die() () from 
> /usr/lib/jvm/java-8-openjdk-amd64/jre/lib/amd64/server/libjvm.so
> #4 0x7fda71710e4f in JVM_handle_linux_signal () from 
> /usr/lib/jvm/java-8-openjdk-amd64/jre/lib/amd64/server/libjvm.so
> #5 0x7fda71703e48 in signalHandler(int, siginfo_t*, void*) () from 
> /usr/lib/jvm/java-8-openjdk-amd64/jre/lib/amd64/server/libjvm.so
> #6 
> #7 0x7fd9c3437f8b in impala::RawValue::Compare(void const*, void const*, 
> impala::ColumnType const&) ()
> #8 0x7fd9c3438e25 in Compare ()
> #9 0x02a26293 in impala::TupleRowComparator::Compare 
> (rhs=0x7fd9c3c4a8b8, lhs=0x7fd9c3c4a8c0, this=0x1284e480) at 
> be/src/util/tuple-row-compare.h:98
> #10 impala::TupleRowComparator::Less (rhs=0x7fd9c3c4a8b8, lhs=0x7fd9c3c4a8c0, 
> this=0x1284e480) at be/src/util/tuple-row-compare.h:107
> #11 impala::Sorter::TupleSorter::Less (this=0x137b2000, lhs=0x7fd9c3c4a8c0, 
> rhs=0x7fd9c3c4a8b8) at be/src/runtime/sorter-ir.cc:72
> #12 0x02a27409 in impala::Sorter::TupleSorter::MedianOfThree 
> (this=0x137b2000, t1=0x14808e50, t2=0x14802d3f, t3=0x14808085) at 
> be/src/runtime/sorter-ir.cc:214
> #13 0x02a27394 in impala::Sorter::TupleSorter::SelectPivot 
> (this=0x137b2000, begin=..., end=...) at be/src/runtime/sorter-ir.cc:206
> #14 0x02a26cd8 in impala::Sorter::TupleSorter::SortHelper 
> (this=0x137b2000, begin=..., end=...) at be/src/runtime/sorter-ir.cc:165
> #15 0x02a15e8a in impala::Sorter::TupleSorter::Sort (this=0x137b2000, 
> run=0x13974da0) at be/src/runtime/sorter.cc:755
> #16 0x02a18e27 in impala::Sorter::SortCurrentInputRun 
> (this=0x1284e3c0) at be/src/runtime/sorter.cc:956
> #17 0x02a183e7 in impala::Sorter::InputDone (this=0x1284e3c0) at 
> be/src/runtime/sorter.cc:892
> #18 0x0263bc18 in impala::SortNode::SortInput (this=0xdf63e40, 
> state=0x11e652a0) at be/src/exec/sort-node.cc:187
> #19 0x0263a8e0 in impala::SortNode::Open (this=0xdf63e40, 
> state=0x11e652a0) at be/src/exec/sort-node.cc:90
> #20 0x020f289a in impala::FragmentInstanceState::Open 
> (this=0xe0571e0) at be/src/runtime/fragment-instance-state.cc:348
> #21 0x020ef54c in impala::FragmentInstanceState::Exec 
> (this=0xe0571e0) at be/src/runtime/fragment-instance-state.cc:84
> #22 0x02102f9b in impala::QueryState::ExecFInstance (this=0xd376000, 
> fis=0xe0571e0) at be/src/runtime/query-state.cc:650
> #23 0x02101268 in impala::QueryStateoperator()(void) 
> const (__closure=0x7fd9c3c4bca8) at be/src/runtime/query-state.cc:558
> #24 0x02104c7d in 
> boost::detail::function::void_function_obj_invoker0,
>  void>::invoke(boost::detail::function::function_buffer &) 
> (function_obj_ptr=...)
> at toolchain/boost-1.57.0-p3/include/boost/function/function_template.hpp:153
> #25 0x01f04b46 in boost::function0::operator() 
> (this=0x7fd9c3c4bca0) at 
> toolchain/boost-1.57.0-p3/include/boost/function/function_template.hpp:767
> #26 0x0247bafd in impala::Thread::SuperviseThread(std::string const&, 
> std::string const&, boost::function, impala::ThreadDebugInfo const*, 
> impala::Promise*) (Python Exception  'gdb.error'> No type named class std::basic_string std::char_traits, std::allocator >::_Rep.: 
> name=, Python Exception  No type named class 
> std::basic_string, std::allocator 
> >::_Rep.: 
> category=, functor=

[jira] [Updated] (IMPALA-9111) Sorting 'Decimal16Value's with codegen enabled but codegen optimizations disabled fails

2019-10-31 Thread Daniel Becker (Jira)


 [ 
https://issues.apache.org/jira/browse/IMPALA-9111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Daniel Becker updated IMPALA-9111:
--
Description: 
Starting the Impala cluster with
{code:java}
bin/start-impala-cluster.py --impalad_args="-disable_optimization_passes"{code}
 

the following query fails and Impala crashes:

 
{code:java}
SELECT d28_1
 FROM functional.decimal_rtf_tbl ORDER BY d28_1;{code}
 


This error happens if the inlining pass in OptimizeModule in 
be/src/codegen/llvm-codegen.cc is not run. It seems the problem only happens 
with decimals that need to be stored on 16 bytes. Maybe it is some ABI 
incompatibility with Decimal16Value.

Stack trace:
{code:java}
#0 0x7fda6e63e428 in __GI_raise (sig=sig@entry=6) at 
../sysdeps/unix/sysv/linux/raise.c:54
#1 0x7fda6e64002a in __GI_abort () at abort.c:89
#2 0x7fda71707149 in os::abort(bool) () from 
/usr/lib/jvm/java-8-openjdk-amd64/jre/lib/amd64/server/libjvm.so
#3 0x7fda718bad27 in VMError::report_and_die() () from 
/usr/lib/jvm/java-8-openjdk-amd64/jre/lib/amd64/server/libjvm.so
#4 0x7fda71710e4f in JVM_handle_linux_signal () from 
/usr/lib/jvm/java-8-openjdk-amd64/jre/lib/amd64/server/libjvm.so
#5 0x7fda71703e48 in signalHandler(int, siginfo_t*, void*) () from 
/usr/lib/jvm/java-8-openjdk-amd64/jre/lib/amd64/server/libjvm.so
#6 
#7 0x7fd9c3437f8b in impala::RawValue::Compare(void const*, void const*, 
impala::ColumnType const&) ()
#8 0x7fd9c3438e25 in Compare ()
#9 0x02a26293 in impala::TupleRowComparator::Compare 
(rhs=0x7fd9c3c4a8b8, lhs=0x7fd9c3c4a8c0, this=0x1284e480) at 
be/src/util/tuple-row-compare.h:98
#10 impala::TupleRowComparator::Less (rhs=0x7fd9c3c4a8b8, lhs=0x7fd9c3c4a8c0, 
this=0x1284e480) at be/src/util/tuple-row-compare.h:107
#11 impala::Sorter::TupleSorter::Less (this=0x137b2000, lhs=0x7fd9c3c4a8c0, 
rhs=0x7fd9c3c4a8b8) at be/src/runtime/sorter-ir.cc:72
#12 0x02a27409 in impala::Sorter::TupleSorter::MedianOfThree 
(this=0x137b2000, t1=0x14808e50, t2=0x14802d3f, t3=0x14808085) at 
be/src/runtime/sorter-ir.cc:214
#13 0x02a27394 in impala::Sorter::TupleSorter::SelectPivot 
(this=0x137b2000, begin=..., end=...) at be/src/runtime/sorter-ir.cc:206
#14 0x02a26cd8 in impala::Sorter::TupleSorter::SortHelper 
(this=0x137b2000, begin=..., end=...) at be/src/runtime/sorter-ir.cc:165
#15 0x02a15e8a in impala::Sorter::TupleSorter::Sort (this=0x137b2000, 
run=0x13974da0) at be/src/runtime/sorter.cc:755
#16 0x02a18e27 in impala::Sorter::SortCurrentInputRun (this=0x1284e3c0) 
at be/src/runtime/sorter.cc:956
#17 0x02a183e7 in impala::Sorter::InputDone (this=0x1284e3c0) at 
be/src/runtime/sorter.cc:892
#18 0x0263bc18 in impala::SortNode::SortInput (this=0xdf63e40, 
state=0x11e652a0) at be/src/exec/sort-node.cc:187
#19 0x0263a8e0 in impala::SortNode::Open (this=0xdf63e40, 
state=0x11e652a0) at be/src/exec/sort-node.cc:90
#20 0x020f289a in impala::FragmentInstanceState::Open (this=0xe0571e0) 
at be/src/runtime/fragment-instance-state.cc:348
#21 0x020ef54c in impala::FragmentInstanceState::Exec (this=0xe0571e0) 
at be/src/runtime/fragment-instance-state.cc:84
#22 0x02102f9b in impala::QueryState::ExecFInstance (this=0xd376000, 
fis=0xe0571e0) at be/src/runtime/query-state.cc:650
#23 0x02101268 in impala::QueryStateoperator()(void) 
const (__closure=0x7fd9c3c4bca8) at be/src/runtime/query-state.cc:558
#24 0x02104c7d in 
boost::detail::function::void_function_obj_invoker0,
 void>::invoke(boost::detail::function::function_buffer &) 
(function_obj_ptr=...)
at toolchain/boost-1.57.0-p3/include/boost/function/function_template.hpp:153
#25 0x01f04b46 in boost::function0::operator() 
(this=0x7fd9c3c4bca0) at 
toolchain/boost-1.57.0-p3/include/boost/function/function_template.hpp:767
#26 0x0247bafd in impala::Thread::SuperviseThread(std::string const&, 
std::string const&, boost::function, impala::ThreadDebugInfo const*, 
impala::Promise*) (Python Exception  No type named class std::basic_string, std::allocator >::_Rep.: 
name=, Python Exception  No type named class 
std::basic_string, std::allocator >::_Rep.: 
category=, functor=..., parent_thread_info=0x7fd9c4c4d950, 
thread_started=0x7fd9c4c4c8f0) at be/src/util/thread.cc:360
#27 0x02483e81 in boost::_bi::list5, 
boost::_bi::value, boost::_bi::value >, 
boost::_bi::value, 
boost::_bi::value*> 
>::operator(), impala::ThreadDebugInfo const*, impala::Promise*), boost::_bi::list0>(boost::_bi::type, void 
(*&)(std::string const&, std::string const&, boost::function, 
impala::ThreadDebugInfo const*, impala::Promise*), boost::_bi::list0&, int) (this=0xd3857c0, 
f=@0xd3857b8: 0x247b796 , impala::ThreadDebugInfo const*, 
impala::Promise*)>, a=...)
at toolchain/boost-1.57.0-p3/include/boost/bind/bind.hpp:525
#28 0x02483da5 in boost::_bi::bind_t, impala::ThreadDebugInf