[jira] [Assigned] (IMPALA-10267) Impala crashes in HdfsScanner::WriteTemplateTuples() with negative num_tuples

2022-06-09 Thread Csaba Ringhofer (Jira) 


 [ 
https://issues.apache.org/jira/browse/IMPALA-10267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Csaba Ringhofer reassigned IMPALA-10267:


Assignee: Csaba Ringhofer  (was: Qifan Chen)

> Impala crashes in HdfsScanner::WriteTemplateTuples() with negative num_tuples
> -
>
> Key: IMPALA-10267
> URL: https://issues.apache.org/jira/browse/IMPALA-10267
> Project: IMPALA
>  Issue Type: Bug
>  Components: Backend
>Affects Versions: Impala 4.0.0
>Reporter: Joe McDonnell
>Assignee: Csaba Ringhofer
>Priority: Critical
>  Labels: broken-build, flaky
> Fix For: Impala 4.0.0
>
>
> An exhaustive job hit two Impalad crashes with the following stack:
> {noformat}
>  2  impalad!google::LogMessageFatal::~LogMessageFatal() + 0x9
> rbx = 0x   rbp = 0x7f82f98ad7a0
> rsp = 0x7f82f98ad6a0   r12 = 0x
> r13 = 0x7f8306dd1690   r14 = 0x2f6631a0
> r15 = 0x72b8f2f0   rip = 0x05209129
> Found by: call frame info
>  3  impalad!impala::HdfsScanner::WriteTemplateTuples(impala::TupleRow*, int) 
> [hdfs-scanner.cc : 235 + 0xf]
> rbx = 0x   rbp = 0x7f82f98ad7a0
> rsp = 0x7f82f98ad6b0   r12 = 0x
> r13 = 0x7f8306dd1690   r14 = 0x2f6631a0
> r15 = 0x72b8f2f0   rip = 0x02802013
> Found by: call frame info
>  4  impalad!impala::HdfsAvroScanner::ProcessRange(impala::RowBatch*) 
> [hdfs-avro-scanner.cc : 553 + 0x19]
> rbx = 0x0400   rbp = 0x7f82f98adc60
> rsp = 0x7f82f98ad7b0   r12 = 0x
> r13 = 0x7f8306dd1690   r14 = 0x2f6631a0
> r15 = 0x72b8f2f0   rip = 0x0283880d
> Found by: call frame info
>  5  impalad!impala::BaseSequenceScanner::GetNextInternal(impala::RowBatch*) 
> [base-sequence-scanner.cc : 189 + 0x2b]
> rbx = 0x   rbp = 0x7f82f98adf40
> rsp = 0x7f82f98adc70   r12 = 0x
> r13 = 0x7f8306dd1690   r14 = 0x2f6631a0
> r15 = 0x72b8f2f0   rip = 0x029302b5
> Found by: call frame info
>  6  impalad!impala::HdfsScanner::ProcessSplit() [hdfs-scanner.cc : 143 + 0x39]
> rbx = 0x0292fbd4   rbp = 0x7f82f98ae000
> rsp = 0x7f82f98adf50   r12 = 0x
> r13 = 0x7f8306dd1690   r14 = 0x2f6631a0
> r15 = 0x72b8f2f0   rip = 0x028011c9
> Found by: call frame info
>  7  
> impalad!impala::HdfsScanNode::ProcessSplit(std::vector std::allocator > const&, impala::MemPool*, 
> impala::io::ScanRange*, long*) [hdfs-scan-node.cc : 500 + 0x28]
> rbx = 0x8000   rbp = 0x7f82f98ae390
> rsp = 0x7f82f98ae010   r12 = 0x
> r13 = 0x7f8306dd1690   r14 = 0x2f6631a0
> r15 = 0x72b8f2f0   rip = 0x0297aa3d
> Found by: call frame info
>  8  impalad!impala::HdfsScanNode::ScannerThread(bool, long) 
> [hdfs-scan-node.cc : 418 + 0x27]
> rbx = 0x0001abc6a760   rbp = 0x7f82f98ae750
> rsp = 0x7f82f98ae3a0   r12 = 0x
> r13 = 0x7f8306dd1690   r14 = 0x2f6631a0
> r15 = 0x72b8f2f0   rip = 0x02979dbe
> Found by: call frame info
>  9  
> impalad!impala::HdfsScanNode::ThreadTokenAvailableCb(impala::ThreadResourcePool*)::{lambda()#1}::operator()()
>  const + 0x30
> rbx = 0x0bbf   rbp = 0x7f82f98ae770
> rsp = 0x7f82f98ae760   r12 = 0x08e18f40
> r13 = 0x7f8306dd1690   r14 = 0x2f6631a0
> r15 = 0x72b8f2f0   rip = 0x02979126
> Found by: call frame info{noformat}
> This seems to happen when running 
> query_test/test_scanners_fuzz.py::TestScannersFuzzing::test_fuzz_alltypes on 
> Avro. In reading the code in HdfsAvroScanner ProcessScanRanger(), it seems 
> impossible for this value to be negative, so it's unclear what is happening.



--
This message was sent by Atlassian Jira
(v8.20.7#820007)

-
To unsubscribe, e-mail: issues-all-unsubscr...@impala.apache.org
For additional commands, e-mail: issues-all-h...@impala.apache.org

[jira] [Assigned] (IMPALA-10267) Impala crashes in HdfsScanner::WriteTemplateTuples() with negative num_tuples

2020-10-28 Thread Qifan Chen (Jira) 


 [ 
https://issues.apache.org/jira/browse/IMPALA-10267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Qifan Chen reassigned IMPALA-10267:
---

Assignee: Qifan Chen

> Impala crashes in HdfsScanner::WriteTemplateTuples() with negative num_tuples
> -
>
> Key: IMPALA-10267
> URL: https://issues.apache.org/jira/browse/IMPALA-10267
> Project: IMPALA
>  Issue Type: Bug
>  Components: Backend
>Affects Versions: Impala 4.0
>Reporter: Joe McDonnell
>Assignee: Qifan Chen
>Priority: Critical
>  Labels: broken-build, flaky
>
> An exhaustive job hit two Impalad crashes with the following stack:
> {noformat}
>  2  impalad!google::LogMessageFatal::~LogMessageFatal() + 0x9
> rbx = 0x   rbp = 0x7f82f98ad7a0
> rsp = 0x7f82f98ad6a0   r12 = 0x
> r13 = 0x7f8306dd1690   r14 = 0x2f6631a0
> r15 = 0x72b8f2f0   rip = 0x05209129
> Found by: call frame info
>  3  impalad!impala::HdfsScanner::WriteTemplateTuples(impala::TupleRow*, int) 
> [hdfs-scanner.cc : 235 + 0xf]
> rbx = 0x   rbp = 0x7f82f98ad7a0
> rsp = 0x7f82f98ad6b0   r12 = 0x
> r13 = 0x7f8306dd1690   r14 = 0x2f6631a0
> r15 = 0x72b8f2f0   rip = 0x02802013
> Found by: call frame info
>  4  impalad!impala::HdfsAvroScanner::ProcessRange(impala::RowBatch*) 
> [hdfs-avro-scanner.cc : 553 + 0x19]
> rbx = 0x0400   rbp = 0x7f82f98adc60
> rsp = 0x7f82f98ad7b0   r12 = 0x
> r13 = 0x7f8306dd1690   r14 = 0x2f6631a0
> r15 = 0x72b8f2f0   rip = 0x0283880d
> Found by: call frame info
>  5  impalad!impala::BaseSequenceScanner::GetNextInternal(impala::RowBatch*) 
> [base-sequence-scanner.cc : 189 + 0x2b]
> rbx = 0x   rbp = 0x7f82f98adf40
> rsp = 0x7f82f98adc70   r12 = 0x
> r13 = 0x7f8306dd1690   r14 = 0x2f6631a0
> r15 = 0x72b8f2f0   rip = 0x029302b5
> Found by: call frame info
>  6  impalad!impala::HdfsScanner::ProcessSplit() [hdfs-scanner.cc : 143 + 0x39]
> rbx = 0x0292fbd4   rbp = 0x7f82f98ae000
> rsp = 0x7f82f98adf50   r12 = 0x
> r13 = 0x7f8306dd1690   r14 = 0x2f6631a0
> r15 = 0x72b8f2f0   rip = 0x028011c9
> Found by: call frame info
>  7  
> impalad!impala::HdfsScanNode::ProcessSplit(std::vector std::allocator > const&, impala::MemPool*, 
> impala::io::ScanRange*, long*) [hdfs-scan-node.cc : 500 + 0x28]
> rbx = 0x8000   rbp = 0x7f82f98ae390
> rsp = 0x7f82f98ae010   r12 = 0x
> r13 = 0x7f8306dd1690   r14 = 0x2f6631a0
> r15 = 0x72b8f2f0   rip = 0x0297aa3d
> Found by: call frame info
>  8  impalad!impala::HdfsScanNode::ScannerThread(bool, long) 
> [hdfs-scan-node.cc : 418 + 0x27]
> rbx = 0x0001abc6a760   rbp = 0x7f82f98ae750
> rsp = 0x7f82f98ae3a0   r12 = 0x
> r13 = 0x7f8306dd1690   r14 = 0x2f6631a0
> r15 = 0x72b8f2f0   rip = 0x02979dbe
> Found by: call frame info
>  9  
> impalad!impala::HdfsScanNode::ThreadTokenAvailableCb(impala::ThreadResourcePool*)::{lambda()#1}::operator()()
>  const + 0x30
> rbx = 0x0bbf   rbp = 0x7f82f98ae770
> rsp = 0x7f82f98ae760   r12 = 0x08e18f40
> r13 = 0x7f8306dd1690   r14 = 0x2f6631a0
> r15 = 0x72b8f2f0   rip = 0x02979126
> Found by: call frame info{noformat}
> This seems to happen when running 
> query_test/test_scanners_fuzz.py::TestScannersFuzzing::test_fuzz_alltypes on 
> Avro. In reading the code in HdfsAvroScanner ProcessScanRanger(), it seems 
> impossible for this value to be negative, so it's unclear what is happening.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-all-unsubscr...@impala.apache.org
For additional commands, e-mail: issues-all-h...@impala.apache.org