stinger1206 opened a new issue, #66895: URL: https://github.com/apache/doris/issues/66895
### Search before asking - [x] I had searched in the [issues](https://github.com/apache/doris/issues?q=is%3Aissue) and found no similar issues. ### Version Apache Doris 4.1.3 Environment: Kubernetes Compute-storage coupled mode 6 BE nodes ### What's Wrong? Two different BE nodes crashed independently with the same SIGSEGV stack trace: ``` 0# doris::signal::(anonymous namespace)::FailureSignalHandler(...) 1# PosixSignals::chained_handler(...) 2# JVM_handle_linux_signal 3# libc.so.6 4# bvar::Reducer<long, bvar::detail::AddTo<long>, bvar::detail::MinusFrom<long>>::SeriesSampler::take_sample() 5# bvar::detail::SamplerCollector::run() 6# bvar::detail::SamplerCollector::sampling_thread(void*) 7# libc.so.6 8# libc.so.6 ``` The same crash occurred independently on two different BEs. This appears similar to #63193, which was addressed by #64040 and included in Doris 4.1.3. There was no memory pressure at the time of the crashes: BE RSS: ~113 GB / ~155 GB BE process memory limit: 1080 GB Physical memory: 1200 GB ### What You Expected? BE should remain stable and should not terminate with SIGSEGV. ### How to Reproduce? We do not currently have a deterministic standalone reproducer. The crashes started while rewriting a large table with approximately 40 billion rows from storage format V2 to V3, while the cluster was also serving its normal production workload. ### Anything Else? #64040 backports the AgentCombiner lifetime changes from apache/brpc#2949. There is also a follow-up upstream fix, apache/brpc#3291, which addresses an additional heap-use-after-free involving ~AgentCombiner()/clear_all_agents() and TLS Agent destruction. The same follow-up change does not appear to be present in the current Doris 4.1 brpc patch. Reporting this because the bvar::SeriesSampler::take_sample() SIGSEGV is still reproducible on Doris 4.1.3 after the related #64040 fix. ### Are you willing to submit PR? - [ ] Yes I am willing to submit a PR! ### Code of Conduct - [x] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
