[jira] [Updated] (IMPALA-10383) Data race in AdmissionController::WaitOnQueued

2020-12-08 Thread Attila Jeges (Jira)


 [ 
https://issues.apache.org/jira/browse/IMPALA-10383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Attila Jeges updated IMPALA-10383:
--
Labels: broken-build flaky  (was: broken-build data flaky)

> Data race in AdmissionController::WaitOnQueued
> --
>
> Key: IMPALA-10383
> URL: https://issues.apache.org/jira/browse/IMPALA-10383
> Project: IMPALA
>  Issue Type: Bug
>Affects Versions: Impala 4.0
>Reporter: Attila Jeges
>Assignee: Thomas Tauber-Marshall
>Priority: Major
>  Labels: broken-build, flaky
>
> TSAN is reporting a data race in {{AdmissionController::WaitOnQueued:}}
> {code:java}
> WARNING: ThreadSanitizer: data race (pid=4257)
>   Write of size 8 at 0x7b58000901b0 by thread T416:
> #0 std::_Hashtable const, impala::AdmissionController::QueueNode>, 
> std::allocator impala::AdmissionController::QueueNode> >, std::__detail::_Select1st, 
> std::equal_to, std::hash, 
> std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash, 
> std::__detail::_Prime_rehash_policy, std::__detail::_Hashtable_traits false, true> >::_M_erase(unsigned long, std::__detail::_Hash_node_base*, 
> std::__detail::_Hash_node impala::AdmissionController::QueueNode>, true>*) 
> /data/jenkins/workspace/impala-asf-master-core-tsan/Impala-Toolchain/toolchain-packages-gcc7.5.0/gcc-7.5.0/lib/gcc/x86_64-pc-linux-gnu/7.5.0/../../../../include/c++/7.5.0/bits/hashtable.h:1891:7
>  (impalad+0x22bbe78)
> #1 std::_Hashtable const, impala::AdmissionController::QueueNode>, 
> std::allocator impala::AdmissionController::QueueNode> >, std::__detail::_Select1st, 
> std::equal_to, std::hash, 
> std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash, 
> std::__detail::_Prime_rehash_policy, std::__detail::_Hashtable_traits false, true> >::_M_erase(std::integral_constant, 
> impala::UniqueIdPB const&) 
> /data/jenkins/workspace/impala-asf-master-core-tsan/Impala-Toolchain/toolchain-packages-gcc7.5.0/gcc-7.5.0/lib/gcc/x86_64-pc-linux-gnu/7.5.0/../../../../include/c++/7.5.0/bits/hashtable.h:1916:7
>  (impalad+0x22bbd3a)
> #2 std::_Hashtable const, impala::AdmissionController::QueueNode>, 
> std::allocator impala::AdmissionController::QueueNode> >, std::__detail::_Select1st, 
> std::equal_to, std::hash, 
> std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash, 
> std::__detail::_Prime_rehash_policy, std::__detail::_Hashtable_traits false, true> >::erase(impala::UniqueIdPB const&) 
> /data/jenkins/workspace/impala-asf-master-core-tsan/Impala-Toolchain/toolchain-packages-gcc7.5.0/gcc-7.5.0/lib/gcc/x86_64-pc-linux-gnu/7.5.0/../../../../include/c++/7.5.0/bits/hashtable.h:759:16
>  (impalad+0x22bbca0)
> #3 std::unordered_map impala::AdmissionController::QueueNode, std::hash, 
> std::equal_to, 
> std::allocator impala::AdmissionController::QueueNode> > >::erase(impala::UniqueIdPB const&) 
> /data/jenkins/workspace/impala-asf-master-core-tsan/Impala-Toolchain/toolchain-packages-gcc7.5.0/gcc-7.5.0/lib/gcc/x86_64-pc-linux-gnu/7.5.0/../../../../include/c++/7.5.0/bits/unordered_map.h:814:21
>  (impalad+0x22bbc50)
> #4 impala::AdmissionController::WaitOnQueued(impala::UniqueIdPB const&, 
> std::unique_ptr std::default_delete >*, long, 
> bool*)::$_6::operator()() const 
> /data/jenkins/workspace/impala-asf-master-core-tsan/repos/Impala/be/src/scheduling/admission-controller.cc:1278:49
>  (impalad+0x229d199)
> #5 
> impala::ScopeExitTrigger  const&, std::unique_ptr std::default_delete >*, long, 
> bool*)::$_6>::~ScopeExitTrigger() 
> /data/jenkins/workspace/impala-asf-master-core-tsan/repos/Impala/be/src/util/scope-exit-trigger.h:40:25
>  (impalad+0x2294ca9)
> #6 impala::AdmissionController::WaitOnQueued(impala::UniqueIdPB const&, 
> std::unique_ptr std::default_delete >*, long, bool*) 
> /data/jenkins/workspace/impala-asf-master-core-tsan/repos/Impala/be/src/scheduling/admission-controller.cc:1333:1
>  (impalad+0x2294912)
> #7 
> impala::LocalAdmissionControlClient::SubmitForAdmission(impala::AdmissionController::AdmissionRequest
>  const&, impala::RuntimeProfile::EventSequence*, 
> std::unique_ptr std::default_delete >*) 
> /data/jenkins/workspace/impala-asf-master-core-tsan/repos/Impala/be/src/scheduling/local-admission-control-client.cc:45:62
>  (impalad+0x2c1e40e)
> #8 impala::ClientRequestState::FinishExecQueryOrDmlRequest() 
> /data/jenkins/workspace/impala-asf-master-core-tsan/repos/Impala/be/src/service/client-request-state.cc:578:52
>  (impalad+0x245c651)
> #9 boost::_mfi::mf0 impala::ClientRequestState>::operator()(impala::ClientRequestState*) const 
> /data/jenkins/workspace/impala-asf-master-core-tsan/Impala-Toolchain/toolchain-packages-gcc7.5.0/boost-1.61.0-p2/include/boost/bind/mem_fn_template.hpp:49:29
>  (impalad+0x2468ef6)
> #10 void 

[jira] [Updated] (IMPALA-10383) Data race in AdmissionController::WaitOnQueued

2020-12-08 Thread Attila Jeges (Jira)


 [ 
https://issues.apache.org/jira/browse/IMPALA-10383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Attila Jeges updated IMPALA-10383:
--
Labels: broken-build data flaky  (was: broken-build flaky)

> Data race in AdmissionController::WaitOnQueued
> --
>
> Key: IMPALA-10383
> URL: https://issues.apache.org/jira/browse/IMPALA-10383
> Project: IMPALA
>  Issue Type: Bug
>Affects Versions: Impala 4.0
>Reporter: Attila Jeges
>Assignee: Thomas Tauber-Marshall
>Priority: Major
>  Labels: broken-build, data, flaky
>
> TSAN is reporting a data race in {{AdmissionController::WaitOnQueued:}}
> {code:java}
> WARNING: ThreadSanitizer: data race (pid=4257)
>   Write of size 8 at 0x7b58000901b0 by thread T416:
> #0 std::_Hashtable const, impala::AdmissionController::QueueNode>, 
> std::allocator impala::AdmissionController::QueueNode> >, std::__detail::_Select1st, 
> std::equal_to, std::hash, 
> std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash, 
> std::__detail::_Prime_rehash_policy, std::__detail::_Hashtable_traits false, true> >::_M_erase(unsigned long, std::__detail::_Hash_node_base*, 
> std::__detail::_Hash_node impala::AdmissionController::QueueNode>, true>*) 
> /data/jenkins/workspace/impala-asf-master-core-tsan/Impala-Toolchain/toolchain-packages-gcc7.5.0/gcc-7.5.0/lib/gcc/x86_64-pc-linux-gnu/7.5.0/../../../../include/c++/7.5.0/bits/hashtable.h:1891:7
>  (impalad+0x22bbe78)
> #1 std::_Hashtable const, impala::AdmissionController::QueueNode>, 
> std::allocator impala::AdmissionController::QueueNode> >, std::__detail::_Select1st, 
> std::equal_to, std::hash, 
> std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash, 
> std::__detail::_Prime_rehash_policy, std::__detail::_Hashtable_traits false, true> >::_M_erase(std::integral_constant, 
> impala::UniqueIdPB const&) 
> /data/jenkins/workspace/impala-asf-master-core-tsan/Impala-Toolchain/toolchain-packages-gcc7.5.0/gcc-7.5.0/lib/gcc/x86_64-pc-linux-gnu/7.5.0/../../../../include/c++/7.5.0/bits/hashtable.h:1916:7
>  (impalad+0x22bbd3a)
> #2 std::_Hashtable const, impala::AdmissionController::QueueNode>, 
> std::allocator impala::AdmissionController::QueueNode> >, std::__detail::_Select1st, 
> std::equal_to, std::hash, 
> std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash, 
> std::__detail::_Prime_rehash_policy, std::__detail::_Hashtable_traits false, true> >::erase(impala::UniqueIdPB const&) 
> /data/jenkins/workspace/impala-asf-master-core-tsan/Impala-Toolchain/toolchain-packages-gcc7.5.0/gcc-7.5.0/lib/gcc/x86_64-pc-linux-gnu/7.5.0/../../../../include/c++/7.5.0/bits/hashtable.h:759:16
>  (impalad+0x22bbca0)
> #3 std::unordered_map impala::AdmissionController::QueueNode, std::hash, 
> std::equal_to, 
> std::allocator impala::AdmissionController::QueueNode> > >::erase(impala::UniqueIdPB const&) 
> /data/jenkins/workspace/impala-asf-master-core-tsan/Impala-Toolchain/toolchain-packages-gcc7.5.0/gcc-7.5.0/lib/gcc/x86_64-pc-linux-gnu/7.5.0/../../../../include/c++/7.5.0/bits/unordered_map.h:814:21
>  (impalad+0x22bbc50)
> #4 impala::AdmissionController::WaitOnQueued(impala::UniqueIdPB const&, 
> std::unique_ptr std::default_delete >*, long, 
> bool*)::$_6::operator()() const 
> /data/jenkins/workspace/impala-asf-master-core-tsan/repos/Impala/be/src/scheduling/admission-controller.cc:1278:49
>  (impalad+0x229d199)
> #5 
> impala::ScopeExitTrigger  const&, std::unique_ptr std::default_delete >*, long, 
> bool*)::$_6>::~ScopeExitTrigger() 
> /data/jenkins/workspace/impala-asf-master-core-tsan/repos/Impala/be/src/util/scope-exit-trigger.h:40:25
>  (impalad+0x2294ca9)
> #6 impala::AdmissionController::WaitOnQueued(impala::UniqueIdPB const&, 
> std::unique_ptr std::default_delete >*, long, bool*) 
> /data/jenkins/workspace/impala-asf-master-core-tsan/repos/Impala/be/src/scheduling/admission-controller.cc:1333:1
>  (impalad+0x2294912)
> #7 
> impala::LocalAdmissionControlClient::SubmitForAdmission(impala::AdmissionController::AdmissionRequest
>  const&, impala::RuntimeProfile::EventSequence*, 
> std::unique_ptr std::default_delete >*) 
> /data/jenkins/workspace/impala-asf-master-core-tsan/repos/Impala/be/src/scheduling/local-admission-control-client.cc:45:62
>  (impalad+0x2c1e40e)
> #8 impala::ClientRequestState::FinishExecQueryOrDmlRequest() 
> /data/jenkins/workspace/impala-asf-master-core-tsan/repos/Impala/be/src/service/client-request-state.cc:578:52
>  (impalad+0x245c651)
> #9 boost::_mfi::mf0 impala::ClientRequestState>::operator()(impala::ClientRequestState*) const 
> /data/jenkins/workspace/impala-asf-master-core-tsan/Impala-Toolchain/toolchain-packages-gcc7.5.0/boost-1.61.0-p2/include/boost/bind/mem_fn_template.hpp:49:29
>  (impalad+0x2468ef6)
> #10 void 

[jira] [Updated] (IMPALA-10383) Data race in AdmissionController::WaitOnQueued

2020-12-08 Thread Attila Jeges (Jira)


 [ 
https://issues.apache.org/jira/browse/IMPALA-10383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Attila Jeges updated IMPALA-10383:
--
Labels: broken-build  (was: )

> Data race in AdmissionController::WaitOnQueued
> --
>
> Key: IMPALA-10383
> URL: https://issues.apache.org/jira/browse/IMPALA-10383
> Project: IMPALA
>  Issue Type: Bug
>Affects Versions: Impala 4.0
>Reporter: Attila Jeges
>Assignee: Thomas Tauber-Marshall
>Priority: Major
>  Labels: broken-build
>
> TSAN is reporting a data race in {{AdmissionController::WaitOnQueued:}}
> {code:java}
> WARNING: ThreadSanitizer: data race (pid=4257)
>   Write of size 8 at 0x7b58000901b0 by thread T416:
> #0 std::_Hashtable const, impala::AdmissionController::QueueNode>, 
> std::allocator impala::AdmissionController::QueueNode> >, std::__detail::_Select1st, 
> std::equal_to, std::hash, 
> std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash, 
> std::__detail::_Prime_rehash_policy, std::__detail::_Hashtable_traits false, true> >::_M_erase(unsigned long, std::__detail::_Hash_node_base*, 
> std::__detail::_Hash_node impala::AdmissionController::QueueNode>, true>*) 
> /data/jenkins/workspace/impala-asf-master-core-tsan/Impala-Toolchain/toolchain-packages-gcc7.5.0/gcc-7.5.0/lib/gcc/x86_64-pc-linux-gnu/7.5.0/../../../../include/c++/7.5.0/bits/hashtable.h:1891:7
>  (impalad+0x22bbe78)
> #1 std::_Hashtable const, impala::AdmissionController::QueueNode>, 
> std::allocator impala::AdmissionController::QueueNode> >, std::__detail::_Select1st, 
> std::equal_to, std::hash, 
> std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash, 
> std::__detail::_Prime_rehash_policy, std::__detail::_Hashtable_traits false, true> >::_M_erase(std::integral_constant, 
> impala::UniqueIdPB const&) 
> /data/jenkins/workspace/impala-asf-master-core-tsan/Impala-Toolchain/toolchain-packages-gcc7.5.0/gcc-7.5.0/lib/gcc/x86_64-pc-linux-gnu/7.5.0/../../../../include/c++/7.5.0/bits/hashtable.h:1916:7
>  (impalad+0x22bbd3a)
> #2 std::_Hashtable const, impala::AdmissionController::QueueNode>, 
> std::allocator impala::AdmissionController::QueueNode> >, std::__detail::_Select1st, 
> std::equal_to, std::hash, 
> std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash, 
> std::__detail::_Prime_rehash_policy, std::__detail::_Hashtable_traits false, true> >::erase(impala::UniqueIdPB const&) 
> /data/jenkins/workspace/impala-asf-master-core-tsan/Impala-Toolchain/toolchain-packages-gcc7.5.0/gcc-7.5.0/lib/gcc/x86_64-pc-linux-gnu/7.5.0/../../../../include/c++/7.5.0/bits/hashtable.h:759:16
>  (impalad+0x22bbca0)
> #3 std::unordered_map impala::AdmissionController::QueueNode, std::hash, 
> std::equal_to, 
> std::allocator impala::AdmissionController::QueueNode> > >::erase(impala::UniqueIdPB const&) 
> /data/jenkins/workspace/impala-asf-master-core-tsan/Impala-Toolchain/toolchain-packages-gcc7.5.0/gcc-7.5.0/lib/gcc/x86_64-pc-linux-gnu/7.5.0/../../../../include/c++/7.5.0/bits/unordered_map.h:814:21
>  (impalad+0x22bbc50)
> #4 impala::AdmissionController::WaitOnQueued(impala::UniqueIdPB const&, 
> std::unique_ptr std::default_delete >*, long, 
> bool*)::$_6::operator()() const 
> /data/jenkins/workspace/impala-asf-master-core-tsan/repos/Impala/be/src/scheduling/admission-controller.cc:1278:49
>  (impalad+0x229d199)
> #5 
> impala::ScopeExitTrigger  const&, std::unique_ptr std::default_delete >*, long, 
> bool*)::$_6>::~ScopeExitTrigger() 
> /data/jenkins/workspace/impala-asf-master-core-tsan/repos/Impala/be/src/util/scope-exit-trigger.h:40:25
>  (impalad+0x2294ca9)
> #6 impala::AdmissionController::WaitOnQueued(impala::UniqueIdPB const&, 
> std::unique_ptr std::default_delete >*, long, bool*) 
> /data/jenkins/workspace/impala-asf-master-core-tsan/repos/Impala/be/src/scheduling/admission-controller.cc:1333:1
>  (impalad+0x2294912)
> #7 
> impala::LocalAdmissionControlClient::SubmitForAdmission(impala::AdmissionController::AdmissionRequest
>  const&, impala::RuntimeProfile::EventSequence*, 
> std::unique_ptr std::default_delete >*) 
> /data/jenkins/workspace/impala-asf-master-core-tsan/repos/Impala/be/src/scheduling/local-admission-control-client.cc:45:62
>  (impalad+0x2c1e40e)
> #8 impala::ClientRequestState::FinishExecQueryOrDmlRequest() 
> /data/jenkins/workspace/impala-asf-master-core-tsan/repos/Impala/be/src/service/client-request-state.cc:578:52
>  (impalad+0x245c651)
> #9 boost::_mfi::mf0 impala::ClientRequestState>::operator()(impala::ClientRequestState*) const 
> /data/jenkins/workspace/impala-asf-master-core-tsan/Impala-Toolchain/toolchain-packages-gcc7.5.0/boost-1.61.0-p2/include/boost/bind/mem_fn_template.hpp:49:29
>  (impalad+0x2468ef6)
> #10 void boost::_bi::list1 
> >::operator(), 
> 

[jira] [Updated] (IMPALA-10383) Data race in AdmissionController::WaitOnQueued

2020-12-08 Thread Attila Jeges (Jira)


 [ 
https://issues.apache.org/jira/browse/IMPALA-10383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Attila Jeges updated IMPALA-10383:
--
Labels: broken-build flaky  (was: broken-build)

> Data race in AdmissionController::WaitOnQueued
> --
>
> Key: IMPALA-10383
> URL: https://issues.apache.org/jira/browse/IMPALA-10383
> Project: IMPALA
>  Issue Type: Bug
>Affects Versions: Impala 4.0
>Reporter: Attila Jeges
>Assignee: Thomas Tauber-Marshall
>Priority: Major
>  Labels: broken-build, flaky
>
> TSAN is reporting a data race in {{AdmissionController::WaitOnQueued:}}
> {code:java}
> WARNING: ThreadSanitizer: data race (pid=4257)
>   Write of size 8 at 0x7b58000901b0 by thread T416:
> #0 std::_Hashtable const, impala::AdmissionController::QueueNode>, 
> std::allocator impala::AdmissionController::QueueNode> >, std::__detail::_Select1st, 
> std::equal_to, std::hash, 
> std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash, 
> std::__detail::_Prime_rehash_policy, std::__detail::_Hashtable_traits false, true> >::_M_erase(unsigned long, std::__detail::_Hash_node_base*, 
> std::__detail::_Hash_node impala::AdmissionController::QueueNode>, true>*) 
> /data/jenkins/workspace/impala-asf-master-core-tsan/Impala-Toolchain/toolchain-packages-gcc7.5.0/gcc-7.5.0/lib/gcc/x86_64-pc-linux-gnu/7.5.0/../../../../include/c++/7.5.0/bits/hashtable.h:1891:7
>  (impalad+0x22bbe78)
> #1 std::_Hashtable const, impala::AdmissionController::QueueNode>, 
> std::allocator impala::AdmissionController::QueueNode> >, std::__detail::_Select1st, 
> std::equal_to, std::hash, 
> std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash, 
> std::__detail::_Prime_rehash_policy, std::__detail::_Hashtable_traits false, true> >::_M_erase(std::integral_constant, 
> impala::UniqueIdPB const&) 
> /data/jenkins/workspace/impala-asf-master-core-tsan/Impala-Toolchain/toolchain-packages-gcc7.5.0/gcc-7.5.0/lib/gcc/x86_64-pc-linux-gnu/7.5.0/../../../../include/c++/7.5.0/bits/hashtable.h:1916:7
>  (impalad+0x22bbd3a)
> #2 std::_Hashtable const, impala::AdmissionController::QueueNode>, 
> std::allocator impala::AdmissionController::QueueNode> >, std::__detail::_Select1st, 
> std::equal_to, std::hash, 
> std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash, 
> std::__detail::_Prime_rehash_policy, std::__detail::_Hashtable_traits false, true> >::erase(impala::UniqueIdPB const&) 
> /data/jenkins/workspace/impala-asf-master-core-tsan/Impala-Toolchain/toolchain-packages-gcc7.5.0/gcc-7.5.0/lib/gcc/x86_64-pc-linux-gnu/7.5.0/../../../../include/c++/7.5.0/bits/hashtable.h:759:16
>  (impalad+0x22bbca0)
> #3 std::unordered_map impala::AdmissionController::QueueNode, std::hash, 
> std::equal_to, 
> std::allocator impala::AdmissionController::QueueNode> > >::erase(impala::UniqueIdPB const&) 
> /data/jenkins/workspace/impala-asf-master-core-tsan/Impala-Toolchain/toolchain-packages-gcc7.5.0/gcc-7.5.0/lib/gcc/x86_64-pc-linux-gnu/7.5.0/../../../../include/c++/7.5.0/bits/unordered_map.h:814:21
>  (impalad+0x22bbc50)
> #4 impala::AdmissionController::WaitOnQueued(impala::UniqueIdPB const&, 
> std::unique_ptr std::default_delete >*, long, 
> bool*)::$_6::operator()() const 
> /data/jenkins/workspace/impala-asf-master-core-tsan/repos/Impala/be/src/scheduling/admission-controller.cc:1278:49
>  (impalad+0x229d199)
> #5 
> impala::ScopeExitTrigger  const&, std::unique_ptr std::default_delete >*, long, 
> bool*)::$_6>::~ScopeExitTrigger() 
> /data/jenkins/workspace/impala-asf-master-core-tsan/repos/Impala/be/src/util/scope-exit-trigger.h:40:25
>  (impalad+0x2294ca9)
> #6 impala::AdmissionController::WaitOnQueued(impala::UniqueIdPB const&, 
> std::unique_ptr std::default_delete >*, long, bool*) 
> /data/jenkins/workspace/impala-asf-master-core-tsan/repos/Impala/be/src/scheduling/admission-controller.cc:1333:1
>  (impalad+0x2294912)
> #7 
> impala::LocalAdmissionControlClient::SubmitForAdmission(impala::AdmissionController::AdmissionRequest
>  const&, impala::RuntimeProfile::EventSequence*, 
> std::unique_ptr std::default_delete >*) 
> /data/jenkins/workspace/impala-asf-master-core-tsan/repos/Impala/be/src/scheduling/local-admission-control-client.cc:45:62
>  (impalad+0x2c1e40e)
> #8 impala::ClientRequestState::FinishExecQueryOrDmlRequest() 
> /data/jenkins/workspace/impala-asf-master-core-tsan/repos/Impala/be/src/service/client-request-state.cc:578:52
>  (impalad+0x245c651)
> #9 boost::_mfi::mf0 impala::ClientRequestState>::operator()(impala::ClientRequestState*) const 
> /data/jenkins/workspace/impala-asf-master-core-tsan/Impala-Toolchain/toolchain-packages-gcc7.5.0/boost-1.61.0-p2/include/boost/bind/mem_fn_template.hpp:49:29
>  (impalad+0x2468ef6)
> #10 void boost::_bi::list1 
>