[jira] [Assigned] (IMPALA-3380) Add TCP timeouts to all RPCs that don't block

2020-02-05 Thread Sahil Takiar (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-3380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar reassigned IMPALA-3380: Assignee: (was: Michael Ho) > Add TCP timeouts to all RPCs that don't block >

[jira] [Assigned] (IMPALA-8714) Metrics for tracking query failure reasons

2020-02-05 Thread Sahil Takiar (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar reassigned IMPALA-8714: Assignee: Sahil Takiar > Metrics for tracking query failure reasons >

[jira] [Commented] (IMPALA-9316) Consider coalescing S3 scans

2020-02-04 Thread Sahil Takiar (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-9316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17030093#comment-17030093 ] Sahil Takiar commented on IMPALA-9316: -- Talked with Gopal V about this. This change will be

[jira] [Resolved] (IMPALA-9342) Membership updates should only remove quiescing nodes from the blacklist

2020-02-06 Thread Sahil Takiar (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-9342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar resolved IMPALA-9342. -- Fix Version/s: Impala 3.4.0 Resolution: Fixed > Membership updates should only remove

[jira] [Updated] (IMPALA-9225) Retryable queries should spool all results before returning any to the client

2020-02-06 Thread Sahil Takiar (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-9225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated IMPALA-9225: - Description: If query retries are enabled, a query should not return any results to the client

[jira] [Commented] (IMPALA-9058) S3 tests failing with FileNotFoundException getVersionMarkerItem on ../VERSION

2020-01-30 Thread Sahil Takiar (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-9058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17026970#comment-17026970 ] Sahil Takiar commented on IMPALA-9058: -- Here is the full stack of the Java exception thrown in HMS:

[jira] [Resolved] (IMPALA-9262) Blacklist test test_kill_impalad_with_running_queries fails in exhaustive mode

2020-02-03 Thread Sahil Takiar (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-9262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar resolved IMPALA-9262. -- Resolution: Fixed Issue didn't occur over the weekend (it was happening almost every day

[jira] [Created] (IMPALA-9364) Web UI improvements for retried queries

2020-02-07 Thread Sahil Takiar (Jira)
Sahil Takiar created IMPALA-9364: Summary: Web UI improvements for retried queries Key: IMPALA-9364 URL: https://issues.apache.org/jira/browse/IMPALA-9364 Project: IMPALA Issue Type:

[jira] [Commented] (IMPALA-9316) Consider coalescing S3 scans

2020-02-05 Thread Sahil Takiar (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-9316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17030820#comment-17030820 ] Sahil Takiar commented on IMPALA-9316: -- Thanks for the pointers Tim, do you mean that issuing

[jira] [Created] (IMPALA-9327) Data cache should be able to borrow spill-to-disk space

2020-01-24 Thread Sahil Takiar (Jira)
Sahil Takiar created IMPALA-9327: Summary: Data cache should be able to borrow spill-to-disk space Key: IMPALA-9327 URL: https://issues.apache.org/jira/browse/IMPALA-9327 Project: IMPALA

[jira] [Resolved] (IMPALA-9334) Log node blacklisting removals in ClusterMembershipMgr

2020-01-28 Thread Sahil Takiar (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-9334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar resolved IMPALA-9334. -- Fix Version/s: Impala 3.4.0 Resolution: Fixed > Log node blacklisting removals in

[jira] [Resolved] (IMPALA-9307) TSAN data race in kudu::Socket::Accept and TraceLog::UpdateCategoryGroupEnabledFlag

2020-01-28 Thread Sahil Takiar (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-9307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar resolved IMPALA-9307. -- Resolution: Not A Problem Fixed after adding the {{-DDYNAMIC_ANNOTATIONS_ENABLED}} to the

[jira] [Resolved] (IMPALA-9315) TSAN data race in kudu::ScopedWatchKernelStack / KernelStackWatchdog

2020-01-28 Thread Sahil Takiar (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-9315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar resolved IMPALA-9315. -- Resolution: Not A Problem Fixed after adding the {{-DDYNAMIC_ANNOTATIONS_ENABLED}} to the

[jira] [Commented] (IMPALA-6259) Remove workaround for posix_memalign in SystemAllocator after LLVM 5.0 upgrade

2020-02-04 Thread Sahil Takiar (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-6259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17030275#comment-17030275 ] Sahil Takiar commented on IMPALA-6259: -- Unfortunately, while this was fixed for ASAN and LSAN in 

[jira] [Updated] (IMPALA-6259) Remove workaround for posix_memalign in SystemAllocator after LLVM 6.0 upgrade

2020-02-04 Thread Sahil Takiar (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-6259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated IMPALA-6259: - Summary: Remove workaround for posix_memalign in SystemAllocator after LLVM 6.0 upgrade (was:

[jira] [Commented] (IMPALA-9393) TestBlacklist.test_kill_impalad_with_running_queries fails on centos6

2020-02-17 Thread Sahil Takiar (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-9393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17038772#comment-17038772 ] Sahil Takiar commented on IMPALA-9393: -- We've seen issues with this test in the past, will take a

[jira] [Assigned] (IMPALA-9393) TestBlacklist.test_kill_impalad_with_running_queries fails on centos6

2020-02-17 Thread Sahil Takiar (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-9393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar reassigned IMPALA-9393: Assignee: Sahil Takiar (was: Thomas Tauber-Marshall) >

[jira] [Commented] (IMPALA-9374) Possible data race in TupleDescriptor::GetLlvmStruct

2020-02-18 Thread Sahil Takiar (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-9374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17039515#comment-17039515 ] Sahil Takiar commented on IMPALA-9374: -- This happens in a couple different places as well:

[jira] [Created] (IMPALA-9400) Impala Ozone Support

2020-02-18 Thread Sahil Takiar (Jira)
Sahil Takiar created IMPALA-9400: Summary: Impala Ozone Support Key: IMPALA-9400 URL: https://issues.apache.org/jira/browse/IMPALA-9400 Project: IMPALA Issue Type: New Feature

[jira] [Comment Edited] (IMPALA-9374) Possible data race in TupleDescriptor::GetLlvmStruct

2020-02-18 Thread Sahil Takiar (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-9374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17039512#comment-17039512 ] Sahil Takiar edited comment on IMPALA-9374 at 2/18/20 10:24 PM: The

[jira] [Commented] (IMPALA-9374) Possible data race in TupleDescriptor::GetLlvmStruct

2020-02-18 Thread Sahil Takiar (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-9374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17039512#comment-17039512 ] Sahil Takiar commented on IMPALA-9374: -- The difference between the two stacks here is: {code:java}

[jira] [Updated] (IMPALA-9405) Unify MetaStoreClientPool Usage

2020-02-20 Thread Sahil Takiar (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-9405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated IMPALA-9405: - Summary: Unify MetaStoreClientPool Usage (was: Improvements for Frontend#metaStoreClientPool_)

[jira] [Commented] (IMPALA-9405) Unify MetaStoreClientPool Usage

2020-02-20 Thread Sahil Takiar (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-9405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17041278#comment-17041278 ] Sahil Takiar commented on IMPALA-9405: -- Thanks for the input everyone. Sounds like we should just

[jira] [Commented] (IMPALA-8521) Lots of "unreleased ByteBuffers allocated by read()" errors from HDFS client

2020-02-20 Thread Sahil Takiar (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-8521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17041162#comment-17041162 ] Sahil Takiar commented on IMPALA-8521: -- I'll take a closer look today. My gut feeling is that this

[jira] [Commented] (IMPALA-9405) Improvements for Frontend#metaStoreClientPool_

2020-02-19 Thread Sahil Takiar (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-9405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17040464#comment-17040464 ] Sahil Takiar commented on IMPALA-9405: -- [~boroknagyz], [~vihangk1] does this make sense? >

[jira] [Created] (IMPALA-9405) Improvements for Frontend#metaStoreClientPool_

2020-02-19 Thread Sahil Takiar (Jira)
Sahil Takiar created IMPALA-9405: Summary: Improvements for Frontend#metaStoreClientPool_ Key: IMPALA-9405 URL: https://issues.apache.org/jira/browse/IMPALA-9405 Project: IMPALA Issue Type:

[jira] [Commented] (IMPALA-9404) Instantiations/ExprTest.MathConversionFunctions fails in TSAN builds

2020-02-19 Thread Sahil Takiar (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-9404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17040288#comment-17040288 ] Sahil Takiar commented on IMPALA-9404: -- Not sure why this is failing, but I don't think it is due

[jira] [Created] (IMPALA-9404) Instantiations/ExprTest.MathConversionFunctions fails in TSAN builds

2020-02-19 Thread Sahil Takiar (Jira)
Sahil Takiar created IMPALA-9404: Summary: Instantiations/ExprTest.MathConversionFunctions fails in TSAN builds Key: IMPALA-9404 URL: https://issues.apache.org/jira/browse/IMPALA-9404 Project: IMPALA

[jira] [Assigned] (IMPALA-9313) TSAN data race in TmpFileMgr::File::Blacklist

2020-02-19 Thread Sahil Takiar (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-9313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar reassigned IMPALA-9313: Assignee: Sahil Takiar > TSAN data race in TmpFileMgr::File::Blacklist >

[jira] [Created] (IMPALA-9403) Allow TSAN to be set on codegen

2020-02-19 Thread Sahil Takiar (Jira)
Sahil Takiar created IMPALA-9403: Summary: Allow TSAN to be set on codegen Key: IMPALA-9403 URL: https://issues.apache.org/jira/browse/IMPALA-9403 Project: IMPALA Issue Type: Sub-task

[jira] [Commented] (IMPALA-8521) Lots of "unreleased ByteBuffers allocated by read()" errors from HDFS client

2020-02-20 Thread Sahil Takiar (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-8521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17041379#comment-17041379 ] Sahil Takiar commented on IMPALA-8521: -- Okay, looks like this is a bug in the HDFS client code. At

[jira] [Commented] (IMPALA-9314) Thrift server shutdown is racey

2020-02-11 Thread Sahil Takiar (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-9314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17034656#comment-17034656 ] Sahil Takiar commented on IMPALA-9314: -- For now, I have suppressed these warnings in the

[jira] [Created] (IMPALA-9374) Possible data race in TupleDescriptor::GetLlvmStruct

2020-02-11 Thread Sahil Takiar (Jira)
Sahil Takiar created IMPALA-9374: Summary: Possible data race in TupleDescriptor::GetLlvmStruct Key: IMPALA-9374 URL: https://issues.apache.org/jira/browse/IMPALA-9374 Project: IMPALA Issue

[jira] [Resolved] (IMPALA-9308) TSAN data race in ReservationTracker::used_reservation_ updates

2020-02-11 Thread Sahil Takiar (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-9308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar resolved IMPALA-9308. -- Fix Version/s: Impala 3.4.0 Assignee: Sahil Takiar Resolution: Fixed This has

[jira] [Updated] (IMPALA-9374) Possible data race in TupleDescriptor::GetLlvmStruct

2020-02-11 Thread Sahil Takiar (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-9374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated IMPALA-9374: - Description: A full run of E2E tests against a TSAN build has a ton of the following data

[jira] [Commented] (IMPALA-8577) Crash during OpenSSLSocket.read

2020-02-11 Thread Sahil Takiar (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-8577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17034648#comment-17034648 ] Sahil Takiar commented on IMPALA-8577: -- Can't remember for sure, but I think it was 1.0.2 > Crash

[jira] [Created] (IMPALA-9388) Possible data race in BloomFilter::BucketFindAVX2

2020-02-14 Thread Sahil Takiar (Jira)
Sahil Takiar created IMPALA-9388: Summary: Possible data race in BloomFilter::BucketFindAVX2 Key: IMPALA-9388 URL: https://issues.apache.org/jira/browse/IMPALA-9388 Project: IMPALA Issue

[jira] [Commented] (IMPALA-9388) Possible data race in BloomFilter::BucketFindAVX2

2020-02-14 Thread Sahil Takiar (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-9388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17037281#comment-17037281 ] Sahil Takiar commented on IMPALA-9388: -- I haven't had much luck in figuring out what is causing

[jira] [Created] (IMPALA-9370) Re-factor ImpalaServer, ClientRequestState, Coordinator protocol

2020-02-10 Thread Sahil Takiar (Jira)
Sahil Takiar created IMPALA-9370: Summary: Re-factor ImpalaServer, ClientRequestState, Coordinator protocol Key: IMPALA-9370 URL: https://issues.apache.org/jira/browse/IMPALA-9370 Project: IMPALA

[jira] [Reopened] (IMPALA-9262) Blacklist test test_kill_impalad_with_running_queries fails in exhaustive mode

2020-01-15 Thread Sahil Takiar (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-9262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar reopened IMPALA-9262: -- Still seems to be happening, different error now though: {code}

[jira] [Resolved] (IMPALA-9295) RPC failures don't always trigger a blacklist

2020-01-15 Thread Sahil Takiar (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-9295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar resolved IMPALA-9295. -- Fix Version/s: Impala 3.4.0 Resolution: Fixed > RPC failures don't always trigger a

[jira] [Created] (IMPALA-9293) Impala Doc: Revise explanation of HDFS trashcan usage on S3

2020-01-13 Thread Sahil Takiar (Jira)
Sahil Takiar created IMPALA-9293: Summary: Impala Doc: Revise explanation of HDFS trashcan usage on S3 Key: IMPALA-9293 URL: https://issues.apache.org/jira/browse/IMPALA-9293 Project: IMPALA

[jira] [Created] (IMPALA-9292) TestWebPage.test_catalog flaky with InconsistentMetadataFetchException

2020-01-13 Thread Sahil Takiar (Jira)
Sahil Takiar created IMPALA-9292: Summary: TestWebPage.test_catalog flaky with InconsistentMetadataFetchException Key: IMPALA-9292 URL: https://issues.apache.org/jira/browse/IMPALA-9292 Project:

[jira] [Updated] (IMPALA-9292) TestWebPage.test_catalog flaky with InconsistentMetadataFetchException

2020-01-13 Thread Sahil Takiar (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-9292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated IMPALA-9292: - Description: On a ubuntu-16.04-dockerised-tests build: {code:java}

[jira] [Commented] (IMPALA-9253) Blacklist additional posix error codes for failed DataStreamService RPCs

2020-01-13 Thread Sahil Takiar (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-9253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17014548#comment-17014548 ] Sahil Takiar commented on IMPALA-9253: -- I've hit ECONNRESET (errno = 104) "Connection reset by

[jira] [Created] (IMPALA-9295) RPC failures don't always trigger a blacklist

2020-01-13 Thread Sahil Takiar (Jira)
Sahil Takiar created IMPALA-9295: Summary: RPC failures don't always trigger a blacklist Key: IMPALA-9295 URL: https://issues.apache.org/jira/browse/IMPALA-9295 Project: IMPALA Issue Type:

[jira] [Commented] (IMPALA-1995) Flaky test: PlannerTest.testHbase: splits for HBASE KEYRANGE not set up correctly.

2020-01-14 Thread Sahil Takiar (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-1995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015192#comment-17015192 ] Sahil Takiar commented on IMPALA-1995: -- Happened again in

[jira] [Resolved] (IMPALA-9267) Impala hits DCHECK in ClientRequestState due to invalid state transition

2020-01-13 Thread Sahil Takiar (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-9267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar resolved IMPALA-9267. -- Fix Version/s: Impala 3.4.0 Resolution: Fixed > Impala hits DCHECK in

[jira] [Resolved] (IMPALA-9293) Impala Doc: Revise explanation of HDFS trashcan usage on S3

2020-01-13 Thread Sahil Takiar (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-9293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar resolved IMPALA-9293. -- Fix Version/s: Impala 3.4.0 Resolution: Fixed > Impala Doc: Revise explanation of HDFS

[jira] [Created] (IMPALA-9296) Move FragmentInstanceExecStatus' AuxErrorInfo to StatefulStatus

2020-01-14 Thread Sahil Takiar (Jira)
Sahil Takiar created IMPALA-9296: Summary: Move FragmentInstanceExecStatus' AuxErrorInfo to StatefulStatus Key: IMPALA-9296 URL: https://issues.apache.org/jira/browse/IMPALA-9296 Project: IMPALA

[jira] [Commented] (IMPALA-9295) RPC failures don't always trigger a blacklist

2020-01-14 Thread Sahil Takiar (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-9295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015458#comment-17015458 ] Sahil Takiar commented on IMPALA-9295: -- Thanks for catching that, filed IMPALA-9296. > RPC

[jira] [Created] (IMPALA-9313) TSAN data race in TmpFileMgr::File::Blacklist

2020-01-22 Thread Sahil Takiar (Jira)
Sahil Takiar created IMPALA-9313: Summary: TSAN data race in TmpFileMgr::File::Blacklist Key: IMPALA-9313 URL: https://issues.apache.org/jira/browse/IMPALA-9313 Project: IMPALA Issue Type:

[jira] [Created] (IMPALA-9314) Thrift server shutdown is racey

2020-01-22 Thread Sahil Takiar (Jira)
Sahil Takiar created IMPALA-9314: Summary: Thrift server shutdown is racey Key: IMPALA-9314 URL: https://issues.apache.org/jira/browse/IMPALA-9314 Project: IMPALA Issue Type: Sub-task

[jira] [Commented] (IMPALA-9315) TSAN data race in kudu::ScopedWatchKernelStack / KernelStackWatchdog

2020-01-22 Thread Sahil Takiar (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-9315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17021283#comment-17021283 ] Sahil Takiar commented on IMPALA-9315: -- Similar data race: {code} WARNING: ThreadSanitizer: data

[jira] [Created] (IMPALA-9315) TSAN data race in kudu::ScopedWatchKernelStack / KernelStackWatchdog

2020-01-22 Thread Sahil Takiar (Jira)
Sahil Takiar created IMPALA-9315: Summary: TSAN data race in kudu::ScopedWatchKernelStack / KernelStackWatchdog Key: IMPALA-9315 URL: https://issues.apache.org/jira/browse/IMPALA-9315 Project: IMPALA

[jira] [Commented] (IMPALA-9112) Consider removing hdfsExists calls when writing files to S3

2020-01-22 Thread Sahil Takiar (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-9112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17021262#comment-17021262 ] Sahil Takiar commented on IMPALA-9112: -- I looked into this briefly, and there is an issue I'm not

[jira] [Commented] (IMPALA-9058) S3 tests failing with FileNotFoundException getVersionMarkerItem on ../VERSION

2020-01-22 Thread Sahil Takiar (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-9058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17021274#comment-17021274 ] Sahil Takiar commented on IMPALA-9058: -- Still seeing this even with HADOOP-16520 Error is pretty

[jira] [Commented] (IMPALA-9314) Thrift server shutdown is racey

2020-01-22 Thread Sahil Takiar (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-9314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17021295#comment-17021295 ] Sahil Takiar commented on IMPALA-9314: -- Data race on {{stop_}} {code:java} WARNING:

[jira] [Comment Edited] (IMPALA-9314) Thrift server shutdown is racey

2020-01-22 Thread Sahil Takiar (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-9314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17021295#comment-17021295 ] Sahil Takiar edited comment on IMPALA-9314 at 1/22/20 5:18 PM: --- Data race

[jira] [Created] (IMPALA-9316) Consider coalescing S3 scans

2020-01-22 Thread Sahil Takiar (Jira)
Sahil Takiar created IMPALA-9316: Summary: Consider coalescing S3 scans Key: IMPALA-9316 URL: https://issues.apache.org/jira/browse/IMPALA-9316 Project: IMPALA Issue Type: Improvement

[jira] [Assigned] (IMPALA-5904) Enable ThreadSanitizer for Impala

2020-01-22 Thread Sahil Takiar (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-5904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar reassigned IMPALA-5904: Assignee: Sahil Takiar > Enable ThreadSanitizer for Impala >

[jira] [Updated] (IMPALA-9137) Blacklist node if a DataStreamService RPC to the node fails

2020-01-16 Thread Sahil Takiar (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-9137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated IMPALA-9137: - Parent: (was: IMPALA-9124) Issue Type: Bug (was: Sub-task) > Blacklist node if a

[jira] [Updated] (IMPALA-8339) Coordinator should be more resilient to fragment instances startup failure

2020-01-16 Thread Sahil Takiar (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-8339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated IMPALA-8339: - Parent: IMPALA-9299 Issue Type: Sub-task (was: Improvement) > Coordinator should be

[jira] [Created] (IMPALA-9301) Aux error info should detect multiple RPC failures

2020-01-16 Thread Sahil Takiar (Jira)
Sahil Takiar created IMPALA-9301: Summary: Aux error info should detect multiple RPC failures Key: IMPALA-9301 URL: https://issues.apache.org/jira/browse/IMPALA-9301 Project: IMPALA Issue

[jira] [Updated] (IMPALA-9243) Coordinator Web UI should list which executors have been blacklisted

2020-01-16 Thread Sahil Takiar (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-9243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated IMPALA-9243: - Parent: IMPALA-9299 Issue Type: Sub-task (was: Improvement) > Coordinator Web UI

[jira] [Updated] (IMPALA-9137) Blacklist node if a DataStreamService RPC to the node fails

2020-01-16 Thread Sahil Takiar (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-9137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated IMPALA-9137: - Parent: IMPALA-9299 Issue Type: Sub-task (was: Bug) > Blacklist node if a

[jira] [Updated] (IMPALA-9224) Blacklist nodes with faulty disks

2020-01-16 Thread Sahil Takiar (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-9224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated IMPALA-9224: - Parent: IMPALA-9299 Issue Type: Sub-task (was: Improvement) > Blacklist nodes with

[jira] [Updated] (IMPALA-9253) Blacklist additional posix error codes for failed DataStreamService RPCs

2020-01-16 Thread Sahil Takiar (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-9253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated IMPALA-9253: - Parent: IMPALA-9299 Issue Type: Sub-task (was: Improvement) > Blacklist additional

[jira] [Created] (IMPALA-9299) Node Blacklisting: Coordinators should blacklist unhealthy nodes

2020-01-16 Thread Sahil Takiar (Jira)
Sahil Takiar created IMPALA-9299: Summary: Node Blacklisting: Coordinators should blacklist unhealthy nodes Key: IMPALA-9299 URL: https://issues.apache.org/jira/browse/IMPALA-9299 Project: IMPALA

[jira] [Created] (IMPALA-9300) Add a limit on the number of nodes that can be blacklisted per query

2020-01-16 Thread Sahil Takiar (Jira)
Sahil Takiar created IMPALA-9300: Summary: Add a limit on the number of nodes that can be blacklisted per query Key: IMPALA-9300 URL: https://issues.apache.org/jira/browse/IMPALA-9300 Project: IMPALA

[jira] [Resolved] (IMPALA-9296) Move FragmentInstanceExecStatus' AuxErrorInfo to StatefulStatus

2020-01-20 Thread Sahil Takiar (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-9296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar resolved IMPALA-9296. -- Fix Version/s: Impala 3.4.0 Resolution: Fixed > Move FragmentInstanceExecStatus'

[jira] [Created] (IMPALA-9307) TSAN data race in kudu::Socket::Accept and TraceLog::UpdateCategoryGroupEnabledFlag

2020-01-20 Thread Sahil Takiar (Jira)
Sahil Takiar created IMPALA-9307: Summary: TSAN data race in kudu::Socket::Accept and TraceLog::UpdateCategoryGroupEnabledFlag Key: IMPALA-9307 URL: https://issues.apache.org/jira/browse/IMPALA-9307

[jira] [Created] (IMPALA-9308) TSAN data race in ReservationTracker::used_reservation_ updates

2020-01-20 Thread Sahil Takiar (Jira)
Sahil Takiar created IMPALA-9308: Summary: TSAN data race in ReservationTracker::used_reservation_ updates Key: IMPALA-9308 URL: https://issues.apache.org/jira/browse/IMPALA-9308 Project: IMPALA

[jira] [Commented] (IMPALA-9308) TSAN data race in ReservationTracker::used_reservation_ updates

2020-01-20 Thread Sahil Takiar (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-9308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17019801#comment-17019801 ] Sahil Takiar commented on IMPALA-9308: -- The main usages of {{used_reservation_}} are in

[jira] [Commented] (IMPALA-9307) TSAN data race in kudu::Socket::Accept and TraceLog::UpdateCategoryGroupEnabledFlag

2020-01-20 Thread Sahil Takiar (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-9307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17019822#comment-17019822 ] Sahil Takiar commented on IMPALA-9307: -- Similar data race: {code} WARNING: ThreadSanitizer: data

[jira] [Commented] (IMPALA-9308) TSAN data race in ReservationTracker::used_reservation_ updates

2020-01-21 Thread Sahil Takiar (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-9308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17020447#comment-17020447 ] Sahil Takiar commented on IMPALA-9308: -- What do you think of just making used_reservation_ an

[jira] [Resolved] (IMPALA-3394) Writes to S3 require equivalent local disk space

2020-01-21 Thread Sahil Takiar (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-3394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar resolved IMPALA-3394. -- Resolution: Won't Fix This has been significantly improved in S3A - 

[jira] [Resolved] (IMPALA-9262) Blacklist test test_kill_impalad_with_running_queries fails in exhaustive mode

2020-01-13 Thread Sahil Takiar (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-9262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar resolved IMPALA-9262. -- Fix Version/s: Impala 3.4.0 Resolution: Fixed > Blacklist test

[jira] [Assigned] (IMPALA-9267) Impala hits DCHECK in ClientRequestState due to invalid state transition

2020-01-03 Thread Sahil Takiar (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-9267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar reassigned IMPALA-9267: Assignee: Sahil Takiar > Impala hits DCHECK in ClientRequestState due to invalid state

[jira] [Assigned] (IMPALA-9262) Blacklist test test_kill_impalad_with_running_queries fails in exhaustive mode

2020-01-03 Thread Sahil Takiar (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-9262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar reassigned IMPALA-9262: Assignee: Sahil Takiar (was: Thomas Tauber-Marshall) > Blacklist test

[jira] [Commented] (IMPALA-8577) Crash during OpenSSLSocket.read

2020-01-07 Thread Sahil Takiar (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-8577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17009910#comment-17009910 ] Sahil Takiar commented on IMPALA-8577: -- Doesn't seem like this is specific to the AWS SDK, I just

[jira] [Created] (IMPALA-9485) Enable file handle cache for EC files

2020-03-10 Thread Sahil Takiar (Jira)
Sahil Takiar created IMPALA-9485: Summary: Enable file handle cache for EC files Key: IMPALA-9485 URL: https://issues.apache.org/jira/browse/IMPALA-9485 Project: IMPALA Issue Type: Task

[jira] [Created] (IMPALA-9476) Run Bloaty McBloatface size profiler on Impala binaries

2020-03-06 Thread Sahil Takiar (Jira)
Sahil Takiar created IMPALA-9476: Summary: Run Bloaty McBloatface size profiler on Impala binaries Key: IMPALA-9476 URL: https://issues.apache.org/jira/browse/IMPALA-9476 Project: IMPALA

[jira] [Updated] (IMPALA-9476) Run Bloaty McBloatface size profiler on Impala binaries

2020-03-06 Thread Sahil Takiar (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-9476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated IMPALA-9476: - Attachment: Impala-Bloaty-McBloatface-Output.txt > Run Bloaty McBloatface size profiler on

[jira] [Comment Edited] (IMPALA-9476) Run Bloaty McBloatface size profiler on Impala binaries

2020-03-06 Thread Sahil Takiar (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-9476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17053743#comment-17053743 ] Sahil Takiar edited comment on IMPALA-9476 at 3/6/20, 8:28 PM: --- Attaching

[jira] [Commented] (IMPALA-9476) Run Bloaty McBloatface size profiler on Impala binaries

2020-03-06 Thread Sahil Takiar (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-9476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17053743#comment-17053743 ] Sahil Takiar commented on IMPALA-9476: -- Attaching output of running bloaty on an Impala release

[jira] [Created] (IMPALA-9479) Include GC time in runtime profiles

2020-03-06 Thread Sahil Takiar (Jira)
Sahil Takiar created IMPALA-9479: Summary: Include GC time in runtime profiles Key: IMPALA-9479 URL: https://issues.apache.org/jira/browse/IMPALA-9479 Project: IMPALA Issue Type: Task

[jira] [Created] (IMPALA-9478) Runtime profiles should indicate if custom UDFs are being used

2020-03-06 Thread Sahil Takiar (Jira)
Sahil Takiar created IMPALA-9478: Summary: Runtime profiles should indicate if custom UDFs are being used Key: IMPALA-9478 URL: https://issues.apache.org/jira/browse/IMPALA-9478 Project: IMPALA

[jira] [Updated] (IMPALA-9485) Enable file handle cache for EC files

2020-03-11 Thread Sahil Takiar (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-9485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated IMPALA-9485: - Parent: IMPALA-7003 Issue Type: Sub-task (was: Task) > Enable file handle cache for EC

[jira] [Created] (IMPALA-9487) SHOW and DESCRIBE statements should display EC policies

2020-03-11 Thread Sahil Takiar (Jira)
Sahil Takiar created IMPALA-9487: Summary: SHOW and DESCRIBE statements should display EC policies Key: IMPALA-9487 URL: https://issues.apache.org/jira/browse/IMPALA-9487 Project: IMPALA

[jira] [Created] (IMPALA-9488) Add EC metrics to impala-server

2020-03-11 Thread Sahil Takiar (Jira)
Sahil Takiar created IMPALA-9488: Summary: Add EC metrics to impala-server Key: IMPALA-9488 URL: https://issues.apache.org/jira/browse/IMPALA-9488 Project: IMPALA Issue Type: Sub-task

[jira] [Commented] (IMPALA-9621) Support iceberg on hdfs

2020-04-08 Thread Sahil Takiar (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-9621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17078434#comment-17078434 ] Sahil Takiar commented on IMPALA-9621: -- Not sure how much overlap there would be, but

[jira] [Created] (IMPALA-9636) Retried queries that blacklist nodes should ensure they don't run on the blacklisted node

2020-04-09 Thread Sahil Takiar (Jira)
Sahil Takiar created IMPALA-9636: Summary: Retried queries that blacklist nodes should ensure they don't run on the blacklisted node Key: IMPALA-9636 URL: https://issues.apache.org/jira/browse/IMPALA-9636

[jira] [Commented] (IMPALA-9638) Don't create unnecessary threads in executor-only impalads

2020-04-09 Thread Sahil Takiar (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-9638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17080044#comment-17080044 ] Sahil Takiar commented on IMPALA-9638: -- Noticed this while looking into IMPALA-9609, so linking the

[jira] [Created] (IMPALA-9638) Don't create unnecessary threads in executor-only impalads

2020-04-09 Thread Sahil Takiar (Jira)
Sahil Takiar created IMPALA-9638: Summary: Don't create unnecessary threads in executor-only impalads Key: IMPALA-9638 URL: https://issues.apache.org/jira/browse/IMPALA-9638 Project: IMPALA

[jira] [Commented] (IMPALA-5746) Remote fragments continue to hold onto memory after stopping the coordinator daemon

2020-04-09 Thread Sahil Takiar (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-5746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17080083#comment-17080083 ] Sahil Takiar commented on IMPALA-5746: -- Positing some ideas about how to fix this before I forget:

[jira] [Commented] (IMPALA-5746) Remote fragments continue to hold onto memory after stopping the coordinator daemon

2020-04-09 Thread Sahil Takiar (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-5746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17080076#comment-17080076 ] Sahil Takiar commented on IMPALA-5746: -- [~twmarshall] and I discussed this a bit on the review for

[jira] [Updated] (IMPALA-9642) Set USE_CDP_HIVE to true by default

2020-04-10 Thread Sahil Takiar (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-9642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated IMPALA-9642: - Description: Now that the next release is Impala 4.0, we can turn  USE_CDP_HIVE to true by

[jira] [Created] (IMPALA-9642) Set USE_CDP_HIVE to true by default

2020-04-10 Thread Sahil Takiar (Jira)
Sahil Takiar created IMPALA-9642: Summary: Set USE_CDP_HIVE to true by default Key: IMPALA-9642 URL: https://issues.apache.org/jira/browse/IMPALA-9642 Project: IMPALA Issue Type: Task

[jira] [Created] (IMPALA-9610) Crashed statestore causes queries to hang

2020-04-06 Thread Sahil Takiar (Jira)
Sahil Takiar created IMPALA-9610: Summary: Crashed statestore causes queries to hang Key: IMPALA-9610 URL: https://issues.apache.org/jira/browse/IMPALA-9610 Project: IMPALA Issue Type: Bug

<    3   4   5   6   7   8   9   10   11   12   >