[jira] [Commented] (SPARK-25925) Spark 2.3.1 retrieves all partitions from Hive Metastore by default

[ https://issues.apache.org/jira/browse/SPARK-25925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16678861#comment-16678861 ] Adam Budde commented on SPARK-25925: [~axenol] I would definitely support making the

[jira] [Commented] (SPARK-25925) Spark 2.3.1 retrieves all partitions from Hive Metastore by default

[ https://issues.apache.org/jira/browse/SPARK-25925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16673763#comment-16673763 ] Adam Budde commented on SPARK-25925: It's been a while since I've thought about all

[jira] [Commented] (SPARK-22306) INFER_AND_SAVE overwrites important metadata in Parquet Metastore table

[ https://issues.apache.org/jira/browse/SPARK-22306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16211642#comment-16211642 ] Adam Budde commented on SPARK-22306: I'll take a look and potentially start on a patc

[jira] [Created] (SPARK-19911) Add builder interface for Kinesis DStreams

Adam Budde created SPARK-19911: -- Summary: Add builder interface for Kinesis DStreams Key: SPARK-19911 URL: https://issues.apache.org/jira/browse/SPARK-19911 Project: Spark Issue Type: New Featur

[jira] [Commented] (SPARK-19611) Spark 2.1.0 breaks some Hive tables backed by case-sensitive data files

[ https://issues.apache.org/jira/browse/SPARK-19611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15870262#comment-15870262 ] Adam Budde commented on SPARK-19611: [SPARK-17183|https://issues.apache.org/jira/brow

[jira] [Updated] (SPARK-19611) Spark 2.1.0 breaks some Hive tables backed by case-sensitive data files

[ https://issues.apache.org/jira/browse/SPARK-19611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Budde updated SPARK-19611: --- Description: This issue replaces [SPARK-19455|https://issues.apache.org/jira/browse/SPARK-19455] and

[jira] [Commented] (SPARK-19455) Add option for case-insensitive Parquet field resolution

[ https://issues.apache.org/jira/browse/SPARK-19455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15868457#comment-15868457 ] Adam Budde commented on SPARK-19455: Closing this in favor of https://issues.apache.o

[jira] [Closed] (SPARK-19455) Add option for case-insensitive Parquet field resolution

[ https://issues.apache.org/jira/browse/SPARK-19455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Budde closed SPARK-19455. -- Resolution: Duplicate Closing in favor of https://issues.apache.org/jira/browse/SPARK-19611 > Add opti

[jira] [Issue Comment Deleted] (SPARK-19455) Add option for case-insensitive Parquet field resolution

[ https://issues.apache.org/jira/browse/SPARK-19455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Budde updated SPARK-19455: --- Comment: was deleted (was: Closing this in favor of https://issues.apache.org/jira/browse/SPARK-1961

[jira] [Created] (SPARK-19611) Spark 2.1.0 breaks some Hive tables backed by case-sensitive data files

Adam Budde created SPARK-19611: -- Summary: Spark 2.1.0 breaks some Hive tables backed by case-sensitive data files Key: SPARK-19611 URL: https://issues.apache.org/jira/browse/SPARK-19611 Project: Spark

[jira] [Created] (SPARK-19455) Add option for case-insensitive Parquet field resolution

Adam Budde created SPARK-19455: -- Summary: Add option for case-insensitive Parquet field resolution Key: SPARK-19455 URL: https://issues.apache.org/jira/browse/SPARK-19455 Project: Spark Issue Ty

[jira] (SPARK-19405) Add support to KinesisUtils for cross-account Kinesis reads via STS

Title: Message Title Adam Budde commented on SPARK-19405

[jira] (SPARK-19405) Add support to KinesisUtils for cross-account Kinesis reads via STS

Title: Message Title Adam Budde updated an issue

[jira] (SPARK-19405) Add support to KinesisUtils for cross-account Kinesis reads via STS

Title: Message Title Adam Budde created an issue

[jira] [Commented] (SPARK-18379) Make the parallelism of parallelPartitionDiscovery configurable.

[ https://issues.apache.org/jira/browse/SPARK-18379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15791600#comment-15791600 ] Adam Budde commented on SPARK-18379: You're right, the default is still 1. I was

[jira] [Commented] (SPARK-18379) Make the parallelism of parallelPartitionDiscovery configurable.

[ https://issues.apache.org/jira/browse/SPARK-18379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15790158#comment-15790158 ] Adam Budde commented on SPARK-18379: Apologies if I'm being pedantic here-- not sure

[jira] [Comment Edited] (SPARK-18379) Make the parallelism of parallelPartitionDiscovery configurable.

[ https://issues.apache.org/jira/browse/SPARK-18379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15773765#comment-15773765 ] Adam Budde edited comment on SPARK-18379 at 12/23/16 10:04 PM:

[jira] [Comment Edited] (SPARK-18379) Make the parallelism of parallelPartitionDiscovery configurable.

[ https://issues.apache.org/jira/browse/SPARK-18379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15773765#comment-15773765 ] Adam Budde edited comment on SPARK-18379 at 12/23/16 9:59 PM: -

[jira] [Commented] (SPARK-18379) Make the parallelism of parallelPartitionDiscovery configurable.

[ https://issues.apache.org/jira/browse/SPARK-18379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15773765#comment-15773765 ] Adam Budde commented on SPARK-18379: For tables with a number of files under defaultP

[jira] [Comment Edited] (SPARK-18379) Make the parallelism of parallelPartitionDiscovery configurable.

[ https://issues.apache.org/jira/browse/SPARK-18379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15773629#comment-15773629 ] Adam Budde edited comment on SPARK-18379 at 12/23/16 8:44 PM: -

[jira] [Comment Edited] (SPARK-18379) Make the parallelism of parallelPartitionDiscovery configurable.

[ https://issues.apache.org/jira/browse/SPARK-18379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15773629#comment-15773629 ] Adam Budde edited comment on SPARK-18379 at 12/23/16 8:32 PM: -

[jira] [Commented] (SPARK-18379) Make the parallelism of parallelPartitionDiscovery configurable.

[ https://issues.apache.org/jira/browse/SPARK-18379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15773629#comment-15773629 ] Adam Budde commented on SPARK-18379: Is there any reason this can't be pulled into a

[jira] [Updated] (SPARK-13122) Race condition in MemoryStore.unrollSafely() causes memory leak

[ https://issues.apache.org/jira/browse/SPARK-13122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Budde updated SPARK-13122: --- Description: The [unrollSafely()|https://github.com/apache/spark/blob/v1.6.0/core/src/main/scala/org

[jira] [Updated] (SPARK-13122) Race condition in MemoryStore.unrollSafely() causes memory leak

[ https://issues.apache.org/jira/browse/SPARK-13122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Budde updated SPARK-13122: --- Description: The [unrollSafely()|https://github.com/apache/spark/blob/v1.6.0/core/src/main/scala/org

[jira] [Created] (SPARK-13122) Race condition in MemoryStore.unrollSafely() causes memory leak

Adam Budde created SPARK-13122: -- Summary: Race condition in MemoryStore.unrollSafely() causes memory leak Key: SPARK-13122 URL: https://issues.apache.org/jira/browse/SPARK-13122 Project: Spark

[jira] [Created] (SPARK-6538) Add missing nullable Metastore fields when merging a Parquet schema

Adam Budde created SPARK-6538: - Summary: Add missing nullable Metastore fields when merging a Parquet schema Key: SPARK-6538 URL: https://issues.apache.org/jira/browse/SPARK-6538 Project: Spark