[jira] [Assigned] (SPARK-25701) Supports calculation of table statistics from partition's catalog statistics

[ https://issues.apache.org/jira/browse/SPARK-25701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25701: Assignee: (was: Apache Spark) > Supports calculation of table statistics from partiti

[jira] [Assigned] (SPARK-25701) Supports calculation of table statistics from partition's catalog statistics

[ https://issues.apache.org/jira/browse/SPARK-25701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25701: Assignee: Apache Spark > Supports calculation of table statistics from partition's catalo

[jira] [Commented] (SPARK-25701) Supports calculation of table statistics from partition's catalog statistics

[ https://issues.apache.org/jira/browse/SPARK-25701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16646044#comment-16646044 ] Apache Spark commented on SPARK-25701: -- User 'fjh100456' has created a pull request

[jira] [Commented] (SPARK-25588) SchemaParseException: Can't redefine: list when reading from Parquet

[ https://issues.apache.org/jira/browse/SPARK-25588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16646027#comment-16646027 ] Michael Heuer commented on SPARK-25588: --- Here is a generic unit test that demonstr

[jira] [Updated] (SPARK-25695) Spark history server event log store problem

[ https://issues.apache.org/jira/browse/SPARK-25695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Si Chen updated SPARK-25695: Description: Envirment:spark 2.0.0 hadoop 2.7.3 spark-default.conf {code:java} spark.driver.extraLibraryP

[jira] [Commented] (SPARK-23390) Flaky test: FileBasedDataSourceSuite

[ https://issues.apache.org/jira/browse/SPARK-23390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16646009#comment-16646009 ] Dongjoon Hyun commented on SPARK-23390: --- As a second approach, ORC-419 is created.

[jira] [Commented] (SPARK-25588) SchemaParseException: Can't redefine: list when reading from Parquet

[ https://issues.apache.org/jira/browse/SPARK-25588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16645919#comment-16645919 ] Sean Owen commented on SPARK-25588: --- Is this likely due to the update from Avro 1.7.x

[jira] [Commented] (SPARK-25695) Spark history server event log store problem

[ https://issues.apache.org/jira/browse/SPARK-25695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16645893#comment-16645893 ] Si Chen commented on SPARK-25695: - !image-2018-10-11-11-09-32-259.png! !image-2018-10-11

[jira] [Updated] (SPARK-25695) Spark history server event log store problem

[ https://issues.apache.org/jira/browse/SPARK-25695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Si Chen updated SPARK-25695: Attachment: image-2018-10-11-11-09-32-259.png > Spark history server event log store problem > ---

[jira] [Updated] (SPARK-25695) Spark history server event log store problem

[ https://issues.apache.org/jira/browse/SPARK-25695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Si Chen updated SPARK-25695: Attachment: image-2018-10-11-11-08-20-062.png > Spark history server event log store problem > ---

[jira] [Resolved] (SPARK-25706) messages property in the Inbox class, why not a concurrent collection?

[ https://issues.apache.org/jira/browse/SPARK-25706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jing_tao resolved SPARK-25706. -- Resolution: Not A Bug > messages property in the Inbox class, why not a concurrent collection? > -

[jira] [Created] (SPARK-25706) messages property in the Inbox class, why not a concurrent collection?

jing_tao created SPARK-25706: Summary: messages property in the Inbox class, why not a concurrent collection? Key: SPARK-25706 URL: https://issues.apache.org/jira/browse/SPARK-25706 Project: Spark

[jira] [Commented] (SPARK-25588) SchemaParseException: Can't redefine: list when reading from Parquet

[ https://issues.apache.org/jira/browse/SPARK-25588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16645867#comment-16645867 ] Wenchen Fan commented on SPARK-25588: - [~heuermh] is there a way to demonstrate the

[jira] [Commented] (SPARK-25378) ArrayData.toArray(StringType) assume UTF8String in 2.4

[ https://issues.apache.org/jira/browse/SPARK-25378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16645862#comment-16645862 ] Wenchen Fan commented on SPARK-25378: - Since TF 1.12 will be released soon, and I be

[jira] [Resolved] (SPARK-25378) ArrayData.toArray(StringType) assume UTF8String in 2.4

[ https://issues.apache.org/jira/browse/SPARK-25378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-25378. - Resolution: Won't Fix > ArrayData.toArray(StringType) assume UTF8String in 2.4 > ---

[jira] [Commented] (SPARK-25695) Spark history server event log store problem

[ https://issues.apache.org/jira/browse/SPARK-25695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16645819#comment-16645819 ] shahid commented on SPARK-25695: Hi [~Krypton], Is event log directory there in all the

[jira] [Comment Edited] (SPARK-25695) Spark history server event log store problem

[ https://issues.apache.org/jira/browse/SPARK-25695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16645809#comment-16645809 ] Si Chen edited comment on SPARK-25695 at 10/11/18 1:30 AM: --- I

[jira] [Comment Edited] (SPARK-10816) EventTime based sessionization

[ https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16645705#comment-16645705 ] Jungtaek Lim edited comment on SPARK-10816 at 10/11/18 1:21 AM: --

[jira] [Commented] (SPARK-25695) Spark history server event log store problem

[ https://issues.apache.org/jira/browse/SPARK-25695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16645809#comment-16645809 ] Si Chen commented on SPARK-25695: - Here is the diary of history server. {code:java} 18/

[jira] [Commented] (SPARK-22390) Aggregate push down

[ https://issues.apache.org/jira/browse/SPARK-22390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16645746#comment-16645746 ] Huaxin Gao commented on SPARK-22390: Thanks [~smilegator] > Aggregate push down > -

[jira] [Commented] (SPARK-10816) EventTime based sessionization

[ https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16645745#comment-16645745 ] Jungtaek Lim commented on SPARK-10816: -- Btw, while there was some inactivity on thi

[jira] [Commented] (SPARK-25587) NPE in Dataset when reading from Parquet as Product

[ https://issues.apache.org/jira/browse/SPARK-25587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16645742#comment-16645742 ] Sean Owen commented on SPARK-25587: ---  I think this would be treated as a 'known issue'

[jira] [Commented] (SPARK-10816) EventTime based sessionization

[ https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16645720#comment-16645720 ] Jungtaek Lim commented on SPARK-10816: -- [~zsxwing] [~tdas] {quote}In addition, it's

[jira] [Comment Edited] (SPARK-10816) EventTime based sessionization

[ https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16645705#comment-16645705 ] Jungtaek Lim edited comment on SPARK-10816 at 10/10/18 11:31 PM: -

[jira] [Comment Edited] (SPARK-10816) EventTime based sessionization

[ https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16645705#comment-16645705 ] Jungtaek Lim edited comment on SPARK-10816 at 10/10/18 11:30 PM: -

[jira] [Comment Edited] (SPARK-10816) EventTime based sessionization

[ https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16645705#comment-16645705 ] Jungtaek Lim edited comment on SPARK-10816 at 10/10/18 11:30 PM: -

[jira] [Comment Edited] (SPARK-10816) EventTime based sessionization

[ https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16645705#comment-16645705 ] Jungtaek Lim edited comment on SPARK-10816 at 10/10/18 11:25 PM: -

[jira] [Commented] (SPARK-10816) EventTime based sessionization

[ https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16645705#comment-16645705 ] Jungtaek Lim commented on SPARK-10816: -- [~zsxwing] [~tdas] Thanks for spending tim

[jira] [Updated] (SPARK-25636) spark-submit swallows the failure reason when there is an error connecting to master

[ https://issues.apache.org/jira/browse/SPARK-25636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-25636: --- Fix Version/s: (was: 2.4.0) 3.0.0 2.4.1 > spark-su

[jira] [Created] (SPARK-25705) Remove Kafka 0.8 support in Spark 3.0.0

Sean Owen created SPARK-25705: - Summary: Remove Kafka 0.8 support in Spark 3.0.0 Key: SPARK-25705 URL: https://issues.apache.org/jira/browse/SPARK-25705 Project: Spark Issue Type: Task

[jira] [Assigned] (SPARK-25598) Remove flume connector in Spark 3

[ https://issues.apache.org/jira/browse/SPARK-25598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25598: Assignee: (was: Apache Spark) > Remove flume connector in Spark 3 > -

[jira] [Commented] (SPARK-25598) Remove flume connector in Spark 3

[ https://issues.apache.org/jira/browse/SPARK-25598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16645617#comment-16645617 ] Apache Spark commented on SPARK-25598: -- User 'srowen' has created a pull request fo

[jira] [Assigned] (SPARK-25598) Remove flume connector in Spark 3

[ https://issues.apache.org/jira/browse/SPARK-25598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25598: Assignee: Apache Spark > Remove flume connector in Spark 3 >

[jira] [Commented] (SPARK-25598) Remove flume connector in Spark 3

[ https://issues.apache.org/jira/browse/SPARK-25598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16645613#comment-16645613 ] Dongjoon Hyun commented on SPARK-25598: --- +1 for removing Flume. > Remove flume co

[jira] [Commented] (SPARK-24130) Data Source V2: Join Push Down

[ https://issues.apache.org/jira/browse/SPARK-24130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16645584#comment-16645584 ] Dilip Biswal commented on SPARK-24130: -- [~smilegator] Thank you. > Data Source V2:

[jira] [Resolved] (SPARK-9576) DataFrame API improvement umbrella ticket (in Spark 2.x)

[ https://issues.apache.org/jira/browse/SPARK-9576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-9576. -- Resolution: Done Target Version/s: (was: 3.0.0) Moved items out of this generic umbrella, a

[jira] [Updated] (SPARK-7549) Support aggregating over nested fields

[ https://issues.apache.org/jira/browse/SPARK-7549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-7549: - Affects Version/s: 2.0.0 Issue Type: Improvement (was: Sub-task) Parent: (w

[jira] [Updated] (SPARK-8000) SQLContext.read.load() should be able to auto-detect input data

[ https://issues.apache.org/jira/browse/SPARK-8000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8000: - Affects Version/s: 2.0.0 Issue Type: Improvement (was: Sub-task) Parent: (w

[jira] [Updated] (SPARK-7400) PortableDataStream UDT

[ https://issues.apache.org/jira/browse/SPARK-7400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-7400: - Affects Version/s: 2.0.0 Issue Type: Improvement (was: Sub-task) Parent: (w

[jira] [Updated] (SPARK-25369) Replace Java shim functional interfaces like java.api.Function with Java 8 equivalents

[ https://issues.apache.org/jira/browse/SPARK-25369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-25369: -- Labels: release-notes (was: ) > Replace Java shim functional interfaces like java.api.Function with J

[jira] [Commented] (SPARK-24130) Data Source V2: Join Push Down

[ https://issues.apache.org/jira/browse/SPARK-24130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16645565#comment-16645565 ] Xiao Li commented on SPARK-24130: - Any data source migration work is being blocked by h

[jira] [Commented] (SPARK-22390) Aggregate push down

[ https://issues.apache.org/jira/browse/SPARK-22390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16645567#comment-16645567 ] Xiao Li commented on SPARK-22390: - Any data source migration work is being blocked by h

[jira] [Commented] (SPARK-24109) Remove class SnappyOutputStreamWrapper

[ https://issues.apache.org/jira/browse/SPARK-24109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16645566#comment-16645566 ] Apache Spark commented on SPARK-24109: -- User 'srowen' has created a pull request fo

[jira] [Assigned] (SPARK-19287) JavaPairRDD flatMapValues requires function returning Iterable, not Iterator

[ https://issues.apache.org/jira/browse/SPARK-19287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19287: Assignee: Apache Spark > JavaPairRDD flatMapValues requires function returning Iterable,

[jira] [Commented] (SPARK-19287) JavaPairRDD flatMapValues requires function returning Iterable, not Iterator

[ https://issues.apache.org/jira/browse/SPARK-19287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16645559#comment-16645559 ] Apache Spark commented on SPARK-19287: -- User 'srowen' has created a pull request fo

[jira] [Commented] (SPARK-19287) JavaPairRDD flatMapValues requires function returning Iterable, not Iterator

[ https://issues.apache.org/jira/browse/SPARK-19287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16645560#comment-16645560 ] Apache Spark commented on SPARK-19287: -- User 'srowen' has created a pull request fo

[jira] [Assigned] (SPARK-19287) JavaPairRDD flatMapValues requires function returning Iterable, not Iterator

[ https://issues.apache.org/jira/browse/SPARK-19287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19287: Assignee: (was: Apache Spark) > JavaPairRDD flatMapValues requires function returning

[jira] [Commented] (SPARK-24499) Documentation improvement of Spark core and SQL

[ https://issues.apache.org/jira/browse/SPARK-24499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16645550#comment-16645550 ] Sean Owen commented on SPARK-24499: --- The title here is pretty broad. Is this just abou

[jira] [Assigned] (SPARK-24109) Remove class SnappyOutputStreamWrapper

[ https://issues.apache.org/jira/browse/SPARK-24109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-24109: - Assignee: Takeshi Yamamuro > Remove class SnappyOutputStreamWrapper > -

[jira] [Updated] (SPARK-25362) Replace Spark Optional class with Java Optional

[ https://issues.apache.org/jira/browse/SPARK-25362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-25362: -- Labels: release-notes (was: ) > Replace Spark Optional class with Java Optional > ---

[jira] [Updated] (SPARK-25598) Remove flume connector in Spark 3

[ https://issues.apache.org/jira/browse/SPARK-25598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-25598: -- Labels: release-notes (was: ) > Remove flume connector in Spark 3 > -

[jira] [Updated] (SPARK-19287) JavaPairRDD flatMapValues requires function returning Iterable, not Iterator

[ https://issues.apache.org/jira/browse/SPARK-19287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-19287: -- Labels: release-notes (was: ) > JavaPairRDD flatMapValues requires function returning Iterable, not I

[jira] [Commented] (SPARK-25598) Remove flume connector in Spark 3

[ https://issues.apache.org/jira/browse/SPARK-25598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16645508#comment-16645508 ] Sean Owen commented on SPARK-25598: --- I agree. It's pretty legacy. I'll post a note on

[jira] [Commented] (SPARK-25150) Joining DataFrames derived from the same source yields confusing/incorrect results

[ https://issues.apache.org/jira/browse/SPARK-25150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16645484#comment-16645484 ] Sean Owen commented on SPARK-25150: --- The second join joins "states-joined-with-humans"

[jira] [Commented] (SPARK-23390) Flaky test: FileBasedDataSourceSuite

[ https://issues.apache.org/jira/browse/SPARK-23390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16645441#comment-16645441 ] Dongjoon Hyun commented on SPARK-23390: --- Yep. Thank you for the guide, [~zsxwing].

[jira] [Assigned] (SPARK-25016) remove Support for hadoop 2.6

[ https://issues.apache.org/jira/browse/SPARK-25016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-25016: - Assignee: Sean Owen > remove Support for hadoop 2.6 > - > >

[jira] [Resolved] (SPARK-25016) remove Support for hadoop 2.6

[ https://issues.apache.org/jira/browse/SPARK-25016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-25016. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 22615 [https://github.c

[jira] [Assigned] (SPARK-25670) Speed up JsonExpressionsSuite

[ https://issues.apache.org/jira/browse/SPARK-25670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25670: Assignee: Apache Spark > Speed up JsonExpressionsSuite > - >

[jira] [Assigned] (SPARK-25670) Speed up JsonExpressionsSuite

[ https://issues.apache.org/jira/browse/SPARK-25670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25670: Assignee: (was: Apache Spark) > Speed up JsonExpressionsSuite > -

[jira] [Reopened] (SPARK-25670) Speed up JsonExpressionsSuite

[ https://issues.apache.org/jira/browse/SPARK-25670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reopened SPARK-25670: --- > Speed up JsonExpressionsSuite > - > > Key: SPARK-25670 >

[jira] [Commented] (SPARK-23390) Flaky test: FileBasedDataSourceSuite

[ https://issues.apache.org/jira/browse/SPARK-23390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16645399#comment-16645399 ] Shixiong Zhu commented on SPARK-23390: -- [~dongjoon] when spark cancels a task, the

[jira] [Commented] (SPARK-25697) When zstd compression enabled in progress application is throwing Error in UI

[ https://issues.apache.org/jira/browse/SPARK-25697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16645395#comment-16645395 ] Apache Spark commented on SPARK-25697: -- User 'shahidki31' has created a pull reques

[jira] [Assigned] (SPARK-25697) When zstd compression enabled in progress application is throwing Error in UI

[ https://issues.apache.org/jira/browse/SPARK-25697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25697: Assignee: Apache Spark > When zstd compression enabled in progress application is throwin

[jira] [Assigned] (SPARK-25697) When zstd compression enabled in progress application is throwing Error in UI

[ https://issues.apache.org/jira/browse/SPARK-25697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25697: Assignee: (was: Apache Spark) > When zstd compression enabled in progress application

[jira] [Commented] (SPARK-25697) When zstd compression enabled in progress application is throwing Error in UI

[ https://issues.apache.org/jira/browse/SPARK-25697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16645394#comment-16645394 ] Apache Spark commented on SPARK-25697: -- User 'shahidki31' has created a pull reques

[jira] [Assigned] (SPARK-25699) Partially push down conjunctive predicated in Orc

[ https://issues.apache.org/jira/browse/SPARK-25699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai reassigned SPARK-25699: --- Assignee: Gengliang Wang > Partially push down conjunctive predicated in Orc >

[jira] [Resolved] (SPARK-25699) Partially push down conjunctive predicated in Orc

[ https://issues.apache.org/jira/browse/SPARK-25699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-25699. - Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 22684 [https://github.com/a

[jira] [Commented] (SPARK-10816) EventTime based sessionization

[ https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16645370#comment-16645370 ] Shixiong Zhu commented on SPARK-10816: -- Thanks a lot for the design docs and protot

[jira] [Commented] (SPARK-23390) Flaky test: FileBasedDataSourceSuite

[ https://issues.apache.org/jira/browse/SPARK-23390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16645358#comment-16645358 ] Dongjoon Hyun commented on SPARK-23390: --- [~zsxwing]. ORC-416 is a first partial at

[jira] [Commented] (SPARK-22390) Aggregate push down

[ https://issues.apache.org/jira/browse/SPARK-22390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16645345#comment-16645345 ] Huaxin Gao commented on SPARK-22390: [~smilegator] Thank you very much for your comm

[jira] [Commented] (SPARK-24130) Data Source V2: Join Push Down

[ https://issues.apache.org/jira/browse/SPARK-24130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16645337#comment-16645337 ] Dilip Biswal commented on SPARK-24130: -- [~smilegator] Would you know if the V2 impl

[jira] [Commented] (SPARK-25422) flaky test: org.apache.spark.DistributedSuite.caching on disk, replicated (encryption = on) (with replication as stream)

[ https://issues.apache.org/jira/browse/SPARK-25422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16645336#comment-16645336 ] Imran Rashid commented on SPARK-25422: -- Unfortunately I messed up the testing of th

[jira] [Created] (SPARK-25704) Replication of > 2GB block fails due to bad config default

Imran Rashid created SPARK-25704: Summary: Replication of > 2GB block fails due to bad config default Key: SPARK-25704 URL: https://issues.apache.org/jira/browse/SPARK-25704 Project: Spark Is

[jira] [Commented] (SPARK-25588) SchemaParseException: Can't redefine: list when reading from Parquet

[ https://issues.apache.org/jira/browse/SPARK-25588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16645295#comment-16645295 ] Michael Heuer commented on SPARK-25588: --- I've reported an issue against Parquet wi

[jira] [Comment Edited] (SPARK-25588) SchemaParseException: Can't redefine: list when reading from Parquet

[ https://issues.apache.org/jira/browse/SPARK-25588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16642200#comment-16642200 ] Michael Heuer edited comment on SPARK-25588 at 10/10/18 5:18 PM: -

[jira] [Commented] (SPARK-25588) SchemaParseException: Can't redefine: list when reading from Parquet

[ https://issues.apache.org/jira/browse/SPARK-25588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16645294#comment-16645294 ] Michael Heuer commented on SPARK-25588: --- [~cloud_fan] I'm curious to how this issu

[jira] [Updated] (SPARK-25588) SchemaParseException: Can't redefine: list when reading from Parquet

[ https://issues.apache.org/jira/browse/SPARK-25588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Heuer updated SPARK-25588: -- Affects Version/s: 2.4.0 > SchemaParseException: Can't redefine: list when reading from Parque

[jira] [Updated] (SPARK-25424) Window duration and slide duration with negative values should fail fast

[ https://issues.apache.org/jira/browse/SPARK-25424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-25424: Fix Version/s: (was: 2.4.0) > Window duration and slide duration with negative values should f

[jira] [Updated] (SPARK-19355) Use map output statistices to improve global limit's parallelism

[ https://issues.apache.org/jira/browse/SPARK-19355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-19355: Fix Version/s: (was: 2.4.0) > Use map output statistices to improve global limit's parallelism

[jira] [Assigned] (SPARK-25636) spark-submit swallows the failure reason when there is an error connecting to master

[ https://issues.apache.org/jira/browse/SPARK-25636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-25636: -- Assignee: Devaraj K > spark-submit swallows the failure reason when there is an error

[jira] [Resolved] (SPARK-25636) spark-submit swallows the failure reason when there is an error connecting to master

[ https://issues.apache.org/jira/browse/SPARK-25636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-25636. Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 22623 [https:

[jira] [Commented] (SPARK-25515) Add a config property for disabling auto deletion of PODS for debugging.

[ https://issues.apache.org/jira/browse/SPARK-25515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16645217#comment-16645217 ] Li Gao commented on SPARK-25515: I'd like to create a PR for this to enable such option.

[jira] [Comment Edited] (SPARK-25515) Add a config property for disabling auto deletion of PODS for debugging.

[ https://issues.apache.org/jira/browse/SPARK-25515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16645217#comment-16645217 ] Li Gao edited comment on SPARK-25515 at 10/10/18 4:28 PM: -- I'd

[jira] [Resolved] (SPARK-24212) PrefixSpan in spark.ml: user guide section

[ https://issues.apache.org/jira/browse/SPARK-24212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-24212. --- Resolution: Won't Fix > PrefixSpan in spark.ml: user guide section > ---

[jira] [Assigned] (SPARK-25611) CompressionCodecSuite: both table-level and session-level compression are set 2 min 20 sec

[ https://issues.apache.org/jira/browse/SPARK-25611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-25611: - Assignee: Dilip Biswal > CompressionCodecSuite: both table-level and session-level compression

[jira] [Resolved] (SPARK-25611) CompressionCodecSuite: both table-level and session-level compression are set 2 min 20 sec

[ https://issues.apache.org/jira/browse/SPARK-25611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-25611. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 22641 [https://github.c

[jira] [Assigned] (SPARK-25612) CompressionCodecSuite: table-level compression is not set but session-level compressions 47 seconds

[ https://issues.apache.org/jira/browse/SPARK-25612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-25612: - Assignee: Dilip Biswal > CompressionCodecSuite: table-level compression is not set but session-

[jira] [Resolved] (SPARK-25612) CompressionCodecSuite: table-level compression is not set but session-level compressions 47 seconds

[ https://issues.apache.org/jira/browse/SPARK-25612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-25612. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 22641 [https://github.c

[jira] [Commented] (SPARK-23597) Audit Spark SQL code base for non-interpreted expressions

[ https://issues.apache.org/jira/browse/SPARK-23597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16645057#comment-16645057 ] Wenchen Fan commented on SPARK-23597: - I'm resolving it. Feel free to reopen it if y

[jira] [Resolved] (SPARK-23597) Audit Spark SQL code base for non-interpreted expressions

[ https://issues.apache.org/jira/browse/SPARK-23597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-23597. - Resolution: Fixed Fix Version/s: 2.4.0 > Audit Spark SQL code base for non-interpreted ex

[jira] [Resolved] (SPARK-25110) make sure Flume streaming connector works with Spark 2.4

[ https://issues.apache.org/jira/browse/SPARK-25110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-25110. - Resolution: Not A Problem > make sure Flume streaming connector works with Spark 2.4 > -

[jira] [Commented] (SPARK-25110) make sure Flume streaming connector works with Spark 2.4

[ https://issues.apache.org/jira/browse/SPARK-25110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16645053#comment-16645053 ] Wenchen Fan commented on SPARK-25110: - Actually Flume integration is deprecated sinc

[jira] [Issue Comment Deleted] (SPARK-24602) In Spark SQL, ALTER TABLE--CHANGE column1 column2 datatype is not supported in 2.3.1

[ https://issues.apache.org/jira/browse/SPARK-24602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shivusondur updated SPARK-24602: Comment: was deleted (was: i am working on this issue) > In Spark SQL, ALTER TABLE--CHANGE column

[jira] [Commented] (SPARK-19976) DirectStream API throws OffsetOutOfRange Exception

[ https://issues.apache.org/jira/browse/SPARK-19976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16644928#comment-16644928 ] Josef Niedermeier commented on SPARK-19976: --- there is ConsumerConfig.AUTO_OFFS

[jira] [Resolved] (SPARK-25702) Push down filters with `Not` operator in Parquet

[ https://issues.apache.org/jira/browse/SPARK-25702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-25702. Resolution: Fixed The condition is not reachable due to optimization rule BooleanSimplific

[jira] [Resolved] (SPARK-25703) Push down filters with `Not` operator in ORC

[ https://issues.apache.org/jira/browse/SPARK-25703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-25703. Resolution: Won't Fix > Push down filters with `Not` operator in ORC > ---

[jira] [Resolved] (SPARK-25448) [Spark Job History] Job Staged page shows 1000 Jobs only

[ https://issues.apache.org/jira/browse/SPARK-25448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ABHISHEK KUMAR GUPTA resolved SPARK-25448. -- Resolution: Invalid > [Spark Job History] Job Staged page shows 1000 Jobs only

[jira] [Reopened] (SPARK-25448) [Spark Job History] Job Staged page shows 1000 Jobs only

[ https://issues.apache.org/jira/browse/SPARK-25448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ABHISHEK KUMAR GUPTA reopened SPARK-25448: -- Need to update the resolution > [Spark Job History] Job Staged page shows 1000 Jo

[jira] [Commented] (SPARK-25700) Avoid to create a readsupport at write path in Data Source V2

[ https://issues.apache.org/jira/browse/SPARK-25700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16644807#comment-16644807 ] Apache Spark commented on SPARK-25700: -- User 'HyukjinKwon' has created a pull reque

[jira] [Commented] (SPARK-25700) Avoid to create a readsupport at write path in Data Source V2

[ https://issues.apache.org/jira/browse/SPARK-25700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16644809#comment-16644809 ] Apache Spark commented on SPARK-25700: -- User 'HyukjinKwon' has created a pull reque

  1   2   >