[jira] [Comment Edited] (SPARK-4105) FAILED_TO_UNCOMPRESS(5) errors when fetching shuffle data with sort-based shuffle

2021-02-12 Thread Tyson Condie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-4105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17283737#comment-17283737 ] Tyson Condie edited comment on SPARK-4105 at 2/12/21, 2:47 PM: ---

[jira] [Commented] (SPARK-4105) FAILED_TO_UNCOMPRESS(5) errors when fetching shuffle data with sort-based shuffle

2021-02-12 Thread Tyson Condie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-4105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17283737#comment-17283737 ] Tyson Condie commented on SPARK-4105: - [~joshrosen] We just experienced a similar stack trace / issue

[jira] [Commented] (SPARK-30602) SPIP: Support push-based shuffle to improve shuffle efficiency

2020-01-29 Thread Tyson Condie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17026134#comment-17026134 ] Tyson Condie commented on SPARK-30602: --  The design looks to bring in some good optimizations from

[jira] [Comment Edited] (SPARK-26257) SPIP: Interop Support for Spark Language Extensions

2019-03-15 Thread Tyson Condie (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16793842#comment-16793842 ] Tyson Condie edited comment on SPARK-26257 at 3/15/19 8:07 PM: --- Thank you

[jira] [Updated] (SPARK-26257) SPIP: Interop Support for Spark Language Extensions

2019-03-15 Thread Tyson Condie (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tyson Condie updated SPARK-26257: - Affects Version/s: (was: 2.4.0) 3.0.0 > SPIP: Interop Support for

[jira] [Updated] (SPARK-26257) SPIP: Interop Support for Spark Language Extensions

2019-03-15 Thread Tyson Condie (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tyson Condie updated SPARK-26257: - Priority: Major (was: Minor) > SPIP: Interop Support for Spark Language Extensions >

[jira] [Commented] (SPARK-26257) SPIP: Interop Support for Spark Language Extensions

2019-03-15 Thread Tyson Condie (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16793842#comment-16793842 ] Tyson Condie commented on SPARK-26257: -- Thank you [~abellina] [~srowen] [~zjffdu] for your interest

[jira] [Comment Edited] (SPARK-27006) SPIP: .NET bindings for Apache Spark

2019-03-14 Thread Tyson Condie (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16792939#comment-16792939 ] Tyson Condie edited comment on SPARK-27006 at 3/14/19 6:23 PM: --- I would

[jira] [Commented] (SPARK-27006) SPIP: .NET bindings for Apache Spark

2019-03-14 Thread Tyson Condie (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16792939#comment-16792939 ] Tyson Condie commented on SPARK-27006: -- I would like to briefly illuminate what I think this SPIP

[jira] [Commented] (SPARK-26257) SPIP: Interop Support for Spark Language Extensions

2019-01-03 Thread Tyson Condie (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16733297#comment-16733297 ] Tyson Condie commented on SPARK-26257: -- [~rxin] Any thoughts regarding this SPIP? I have a draft of

[jira] [Created] (SPARK-26257) SPIP: Interop Support for Spark Language Extensions

2018-12-03 Thread Tyson Condie (JIRA)
Tyson Condie created SPARK-26257: Summary: SPIP: Interop Support for Spark Language Extensions Key: SPARK-26257 URL: https://issues.apache.org/jira/browse/SPARK-26257 Project: Spark Issue

[jira] [Created] (SPARK-19906) Add Documentation for Kafka Write paths

2017-03-10 Thread Tyson Condie (JIRA)
Tyson Condie created SPARK-19906: Summary: Add Documentation for Kafka Write paths Key: SPARK-19906 URL: https://issues.apache.org/jira/browse/SPARK-19906 Project: Spark Issue Type:

[jira] [Created] (SPARK-19891) Await Batch Lock not signaled on stream execution exit

2017-03-09 Thread Tyson Condie (JIRA)
Tyson Condie created SPARK-19891: Summary: Await Batch Lock not signaled on stream execution exit Key: SPARK-19891 URL: https://issues.apache.org/jira/browse/SPARK-19891 Project: Spark Issue

[jira] [Created] (SPARK-19876) Add OneTime trigger executor

2017-03-08 Thread Tyson Condie (JIRA)
Tyson Condie created SPARK-19876: Summary: Add OneTime trigger executor Key: SPARK-19876 URL: https://issues.apache.org/jira/browse/SPARK-19876 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-19719) Structured Streaming write to Kafka

2017-02-23 Thread Tyson Condie (JIRA)
Tyson Condie created SPARK-19719: Summary: Structured Streaming write to Kafka Key: SPARK-19719 URL: https://issues.apache.org/jira/browse/SPARK-19719 Project: Spark Issue Type: New Feature

[jira] [Created] (SPARK-19584) Update Structured Streaming documentation to include Batch query description

2017-02-13 Thread Tyson Condie (JIRA)
Tyson Condie created SPARK-19584: Summary: Update Structured Streaming documentation to include Batch query description Key: SPARK-19584 URL: https://issues.apache.org/jira/browse/SPARK-19584

[jira] [Updated] (SPARK-18790) Keep a general offset history of stream batches

2016-12-08 Thread Tyson Condie (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tyson Condie updated SPARK-18790: - Component/s: Structured Streaming > Keep a general offset history of stream batches >

[jira] [Created] (SPARK-18790) Keep a general offset history of stream batches

2016-12-08 Thread Tyson Condie (JIRA)
Tyson Condie created SPARK-18790: Summary: Keep a general offset history of stream batches Key: SPARK-18790 URL: https://issues.apache.org/jira/browse/SPARK-18790 Project: Spark Issue Type:

[jira] [Created] (SPARK-18498) Clean up HDFSMetadataLog API for better testing

2016-11-17 Thread Tyson Condie (JIRA)
Tyson Condie created SPARK-18498: Summary: Clean up HDFSMetadataLog API for better testing Key: SPARK-18498 URL: https://issues.apache.org/jira/browse/SPARK-18498 Project: Spark Issue Type:

[jira] [Commented] (SPARK-18187) CompactibleFileStreamLog should not rely on "compactInterval" to detect a compaction batch

2016-11-14 Thread Tyson Condie (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15665239#comment-15665239 ] Tyson Condie commented on SPARK-18187: -- Hi [~zsxwing], I have added some new logic to the the

[jira] [Commented] (SPARK-17829) Stable format for offset log

2016-10-27 Thread Tyson Condie (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15613253#comment-15613253 ] Tyson Condie commented on SPARK-17829: -- Thanks Code for the clarification. My background is mostly

[jira] [Commented] (SPARK-17829) Stable format for offset log

2016-10-26 Thread Tyson Condie (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15609907#comment-15609907 ] Tyson Condie commented on SPARK-17829: -- Makes sense to me. I'm still wrapping my head around "best

[jira] [Commented] (SPARK-17829) Stable format for offset log

2016-10-26 Thread Tyson Condie (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15609499#comment-15609499 ] Tyson Condie commented on SPARK-17829: -- In the process of adopting a complete JSON serialization

[jira] [Commented] (SPARK-17829) Stable format for offset log

2016-10-20 Thread Tyson Condie (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15593706#comment-15593706 ] Tyson Condie commented on SPARK-17829: -- Had a conversation with Michael about how to offset