Dongjoon Hyun created SPARK-27755:
-
Summary: Update zstd-jni to 1.4.0-1
Key: SPARK-27755
URL: https://issues.apache.org/jira/browse/SPARK-27755
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-27634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-27634.
---
Resolution: Duplicate
> deleteCheckpointOnStop should be configurable
>
[
https://issues.apache.org/jira/browse/SPARK-27752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-27752.
---
Resolution: Fixed
Assignee: Kazuaki Ishizaki
Fix Version/s: 3.0.0
This is
[
https://issues.apache.org/jira/browse/SPARK-27718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-27718.
---
Resolution: Not A Problem
> incorrect result from pagerank
> --
>
>
[
https://issues.apache.org/jira/browse/SPARK-27751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-27751.
--
Resolution: Invalid
> buildReader is now protected
>
>
>
[
https://issues.apache.org/jira/browse/SPARK-27751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16841821#comment-16841821
]
Hyukjin Kwon commented on SPARK-27751:
--
all the classes in `execution` package is subject to be a
[
https://issues.apache.org/jira/browse/SPARK-27733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16841811#comment-16841811
]
Hyukjin Kwon commented on SPARK-27733:
--
Then it should be blocked by a ticktat that targets hive
[
https://issues.apache.org/jira/browse/SPARK-27733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16841811#comment-16841811
]
Hyukjin Kwon edited comment on SPARK-27733 at 5/16/19 11:34 PM:
Then it
[
https://issues.apache.org/jira/browse/SPARK-27576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-27576.
---
Resolution: Fixed
Fix Version/s: 3.0.0
This is resolved via
[
https://issues.apache.org/jira/browse/SPARK-27735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-27735.
---
Resolution: Fixed
Fix Version/s: 3.0.0
2.4.4
[
https://issues.apache.org/jira/browse/SPARK-27754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27754:
Assignee: (was: Apache Spark)
> Introduce spark on k8s config for driver request
[
https://issues.apache.org/jira/browse/SPARK-27754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27754:
Assignee: Apache Spark
> Introduce spark on k8s config for driver request cores
>
Arun Mahadevan created SPARK-27754:
--
Summary: Introduce spark on k8s config for driver request cores
Key: SPARK-27754
URL: https://issues.apache.org/jira/browse/SPARK-27754
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-27752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27752:
Assignee: Apache Spark
> Updata lz4-java from 1.5.1 to 1.6.0
>
[
https://issues.apache.org/jira/browse/SPARK-27752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27752:
Assignee: (was: Apache Spark)
> Updata lz4-java from 1.5.1 to 1.6.0
>
[
https://issues.apache.org/jira/browse/SPARK-27736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16841614#comment-16841614
]
Thomas Graves commented on SPARK-27736:
---
to clarify my last suggestion, I mean each executor
[
https://issues.apache.org/jira/browse/SPARK-27736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16841593#comment-16841593
]
Thomas Graves commented on SPARK-27736:
---
Yeah we always ran yarn with node manager recover on, but
Shixiong Zhu created SPARK-27753:
Summary: Support SQL expressions for interval parameter in
Structured Streaming
Key: SPARK-27753
URL: https://issues.apache.org/jira/browse/SPARK-27753
Project:
Kazuaki Ishizaki created SPARK-27752:
Summary: Updata lz4-java from 1.5.2 to 1.6.0
Key: SPARK-27752
URL: https://issues.apache.org/jira/browse/SPARK-27752
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-27752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kazuaki Ishizaki updated SPARK-27752:
-
Summary: Updata lz4-java from 1.5.1 to 1.6.0 (was: Updata lz4-java from
1.5.2 to
Geet Kumar created SPARK-27751:
--
Summary: buildReader is now protected
Key: SPARK-27751
URL: https://issues.apache.org/jira/browse/SPARK-27751
Project: Spark
Issue Type: Question
[
https://issues.apache.org/jira/browse/SPARK-27749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27749:
Assignee: Apache Spark
> Fix hadoop-3.2 hive-thriftserver module test issue
>
[
https://issues.apache.org/jira/browse/SPARK-27749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27749:
Assignee: (was: Apache Spark)
> Fix hadoop-3.2 hive-thriftserver module test issue
>
[
https://issues.apache.org/jira/browse/SPARK-27745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin resolved SPARK-27745.
Resolution: Not A Bug
You need to run {{./dev/change-scala-version.sh}} first. Pretty
[
https://issues.apache.org/jira/browse/SPARK-27373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16841506#comment-16841506
]
Thomas Graves edited comment on SPARK-27373 at 5/16/19 4:21 PM:
for the
[
https://issues.apache.org/jira/browse/SPARK-27373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16841506#comment-16841506
]
Thomas Graves commented on SPARK-27373:
---
for the kubernetes side, it has 2 options for requesting
[
https://issues.apache.org/jira/browse/SPARK-27373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves reassigned SPARK-27373:
-
Assignee: Thomas Graves
> Design: Kubernetes support for GPU-aware scheduling
>
t oo created SPARK-27750:
Summary: Standalone scheduler - ability to prioritize applications
over drivers, many drivers act like Denial of Service
Key: SPARK-27750
URL: https://issues.apache.org/jira/browse/SPARK-27750
[
https://issues.apache.org/jira/browse/SPARK-27748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27748:
Assignee: (was: Apache Spark)
> Kafka consumer/producer password/token redaction
>
[
https://issues.apache.org/jira/browse/SPARK-27748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27748:
Assignee: Apache Spark
> Kafka consumer/producer password/token redaction
>
Yuming Wang created SPARK-27749:
---
Summary: Fix hadoop-3.2 hive-thriftserver module test issue
Key: SPARK-27749
URL: https://issues.apache.org/jira/browse/SPARK-27749
Project: Spark
Issue Type:
Gabor Somogyi created SPARK-27748:
-
Summary: Kafka consumer/producer password/token redaction
Key: SPARK-27748
URL: https://issues.apache.org/jira/browse/SPARK-27748
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-27747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27747:
Assignee: Wenchen Fan (was: Apache Spark)
> add a logical plan link in the physical
[
https://issues.apache.org/jira/browse/SPARK-27747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27747:
Assignee: Apache Spark (was: Wenchen Fan)
> add a logical plan link in the physical
Wenchen Fan created SPARK-27746:
---
Summary: add a logical plan link in the physical plan
Key: SPARK-27746
URL: https://issues.apache.org/jira/browse/SPARK-27746
Project: Spark
Issue Type:
Wenchen Fan created SPARK-27747:
---
Summary: add a logical plan link in the physical plan
Key: SPARK-27747
URL: https://issues.apache.org/jira/browse/SPARK-27747
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-27377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-27377.
---
Resolution: Fixed
> Upgrade YARN to 3.1.2+ to support GPU
>
[
https://issues.apache.org/jira/browse/SPARK-27376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16841404#comment-16841404
]
Thomas Graves commented on SPARK-27376:
---
[~mengxr] [~jiangxb]
Thoughts on my proposal above to
[
https://issues.apache.org/jira/browse/SPARK-27733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16841410#comment-16841410
]
Nandor Kollar commented on SPARK-27733:
---
For example HiveCatalogedDDLSuite "create hive serde
Izek Greenfield created SPARK-27745:
---
Summary: build/mvn take wrong scala version when compile for scala
2.12
Key: SPARK-27745
URL: https://issues.apache.org/jira/browse/SPARK-27745
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-27378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16841412#comment-16841412
]
Thomas Graves commented on SPARK-27378:
---
Spark 3.0 already added support for requesting any
[
https://issues.apache.org/jira/browse/SPARK-27379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16841409#comment-16841409
]
Thomas Graves commented on SPARK-27379:
---
The way yarn works is it actually doesn't tell the
[
https://issues.apache.org/jira/browse/SPARK-27379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-27379.
---
Resolution: Invalid
Assignee: Thomas Graves
> YARN passes GPU info to Spark executor
[
https://issues.apache.org/jira/browse/SPARK-27377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16841407#comment-16841407
]
Thomas Graves commented on SPARK-27377:
---
there are enough pieces in the hadoop 3.2 support
[
https://issues.apache.org/jira/browse/SPARK-27376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves reassigned SPARK-27376:
-
Assignee: Thomas Graves
> Design: YARN supports Spark GPU-aware scheduling
>
[
https://issues.apache.org/jira/browse/SPARK-27376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16841402#comment-16841402
]
Thomas Graves commented on SPARK-27376:
---
The design is pretty straight forward, there is really
[
https://issues.apache.org/jira/browse/SPARK-18107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16841351#comment-16841351
]
KaiXu commented on SPARK-18107:
---
it seems this issue have not been fixed? I encountered this issue with
[
https://issues.apache.org/jira/browse/SPARK-27742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16841332#comment-16841332
]
Gabor Somogyi commented on SPARK-27742:
---
Kafka delegation token support just added to 3.0 on
[
https://issues.apache.org/jira/browse/SPARK-27720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16841325#comment-16841325
]
Gabor Somogyi commented on SPARK-27720:
---
[~ov7a] Thanks for your efforts and I've had a look on
[
https://issues.apache.org/jira/browse/SPARK-27334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16841322#comment-16841322
]
Alexander Fedosov commented on SPARK-27334:
---
Hello [~TommyLike]!
It looks like this ticket
[
https://issues.apache.org/jira/browse/SPARK-25075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16841287#comment-16841287
]
Lukas Rytz commented on SPARK-25075:
In our own interest of testing Scala the 2.13 RCs, I took a
[
https://issues.apache.org/jira/browse/SPARK-27744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16841284#comment-16841284
]
Apache Spark commented on SPARK-27744:
--
User 'onursatici' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-27744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27744:
Assignee: Apache Spark
> SubqueryExec thread pool does not preserve thread local
[
https://issues.apache.org/jira/browse/SPARK-27744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27744:
Assignee: (was: Apache Spark)
> SubqueryExec thread pool does not preserve thread
[
https://issues.apache.org/jira/browse/SPARK-27743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27743:
Assignee: (was: Apache Spark)
> alter table: bucketing
> --
>
>
[
https://issues.apache.org/jira/browse/SPARK-27743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27743:
Assignee: Apache Spark
> alter table: bucketing
> --
>
>
Onur Satici created SPARK-27744:
---
Summary: SubqueryExec thread pool does not preserve thread local
properties
Key: SPARK-27744
URL: https://issues.apache.org/jira/browse/SPARK-27744
Project: Spark
xzh_dz created SPARK-27743:
--
Summary: alter table: bucketing
Key: SPARK-27743
URL: https://issues.apache.org/jira/browse/SPARK-27743
Project: Spark
Issue Type: Wish
Components: SQL
[
https://issues.apache.org/jira/browse/SPARK-27722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-27722.
-
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 24622
[
https://issues.apache.org/jira/browse/SPARK-27722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-27722:
---
Assignee: Shivu Sondur
> Remove UnsafeKeyValueSorter
> ---
>
>
[
https://issues.apache.org/jira/browse/SPARK-27742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Stavros Kontopoulos updated SPARK-27742:
Summary: Security Support in Sources and Sinks for SS and Batch (was:
Security
Stavros Kontopoulos created SPARK-27742:
---
Summary: Security Support in Sources and Sinks for SS and batch
Key: SPARK-27742
URL: https://issues.apache.org/jira/browse/SPARK-27742
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-27733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16841193#comment-16841193
]
Nandor Kollar commented on SPARK-27733:
---
[~hyukjin.kwon] I tried to run Spark tests after Avro
[
https://issues.apache.org/jira/browse/SPARK-27733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16841189#comment-16841189
]
Hyukjin Kwon commented on SPARK-27733:
--
why is it dependent on Hive's?
> Upgrade to Avro 1.9.x
>
[
https://issues.apache.org/jira/browse/SPARK-27733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-27733:
-
Component/s: (was: Spark Core)
SQL
> Upgrade to Avro 1.9.x
>
[
https://issues.apache.org/jira/browse/SPARK-27741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-27741.
--
Resolution: Duplicate
> Transitivity on predicate pushdown
>
[
https://issues.apache.org/jira/browse/SPARK-27741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16841184#comment-16841184
]
Hyukjin Kwon commented on SPARK-27741:
--
[~xyxiaoyou], can you check if the same issue exists in
[
https://issues.apache.org/jira/browse/SPARK-27733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ismaël Mejía updated SPARK-27733:
-
Description: Avro 1.9.0 was released with many nice features including
reduced size (1MB less),
[
https://issues.apache.org/jira/browse/SPARK-27741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
U Shaw updated SPARK-27741:
---
Affects Version/s: (was: 2.4.3)
2.1.1
> Transitivity on predicate pushdown
>
[
https://issues.apache.org/jira/browse/SPARK-24374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16840122#comment-16840122
]
Ruiguang Pei edited comment on SPARK-24374 at 5/16/19 9:17 AM:
---
Hi,
[
https://issues.apache.org/jira/browse/SPARK-27741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16841087#comment-16841087
]
Yuming Wang commented on SPARK-27741:
-
This should be supported since SPARK-21479.
> Transitivity
[
https://issues.apache.org/jira/browse/SPARK-27741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
U Shaw updated SPARK-27741:
---
Description:
When using inner join, where conditions can be passed to join on, and when
using outer join,
U Shaw created SPARK-27741:
--
Summary: Transitivity on predicate pushdown
Key: SPARK-27741
URL: https://issues.apache.org/jira/browse/SPARK-27741
Project: Spark
Issue Type: New Feature
73 matches
Mail list logo
