[
https://issues.apache.org/jira/browse/SPARK-27160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-27160:
---
Description:
DecimalType Literal should not be casted to Long.
eg. For `df.filter("x < 3.14")`, ass
[
https://issues.apache.org/jira/browse/SPARK-27160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-27160:
---
Priority: Blocker (was: Major)
> Incorrect Literal Casting of DecimalType in OrcFilters
> -
[
https://issues.apache.org/jira/browse/SPARK-27160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-27160:
---
Target Version/s: (was: 2.4.1)
> Incorrect Literal Casting of DecimalType in OrcFilters
>
[
https://issues.apache.org/jira/browse/SPARK-27160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-27160:
---
Fix Version/s: 3.0.0
> Incorrect Literal Casting of DecimalType in OrcFilters
>
[
https://issues.apache.org/jira/browse/SPARK-27160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-27160:
---
Fix Version/s: 2.4.1
> Incorrect Literal Casting of DecimalType in OrcFilters
>
[
https://issues.apache.org/jira/browse/SPARK-27160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-27160:
---
Labels: correctness (was: )
> Incorrect Literal Casting of DecimalType in OrcFilters
>
[
https://issues.apache.org/jira/browse/SPARK-27160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-27160:
---
Target Version/s: 2.4.1
> Incorrect Literal Casting of DecimalType in OrcFilters
> -
[
https://issues.apache.org/jira/browse/SPARK-27179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-27179:
Environment: (was: Since YARN-7113(Hadoop-3.1.0), hadoop-client add
javax.ws.rs:jsr311-api to
[
https://issues.apache.org/jira/browse/SPARK-27179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-27179:
Description: Since YARN-7113(Hadoop-3.1.0), hadoop-client add
javax.ws.rs:jsr311-api to its depend
[
https://issues.apache.org/jira/browse/SPARK-27179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27179:
Assignee: Apache Spark
> Exclude javax.ws.rs:jsr311-api from hadoop-client
>
[
https://issues.apache.org/jira/browse/SPARK-27179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27179:
Assignee: (was: Apache Spark)
> Exclude javax.ws.rs:jsr311-api from hadoop-client
> -
Yuming Wang created SPARK-27179:
---
Summary: Exclude javax.ws.rs:jsr311-api from hadoop-client
Key: SPARK-27179
URL: https://issues.apache.org/jira/browse/SPARK-27179
Project: Spark
Issue Type: B
[
https://issues.apache.org/jira/browse/SPARK-27170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16794096#comment-16794096
]
Dilip Biswal commented on SPARK-27170:
--
[~wyukawa]
Unfortunately in Spark, we turn
[
https://issues.apache.org/jira/browse/SPARK-27050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16794092#comment-16794092
]
Jungtaek Lim commented on SPARK-27050:
--
Seems like it's resolved in master (3.0.0).
[
https://issues.apache.org/jira/browse/SPARK-27159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen reassigned SPARK-27159:
-
Assignee: Zhu, Lipeng
> Update MsSqlServer dialect
> --
>
>
[
https://issues.apache.org/jira/browse/SPARK-27159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-27159:
--
Priority: Minor (was: Major)
> Update MsSqlServer dialect handling of BLOB type
> ---
[
https://issues.apache.org/jira/browse/SPARK-27159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-27159:
--
Summary: Update MsSqlServer dialect handling of BLOB type (was: Update
MsSqlServer dialect)
> Update
[
https://issues.apache.org/jira/browse/SPARK-27159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-27159.
---
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 24091
[https://github.c
[
https://issues.apache.org/jira/browse/SPARK-27177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16794035#comment-16794035
]
Yuming Wang commented on SPARK-27177:
-
I’d prefer to PRB + sbt builds.
> Update jen
[
https://issues.apache.org/jira/browse/SPARK-27178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
shane knapp updated SPARK-27178:
Affects Version/s: 2.4.0
> k8s test failing due to missing nss library in dockerfile
> ---
[
https://issues.apache.org/jira/browse/SPARK-27178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16794008#comment-16794008
]
shane knapp edited comment on SPARK-27178 at 3/15/19 11:25 PM:
---
[
https://issues.apache.org/jira/browse/SPARK-27038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16794002#comment-16794002
]
Marcelo Vanzin commented on SPARK-27038:
I was looking for something completely
[
https://issues.apache.org/jira/browse/SPARK-27178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16794008#comment-16794008
]
shane knapp commented on SPARK-27178:
-
argh! this also looks like it's failing on 2
[
https://issues.apache.org/jira/browse/SPARK-13704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16794006#comment-16794006
]
Apache Spark commented on SPARK-13704:
--
User 'LantaoJin' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-13704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-13704:
Assignee: (was: Apache Spark)
> TaskSchedulerImpl.createTaskSetManager can be expensi
[
https://issues.apache.org/jira/browse/SPARK-13704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-13704:
Assignee: Apache Spark
> TaskSchedulerImpl.createTaskSetManager can be expensive, and res
[
https://issues.apache.org/jira/browse/SPARK-13704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16794005#comment-16794005
]
Apache Spark commented on SPARK-13704:
--
User 'LantaoJin' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-27038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin resolved SPARK-27038.
Resolution: Duplicate
> Rack resolving takes a long time when initializing TaskSetManager
[
https://issues.apache.org/jira/browse/SPARK-27178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
shane knapp updated SPARK-27178:
Description:
while performing some tests on our existing minikube and k8s infrastructure, i
notic
[
https://issues.apache.org/jira/browse/SPARK-27178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27178:
Assignee: shane knapp (was: Apache Spark)
> k8s test failing due to missing nss library
[
https://issues.apache.org/jira/browse/SPARK-27178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27178:
Assignee: Apache Spark (was: shane knapp)
> k8s test failing due to missing nss library
shane knapp created SPARK-27178:
---
Summary: k8s test failing due to missing nss library in dockerfile
Key: SPARK-27178
URL: https://issues.apache.org/jira/browse/SPARK-27178
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-27070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27070:
Assignee: Yuli Fiterman (was: Apache Spark)
> DefaultPartitionCoalescer can lock up driv
[
https://issues.apache.org/jira/browse/SPARK-26634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin resolved SPARK-26634.
Resolution: Duplicate
> OutputCommitCoordinator may allow task of FetchFailureStage commit
[
https://issues.apache.org/jira/browse/SPARK-27070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-27070:
--
Fix Version/s: (was: 3.0.0)
> DefaultPartitionCoalescer can lock up driver for hours
> ---
[
https://issues.apache.org/jira/browse/SPARK-27070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27070:
Assignee: Apache Spark (was: Yuli Fiterman)
> DefaultPartitionCoalescer can lock up driv
[
https://issues.apache.org/jira/browse/SPARK-27070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reopened SPARK-27070:
---
This is reverted due to Scala-2.11 failure.
-
https://github.com/apache/spark/commit/4bab69b22a
[
https://issues.apache.org/jira/browse/SPARK-25603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
DB Tsai updated SPARK-25603:
Summary: Generalize Nested Column Pruning (was: Nested Column Pruning)
> Generalize Nested Column Pruning
[
https://issues.apache.org/jira/browse/SPARK-26257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16793842#comment-16793842
]
Tyson Condie edited comment on SPARK-26257 at 3/15/19 8:07 PM:
---
[
https://issues.apache.org/jira/browse/SPARK-26257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tyson Condie updated SPARK-26257:
-
Affects Version/s: (was: 2.4.0)
3.0.0
> SPIP: Interop Support for Spa
[
https://issues.apache.org/jira/browse/SPARK-27076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16793868#comment-16793868
]
Steve Loughran commented on SPARK-27076:
I've seen this before in the specific c
[
https://issues.apache.org/jira/browse/SPARK-26257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tyson Condie updated SPARK-26257:
-
Priority: Major (was: Minor)
> SPIP: Interop Support for Spark Language Extensions
> --
[
https://issues.apache.org/jira/browse/SPARK-26257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16793842#comment-16793842
]
Tyson Condie commented on SPARK-26257:
--
Thank you [~abellina] [~srowen] [~zjffdu] f
[
https://issues.apache.org/jira/browse/SPARK-27177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16793744#comment-16793744
]
shane knapp commented on SPARK-27177:
-
are we proposing to do this for all spark bui
[
https://issues.apache.org/jira/browse/SPARK-25341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-25341:
Assignee: Apache Spark
> Support rolling back a shuffle map stage and re-generate the shu
[
https://issues.apache.org/jira/browse/SPARK-25341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-25341:
Assignee: (was: Apache Spark)
> Support rolling back a shuffle map stage and re-gener
[
https://issues.apache.org/jira/browse/SPARK-27177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16793698#comment-16793698
]
Yuming Wang commented on SPARK-27177:
-
cc [~shaneknapp] [~srowen]
> Update jenkins
[
https://issues.apache.org/jira/browse/SPARK-27177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16793703#comment-16793703
]
Sean Owen commented on SPARK-27177:
---
Seems OK to me.
> Update jenkins locale to en_US
[
https://issues.apache.org/jira/browse/SPARK-27177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-27177:
Description:
Two test cases will failed on our jenkins since HADOOP-12045(Hadoop-2.8.0). I'd
like
Yuming Wang created SPARK-27177:
---
Summary: Update jenkins locale to en_US.UTF-8
Key: SPARK-27177
URL: https://issues.apache.org/jira/browse/SPARK-27177
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-27169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16793675#comment-16793675
]
shahid commented on SPARK-27169:
Seems event drop has happened.
> number of active tas
[
https://issues.apache.org/jira/browse/SPARK-27176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27176:
Assignee: (was: Apache Spark)
> Upgrade hadoop-3's built-in Hive maven dependencies t
[
https://issues.apache.org/jira/browse/SPARK-27176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27176:
Assignee: Apache Spark
> Upgrade hadoop-3's built-in Hive maven dependencies to 2.3.4
> -
[
https://issues.apache.org/jira/browse/SPARK-27176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16793665#comment-16793665
]
Apache Spark commented on SPARK-27176:
--
User 'wangyum' has created a pull request f
Yuming Wang created SPARK-27176:
---
Summary: Upgrade hadoop-3's built-in Hive maven dependencies to
2.3.4
Key: SPARK-27176
URL: https://issues.apache.org/jira/browse/SPARK-27176
Project: Spark
I
[
https://issues.apache.org/jira/browse/SPARK-27174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27174:
Assignee: Apache Spark
> Support casting integer types to BinaryType
> --
[
https://issues.apache.org/jira/browse/SPARK-27174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27174:
Assignee: (was: Apache Spark)
> Support casting integer types to BinaryType
> ---
[
https://issues.apache.org/jira/browse/SPARK-27174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16793525#comment-16793525
]
Martin Junghanns commented on SPARK-27174:
--
I'm working on the PR.
> Support c
[
https://issues.apache.org/jira/browse/SPARK-27175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27175:
Assignee: (was: Apache Spark)
> Upgrade hadoop-3 to 3.2.0
> -
[
https://issues.apache.org/jira/browse/SPARK-27175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27175:
Assignee: Apache Spark
> Upgrade hadoop-3 to 3.2.0
> -
>
>
Yuming Wang created SPARK-27175:
---
Summary: Upgrade hadoop-3 to 3.2.0
Key: SPARK-27175
URL: https://issues.apache.org/jira/browse/SPARK-27175
Project: Spark
Issue Type: Improvement
Com
Martin Junghanns created SPARK-27174:
Summary: Support casting integer types to BinaryType
Key: SPARK-27174
URL: https://issues.apache.org/jira/browse/SPARK-27174
Project: Spark
Issue Typ
[
https://issues.apache.org/jira/browse/SPARK-27173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27173:
Assignee: Apache Spark
> For hive parquet table,codes(lz4,brotli,zstd) are not available
[
https://issues.apache.org/jira/browse/SPARK-27173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27173:
Assignee: (was: Apache Spark)
> For hive parquet table,codes(lz4,brotli,zstd) are not
[
https://issues.apache.org/jira/browse/SPARK-27173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16793472#comment-16793472
]
Yuming Wang commented on SPARK-27173:
-
Yes. We are upgrading the built-in Hive now.
liuxian created SPARK-27173:
---
Summary: For hive parquet table,codes()
Key: SPARK-27173
URL: https://issues.apache.org/jira/browse/SPARK-27173
Project: Spark
Issue Type: Improvement
Compon
[
https://issues.apache.org/jira/browse/SPARK-27173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
liuxian updated SPARK-27173:
Description: From
_parquet.hadoop.metadata.CompressionCodecName_(parquet-hadoop-bundle-1.6.0.jar
), we
[
https://issues.apache.org/jira/browse/SPARK-27173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
liuxian updated SPARK-27173:
Description: We can parquet-hadoop-bundle-1.6.0.jar
parquet.hadoop.metadata.CompressionCodecName
> For
[
https://issues.apache.org/jira/browse/SPARK-27173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
liuxian updated SPARK-27173:
Summary: For hive parquet table,codes(lz4,brotli,zstd) are not available
(was: For hive parquet table,cod
[
https://issues.apache.org/jira/browse/SPARK-27141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
wangjiaochun updated SPARK-27141:
-
Description:
Some of following Yarn file related configs are not use ConfigEntry value,try
to r
[
https://issues.apache.org/jira/browse/SPARK-27141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27141:
Assignee: Apache Spark
> Use ConfigEntry for hardcoded configs Yarn
> ---
[
https://issues.apache.org/jira/browse/SPARK-27141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27141:
Assignee: (was: Apache Spark)
> Use ConfigEntry for hardcoded configs Yarn
>
72 matches
Mail list logo