[
https://issues.apache.org/jira/browse/SPARK-32672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17182225#comment-17182225
]
Hyukjin Kwon edited comment on SPARK-32672 at 8/22/20, 4:57 AM:
--
[
https://issues.apache.org/jira/browse/SPARK-26164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17182239#comment-17182239
]
Cheng Su commented on SPARK-26164:
--
[~cloud_fan], [~hyukjin.kwon] - wondering how do yo
[
https://issues.apache.org/jira/browse/SPARK-32672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17182225#comment-17182225
]
Hyukjin Kwon edited comment on SPARK-32672 at 8/22/20, 2:27 AM:
--
[
https://issues.apache.org/jira/browse/SPARK-32672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17182225#comment-17182225
]
Hyukjin Kwon commented on SPARK-32672:
--
[~revans2] is a PMC, and it is a correctnes
[
https://issues.apache.org/jira/browse/SPARK-32672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-32672.
--
Fix Version/s: 3.1.0
2.4.7
3.0.1
Resolution: Fixed
[
https://issues.apache.org/jira/browse/SPARK-32672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-32672:
Assignee: Robert Joseph Evans
> Data corruption in some cached compressed boolean columns
[
https://issues.apache.org/jira/browse/SPARK-32646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17182218#comment-17182218
]
Apache Spark commented on SPARK-32646:
--
User 'viirya' has created a pull request fo
[
https://issues.apache.org/jira/browse/SPARK-32646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
L. C. Hsieh updated SPARK-32646:
Affects Version/s: 3.0.0
> ORC predicate pushdown should work with case-insensitive analysis
> ---
[
https://issues.apache.org/jira/browse/SPARK-32662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Huaxin Gao resolved SPARK-32662.
Fix Version/s: 3.1.0
Resolution: Fixed
Issue resolved by pull request 29482
[https://github
[
https://issues.apache.org/jira/browse/SPARK-32662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Huaxin Gao reassigned SPARK-32662:
--
Assignee: Jatin Puri
> CountVectorizerModel: Remove requirement for minimum vocabulary size
>
[
https://issues.apache.org/jira/browse/SPARK-32642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17182160#comment-17182160
]
Apache Spark commented on SPARK-32642:
--
User 'holdenk' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-32642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-32642:
Assignee: Apache Spark (was: Holden Karau)
> Add support for ESS in Spark sidecar
>
[
https://issues.apache.org/jira/browse/SPARK-32642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17182158#comment-17182158
]
Apache Spark commented on SPARK-32642:
--
User 'holdenk' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-32642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-32642:
Assignee: Holden Karau (was: Apache Spark)
> Add support for ESS in Spark sidecar
>
[
https://issues.apache.org/jira/browse/SPARK-32669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takeshi Yamamuro resolved SPARK-32669.
--
Fix Version/s: 3.1.0
Resolution: Fixed
Resolved by
[https://github.com/apache/
[
https://issues.apache.org/jira/browse/SPARK-32672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-32672:
--
Affects Version/s: (was: 2.2.3)
> Data corruption in some cached compressed boolean column
[
https://issues.apache.org/jira/browse/SPARK-32672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17182156#comment-17182156
]
Dongjoon Hyun commented on SPARK-32672:
---
Thank you, [~revans2].
> Data corruptio
[
https://issues.apache.org/jira/browse/SPARK-32672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-32672:
--
Affects Version/s: 2.2.3
> Data corruption in some cached compressed boolean columns
> ---
[
https://issues.apache.org/jira/browse/SPARK-32672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-32672:
--
Affects Version/s: 2.3.4
> Data corruption in some cached compressed boolean columns
> ---
[
https://issues.apache.org/jira/browse/SPARK-32686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17182045#comment-17182045
]
Apache Spark commented on SPARK-32686:
--
User 'nchammas' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-32686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-32686:
Assignee: Apache Spark
> Un-deprecate inferring DataFrame schema from list of dictionarie
[
https://issues.apache.org/jira/browse/SPARK-32686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-32686:
Assignee: (was: Apache Spark)
> Un-deprecate inferring DataFrame schema from list of
Nicholas Chammas created SPARK-32686:
Summary: Un-deprecate inferring DataFrame schema from list of
dictionaries
Key: SPARK-32686
URL: https://issues.apache.org/jira/browse/SPARK-32686
Project: Sp
[
https://issues.apache.org/jira/browse/SPARK-32686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17182040#comment-17182040
]
Nicholas Chammas commented on SPARK-32686:
--
Not sure if I have the "Affects Ver
[
https://issues.apache.org/jira/browse/SPARK-31608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17181969#comment-17181969
]
Apache Spark commented on SPARK-31608:
--
User 'baohe-zhang' has created a pull reque
[
https://issues.apache.org/jira/browse/SPARK-31608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17181968#comment-17181968
]
Apache Spark commented on SPARK-31608:
--
User 'baohe-zhang' has created a pull reque
angerszhu created SPARK-32685:
-
Summary: Script transform hive serde default field.delimit is '\t'
Key: SPARK-32685
URL: https://issues.apache.org/jira/browse/SPARK-32685
Project: Spark
Issue Typ
[
https://issues.apache.org/jira/browse/SPARK-32684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
angerszhu updated SPARK-32684:
--
Summary: Scrip transform hive serde/default-serde mode null value keep same
with hive as '\\N' (was:
[
https://issues.apache.org/jira/browse/SPARK-32684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
angerszhu updated SPARK-32684:
--
Description:
Hive serde default NULL value is '\N'
{code:java}
String nullString = tbl.getProperty(
[
https://issues.apache.org/jira/browse/SPARK-32684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
angerszhu updated SPARK-32684:
--
Parent: SPARK-31936
Issue Type: Sub-task (was: Bug)
> Scrip transform hive serde/default-serd
angerszhu created SPARK-32684:
-
Summary: Scrip transform hive serde/default-serde mode null value
keep same with hive
Key: SPARK-32684
URL: https://issues.apache.org/jira/browse/SPARK-32684
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-32287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17181923#comment-17181923
]
Apache Spark commented on SPARK-32287:
--
User 'tgravescs' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-32680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-32680:
Assignee: (was: Apache Spark)
> CTAS with V2 catalog wrongly accessed unresolved quer
[
https://issues.apache.org/jira/browse/SPARK-32680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17181912#comment-17181912
]
Apache Spark commented on SPARK-32680:
--
User 'linhongliu-db' has created a pull req
[
https://issues.apache.org/jira/browse/SPARK-32680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-32680:
Assignee: Apache Spark
> CTAS with V2 catalog wrongly accessed unresolved query
> ---
[
https://issues.apache.org/jira/browse/SPARK-32672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17181910#comment-17181910
]
Apache Spark commented on SPARK-32672:
--
User 'revans2' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-32672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-32672:
Assignee: (was: Apache Spark)
> Data corruption in some cached compressed boolean col
[
https://issues.apache.org/jira/browse/SPARK-32672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-32672:
Assignee: Apache Spark
> Data corruption in some cached compressed boolean columns
>
[
https://issues.apache.org/jira/browse/SPARK-32672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17181909#comment-17181909
]
Apache Spark commented on SPARK-32672:
--
User 'revans2' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-32672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17181873#comment-17181873
]
Robert Joseph Evans commented on SPARK-32672:
-
OK reading through the code I
[
https://issues.apache.org/jira/browse/SPARK-32683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Daeho Ro updated SPARK-32683:
-
Environment:
Windows 10 Pro
* with Jupyter Lab - Docker Image
** jupyter/all-spark-notebook:f1811928b
[
https://issues.apache.org/jira/browse/SPARK-32683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Daeho Ro updated SPARK-32683:
-
Environment:
Windows 10 Pro
* with Jupyter Lab - Docker Image
** jupyter/all-spark-notebook:f1811928b
[
https://issues.apache.org/jira/browse/SPARK-32683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Daeho Ro updated SPARK-32683:
-
Environment:
Windows 10 Pro
* with Jupyter Lab Docker Image
** for the spark 3.0
** python 3.8.5
**
[
https://issues.apache.org/jira/browse/SPARK-32672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Robert Joseph Evans updated SPARK-32672:
Attachment: small_bad.snappy.parquet
> Data corruption in some cached compressed b
[
https://issues.apache.org/jira/browse/SPARK-32672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17181868#comment-17181868
]
Robert Joseph Evans commented on SPARK-32672:
-
So I am able to reduce the co
[
https://issues.apache.org/jira/browse/SPARK-32672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17181867#comment-17181867
]
Thomas Graves commented on SPARK-32672:
---
[~cltlfcjin] Please do not be changing p
[
https://issues.apache.org/jira/browse/SPARK-32683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Daeho Ro updated SPARK-32683:
-
Description:
h3. Background
>From the
>[documentation|https://spark.apache.org/docs/latest/sql-ref-dat
[
https://issues.apache.org/jira/browse/SPARK-32683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Daeho Ro updated SPARK-32683:
-
Description:
>From the docs, the pattern F should give a week of the month.
|*Symbol*|*Meaning*|*Present
[
https://issues.apache.org/jira/browse/SPARK-32683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Daeho Ro updated SPARK-32683:
-
Description:
>From the docs, the pattern F should give a week of the month.
|*Symbol*|*Meaning*|*Present
[
https://issues.apache.org/jira/browse/SPARK-32683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Daeho Ro updated SPARK-32683:
-
Attachment: comment.png
> Datetime Pattern F not working as expected
> -
[
https://issues.apache.org/jira/browse/SPARK-32683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Daeho Ro updated SPARK-32683:
-
Attachment: 주석 2020-08-21 213522.png
> Datetime Pattern F not working as expected
>
[
https://issues.apache.org/jira/browse/SPARK-32683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Daeho Ro updated SPARK-32683:
-
Attachment: (was: 주석 2020-08-21 213522.png)
> Datetime Pattern F not working as expected
> -
[
https://issues.apache.org/jira/browse/SPARK-32683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Daeho Ro updated SPARK-32683:
-
Description:
>From the docs, the pattern F should give a week of the month.
|*Symbol*|*Meaning*|*Present
[
https://issues.apache.org/jira/browse/SPARK-32683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Daeho Ro updated SPARK-32683:
-
Summary: Datetime Pattern F not working expected (was: Datetime Pattern F
works wrongly.)
> Datetime P
Daeho Ro created SPARK-32683:
Summary: Datetime Pattern F works wrongly.
Key: SPARK-32683
URL: https://issues.apache.org/jira/browse/SPARK-32683
Project: Spark
Issue Type: Bug
Component
[
https://issues.apache.org/jira/browse/SPARK-32683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Daeho Ro updated SPARK-32683:
-
Summary: Datetime Pattern F not working as expected (was: Datetime Pattern
F not working expected)
> D
[
https://issues.apache.org/jira/browse/SPARK-32682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takeshi Yamamuro resolved SPARK-32682.
--
Fix Version/s: 3.1.0
Assignee: Takeshi Yamamuro
Resolution: Fixed
Reso
[
https://issues.apache.org/jira/browse/SPARK-29654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17181827#comment-17181827
]
Pavol Knapek commented on SPARK-29654:
--
Is there any chance to have this backported
[
https://issues.apache.org/jira/browse/SPARK-32635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17181800#comment-17181800
]
Vinod KC commented on SPARK-32635:
--
[~sascha.baumanns], updated code section. Thanks
>
[
https://issues.apache.org/jira/browse/SPARK-32635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinod KC updated SPARK-32635:
-
Description:
When pyspark.sql.functions.lit() function is used with dataframe cache, it
returns wrong r
[
https://issues.apache.org/jira/browse/SPARK-32682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17181765#comment-17181765
]
Apache Spark commented on SPARK-32682:
--
User 'maropu' has created a pull request fo
[
https://issues.apache.org/jira/browse/SPARK-32682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-32682:
Assignee: Apache Spark
> Use workflow_dispatch to enable manual test triggers
> -
[
https://issues.apache.org/jira/browse/SPARK-32682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17181767#comment-17181767
]
Apache Spark commented on SPARK-32682:
--
User 'maropu' has created a pull request fo
[
https://issues.apache.org/jira/browse/SPARK-32682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-32682:
Assignee: (was: Apache Spark)
> Use workflow_dispatch to enable manual test triggers
Takeshi Yamamuro created SPARK-32682:
Summary: Use workflow_dispatch to enable manual test triggers
Key: SPARK-32682
URL: https://issues.apache.org/jira/browse/SPARK-32682
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-29471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17181736#comment-17181736
]
Chang chen commented on SPARK-29471:
I met the same issue, and eventually find the r
[
https://issues.apache.org/jira/browse/SPARK-32681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-32681:
-
Parent: (was: SPARK-32082)
Issue Type: Improvement (was: Sub-task)
> PySpark type h
Hyukjin Kwon created SPARK-32681:
Summary: PySpark type hints support
Key: SPARK-32681
URL: https://issues.apache.org/jira/browse/SPARK-32681
Project: Spark
Issue Type: Sub-task
Com
[
https://issues.apache.org/jira/browse/SPARK-32648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-32648:
Assignee: (was: Apache Spark)
> Remove unused DELETE_ACTION in FileStreamSinkLog
> --
[
https://issues.apache.org/jira/browse/SPARK-32648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17181735#comment-17181735
]
Apache Spark commented on SPARK-32648:
--
User 'michal-wieleba' has created a pull re
[
https://issues.apache.org/jira/browse/SPARK-32648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-32648:
Assignee: Apache Spark
> Remove unused DELETE_ACTION in FileStreamSinkLog
> -
Linhong Liu created SPARK-32680:
---
Summary: CTAS with V2 catalog wrongly accessed unresolved query
Key: SPARK-32680
URL: https://issues.apache.org/jira/browse/SPARK-32680
Project: Spark
Issue Ty
[
https://issues.apache.org/jira/browse/SPARK-32646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-32646.
-
Fix Version/s: 3.1.0
Resolution: Fixed
Issue resolved by pull request 29457
[https://gith
[
https://issues.apache.org/jira/browse/SPARK-32674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-32674.
--
Fix Version/s: 3.1.0
2.4.7
3.0.1
Resolution: Fixed
[
https://issues.apache.org/jira/browse/SPARK-32674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-32674:
Assignee: Chao Sun
> Add suggestion for parallel directory listing in tuning doc
> --
angerszhu created SPARK-32679:
-
Summary: update "no-serde" in the codebase in other TRANSFORM PRs.
Key: SPARK-32679
URL: https://issues.apache.org/jira/browse/SPARK-32679
Project: Spark
Issue Ty
[
https://issues.apache.org/jira/browse/SPARK-32667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-32667.
-
Fix Version/s: 3.1.0
Resolution: Fixed
Issue resolved by pull request 29500
[https://gith
[
https://issues.apache.org/jira/browse/SPARK-32667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-32667:
---
Assignee: angerszhu
> Scrip transformation no-serde mode when column less then output lengt
[
https://issues.apache.org/jira/browse/SPARK-32678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-32678:
Assignee: (was: Apache Spark)
> Rename EmptyHashedRelationWithAllNullKeys and simplif
[
https://issues.apache.org/jira/browse/SPARK-32678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-32678:
Assignee: Apache Spark
> Rename EmptyHashedRelationWithAllNullKeys and simplify NAAJ gene
[
https://issues.apache.org/jira/browse/SPARK-32678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17181677#comment-17181677
]
Apache Spark commented on SPARK-32678:
--
User 'leanken' has created a pull request f
Leanken.Lin created SPARK-32678:
---
Summary: Rename EmptyHashedRelationWithAllNullKeys and simplify
NAAJ generated code
Key: SPARK-32678
URL: https://issues.apache.org/jira/browse/SPARK-32678
Project: Spa
83 matches
Mail list logo