[
https://issues.apache.org/jira/browse/SPARK-29239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16937495#comment-16937495
]
Liang-Chi Hsieh commented on SPARK-29239:
-
I added SPARK-29221 to the title of t
[
https://issues.apache.org/jira/browse/SPARK-29239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16937486#comment-16937486
]
Liang-Chi Hsieh commented on SPARK-29239:
-
Yes.
> Subquery should not cause NPE
Liang-Chi Hsieh created SPARK-29239:
---
Summary: Subquery should not cause NPE when eliminating
subexpression
Key: SPARK-29239
URL: https://issues.apache.org/jira/browse/SPARK-29239
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-29181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Liang-Chi Hsieh resolved SPARK-29181.
-
Resolution: Duplicate
> Cache preferred locations of checkpointed RDD
>
[
https://issues.apache.org/jira/browse/SPARK-29182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Liang-Chi Hsieh reassigned SPARK-29182:
---
Assignee: Liang-Chi Hsieh
> Cache preferred locations of checkpointed RDD
> ---
[
https://issues.apache.org/jira/browse/SPARK-29181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16933955#comment-16933955
]
Liang-Chi Hsieh commented on SPARK-29181:
-
[~dongjoon] Thanks. Not aware of crea
Liang-Chi Hsieh created SPARK-29182:
---
Summary: Cache preferred locations of checkpointed RDD
Key: SPARK-29182
URL: https://issues.apache.org/jira/browse/SPARK-29182
Project: Spark
Issue Typ
Liang-Chi Hsieh created SPARK-29181:
---
Summary: Cache preferred locations of checkpointed RDD
Key: SPARK-29181
URL: https://issues.apache.org/jira/browse/SPARK-29181
Project: Spark
Issue Typ
[
https://issues.apache.org/jira/browse/SPARK-29042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16932784#comment-16932784
]
Liang-Chi Hsieh commented on SPARK-29042:
-
[~hyukjin.kwon] Am I setting the fix
[
https://issues.apache.org/jira/browse/SPARK-29042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Liang-Chi Hsieh updated SPARK-29042:
Fix Version/s: 2.4.5
> Sampling-based RDD with unordered input should be INDETERMINATE
> -
[
https://issues.apache.org/jira/browse/SPARK-22796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Liang-Chi Hsieh resolved SPARK-22796.
-
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 25812
[http
[
https://issues.apache.org/jira/browse/SPARK-22796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Liang-Chi Hsieh reassigned SPARK-22796:
---
Assignee: Huaxin Gao
> Add multiple column support to PySpark QuantileDiscretizer
>
[
https://issues.apache.org/jira/browse/SPARK-28927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16930827#comment-16930827
]
Liang-Chi Hsieh commented on SPARK-28927:
-
Regarding to AUC unstable issue, the
[
https://issues.apache.org/jira/browse/SPARK-26205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16930787#comment-16930787
]
Liang-Chi Hsieh commented on SPARK-26205:
-
[~cloud_fan]. I see now. Created SPAR
[
https://issues.apache.org/jira/browse/SPARK-29100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Liang-Chi Hsieh reassigned SPARK-29100:
---
Assignee: Liang-Chi Hsieh
> Codegen with switch in InSet expression causes compilat
[
https://issues.apache.org/jira/browse/SPARK-29100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Liang-Chi Hsieh updated SPARK-29100:
Description:
SPARK-26205 adds an optimization to InSet that generates Java switch conditio
Liang-Chi Hsieh created SPARK-29100:
---
Summary: Codegen with switch in InSet expression causes
compilation error
Key: SPARK-29100
URL: https://issues.apache.org/jira/browse/SPARK-29100
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-28927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16930658#comment-16930658
]
Liang-Chi Hsieh edited comment on SPARK-28927 at 9/16/19 3:36 PM:
[
https://issues.apache.org/jira/browse/SPARK-28927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16930658#comment-16930658
]
Liang-Chi Hsieh edited comment on SPARK-28927 at 9/16/19 3:35 PM:
[
https://issues.apache.org/jira/browse/SPARK-28927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16930658#comment-16930658
]
Liang-Chi Hsieh commented on SPARK-28927:
-
Because you are using 2.2.1, spark.sq
[
https://issues.apache.org/jira/browse/SPARK-28927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Liang-Chi Hsieh reassigned SPARK-28927:
---
Assignee: Liang-Chi Hsieh
> ArrayIndexOutOfBoundsException and Not-stable AUC metri
[
https://issues.apache.org/jira/browse/SPARK-29042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Liang-Chi Hsieh reassigned SPARK-29042:
---
Assignee: Liang-Chi Hsieh
> Sampling-based RDD with unordered input should be INDET
[
https://issues.apache.org/jira/browse/SPARK-29042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Liang-Chi Hsieh resolved SPARK-29042.
-
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 25751
[http
[
https://issues.apache.org/jira/browse/SPARK-26205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16929334#comment-16929334
]
Liang-Chi Hsieh commented on SPARK-26205:
-
[~cloud_fan] I ran a simple test, see
[
https://issues.apache.org/jira/browse/SPARK-26205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16928649#comment-16928649
]
Liang-Chi Hsieh commented on SPARK-26205:
-
Yeah, I will look at it.
> Optimize
Liang-Chi Hsieh created SPARK-29042:
---
Summary: Sampling-based RDD with unordered input should be
INDETERMINATE
Key: SPARK-29042
URL: https://issues.apache.org/jira/browse/SPARK-29042
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-28927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16926814#comment-16926814
]
Liang-Chi Hsieh commented on SPARK-28927:
-
Hi [~JerryHouse], do you use any non-
[
https://issues.apache.org/jira/browse/SPARK-23265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Liang-Chi Hsieh reassigned SPARK-23265:
---
Assignee: Huaxin Gao
> Update multi-column error handling logic in QuantileDiscreti
[
https://issues.apache.org/jira/browse/SPARK-23265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Liang-Chi Hsieh resolved SPARK-23265.
-
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 20442
[http
Liang-Chi Hsieh created SPARK-29013:
---
Summary: Structurally equivalent subexpression elimination
Key: SPARK-29013
URL: https://issues.apache.org/jira/browse/SPARK-29013
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-28933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Liang-Chi Hsieh updated SPARK-28933:
Fix Version/s: 3.0.0
> Reduce unnecessary shuffle in ALS when initializing factors
> -
[
https://issues.apache.org/jira/browse/SPARK-28933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16920584#comment-16920584
]
Liang-Chi Hsieh commented on SPARK-28933:
-
This issue was resolved by [https://g
[
https://issues.apache.org/jira/browse/SPARK-28933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Liang-Chi Hsieh resolved SPARK-28933.
-
Resolution: Resolved
> Reduce unnecessary shuffle in ALS when initializing factors
> ---
[
https://issues.apache.org/jira/browse/SPARK-28935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16920550#comment-16920550
]
Liang-Chi Hsieh commented on SPARK-28935:
-
Thanks! [~smilegator]
It should be h
[
https://issues.apache.org/jira/browse/SPARK-28927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16920480#comment-16920480
]
Liang-Chi Hsieh commented on SPARK-28927:
-
Does this only happen on 2.2.1? How a
[
https://issues.apache.org/jira/browse/SPARK-23519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Liang-Chi Hsieh updated SPARK-23519:
Component/s: (was: Spark Core)
> Create View Commands Fails with The view output (col
[
https://issues.apache.org/jira/browse/SPARK-23519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16920302#comment-16920302
]
Liang-Chi Hsieh commented on SPARK-23519:
-
This was closed and then reopened and
[
https://issues.apache.org/jira/browse/SPARK-23519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Liang-Chi Hsieh updated SPARK-23519:
Labels: (was: bulk-closed)
> Create View Commands Fails with The view output (col1,col1
[
https://issues.apache.org/jira/browse/SPARK-28935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16919975#comment-16919975
]
Liang-Chi Hsieh commented on SPARK-28935:
-
Thanks for pinging me! I will look in
[
https://issues.apache.org/jira/browse/SPARK-28926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Liang-Chi Hsieh resolved SPARK-28926.
-
Resolution: Duplicate
I think this is duplicate to SPARK-28927.
> CLONE - ArrayIndexOut
[
https://issues.apache.org/jira/browse/SPARK-28933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Liang-Chi Hsieh reassigned SPARK-28933:
---
Assignee: Liang-Chi Hsieh
> Reduce unnecessary shuffle in ALS when initializing fac
Liang-Chi Hsieh created SPARK-28933:
---
Summary: Reduce unnecessary shuffle in ALS when initializing
factors
Key: SPARK-28933
URL: https://issues.apache.org/jira/browse/SPARK-28933
Project: Spark
Liang-Chi Hsieh created SPARK-28920:
---
Summary: Set up java version for github workflow
Key: SPARK-28920
URL: https://issues.apache.org/jira/browse/SPARK-28920
Project: Spark
Issue Type: Imp
[
https://issues.apache.org/jira/browse/SPARK-23519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16915809#comment-16915809
]
Liang-Chi Hsieh commented on SPARK-23519:
-
I test with Hive 2.1. It doesn't supp
[
https://issues.apache.org/jira/browse/SPARK-25549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Liang-Chi Hsieh resolved SPARK-25549.
-
Resolution: Won't Fix
> High level API to collect RDD statistics
> -
[
https://issues.apache.org/jira/browse/SPARK-25549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16915362#comment-16915362
]
Liang-Chi Hsieh commented on SPARK-25549:
-
Close this as it is not needed now.
Liang-Chi Hsieh created SPARK-28866:
---
Summary: Persist item factors RDD when checkpointing in ALS
Key: SPARK-28866
URL: https://issues.apache.org/jira/browse/SPARK-28866
Project: Spark
Issu
[
https://issues.apache.org/jira/browse/SPARK-24666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16914950#comment-16914950
]
Liang-Chi Hsieh commented on SPARK-24666:
-
I tried to run word2vec with Quora Qu
[
https://issues.apache.org/jira/browse/SPARK-23519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16913915#comment-16913915
]
Liang-Chi Hsieh commented on SPARK-23519:
-
Thanks for pinging me.
I am going on
[
https://issues.apache.org/jira/browse/SPARK-28672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16911007#comment-16911007
]
Liang-Chi Hsieh commented on SPARK-28672:
-
Is there any rule in Hive regarding t
[
https://issues.apache.org/jira/browse/SPARK-28761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16909420#comment-16909420
]
Liang-Chi Hsieh commented on SPARK-28761:
-
If you do it at SparkPlan.scala#L344,
[
https://issues.apache.org/jira/browse/SPARK-28732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16909409#comment-16909409
]
Liang-Chi Hsieh commented on SPARK-28732:
-
As {{count}} return type is LongType,
[
https://issues.apache.org/jira/browse/SPARK-28732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16909409#comment-16909409
]
Liang-Chi Hsieh edited comment on SPARK-28732 at 8/16/19 9:19 PM:
Liang-Chi Hsieh created SPARK-28722:
---
Summary: Change sequential label sorting in StringIndexer fit to
parallel
Key: SPARK-28722
URL: https://issues.apache.org/jira/browse/SPARK-28722
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-28652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Liang-Chi Hsieh updated SPARK-28652:
Priority: Minor (was: Major)
> spark.kubernetes.pyspark.pythonVersion is never passed to
[
https://issues.apache.org/jira/browse/SPARK-28652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Liang-Chi Hsieh updated SPARK-28652:
Issue Type: Test (was: Bug)
> spark.kubernetes.pyspark.pythonVersion is never passed to e
[
https://issues.apache.org/jira/browse/SPARK-28652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16904743#comment-16904743
]
Liang-Chi Hsieh commented on SPARK-28652:
-
As existing tests don't explicitly ch
[
https://issues.apache.org/jira/browse/SPARK-28652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16904729#comment-16904729
]
Liang-Chi Hsieh commented on SPARK-28652:
-
This looks interesting to me. I tried
[
https://issues.apache.org/jira/browse/SPARK-28422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16899788#comment-16899788
]
Liang-Chi Hsieh commented on SPARK-28422:
-
Thanks [~dongjoon]!
> GROUPED_AGG p
[
https://issues.apache.org/jira/browse/SPARK-24152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16889742#comment-16889742
]
Liang-Chi Hsieh commented on SPARK-24152:
-
Ok. I think it was fixed.
> SparkR C
[
https://issues.apache.org/jira/browse/SPARK-24152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16889671#comment-16889671
]
Liang-Chi Hsieh commented on SPARK-24152:
-
This CRAN issue is happening now, aga
[
https://issues.apache.org/jira/browse/SPARK-28441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Liang-Chi Hsieh updated SPARK-28441:
Summary: PythonUDF used in correlated scalar subquery causes (was:
udf(max(udf(column)))
[
https://issues.apache.org/jira/browse/SPARK-28441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Liang-Chi Hsieh updated SPARK-28441:
Summary: PythonUDF used in correlated scalar subquery causes
UnsupportedOperationException
[
https://issues.apache.org/jira/browse/SPARK-28441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Liang-Chi Hsieh updated SPARK-28441:
Priority: Major (was: Minor)
> PythonUDF used in correlated scalar subquery causes
> Uns
[
https://issues.apache.org/jira/browse/SPARK-28288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16887707#comment-16887707
]
Liang-Chi Hsieh commented on SPARK-28288:
-
Those errors can be found in original
[
https://issues.apache.org/jira/browse/SPARK-28365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Liang-Chi Hsieh updated SPARK-28365:
Summary: Fallback locale to en_US in StopWordsRemover if system default
locale isn't in av
[
https://issues.apache.org/jira/browse/SPARK-28365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Liang-Chi Hsieh updated SPARK-28365:
Summary: Set default locale param for StopWordsRemover to en_US if system
default locale i
[
https://issues.apache.org/jira/browse/SPARK-28365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Liang-Chi Hsieh updated SPARK-28365:
Priority: Major (was: Minor)
> Set default locale param for StopWordsRemover to en_US if
[
https://issues.apache.org/jira/browse/SPARK-28365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Liang-Chi Hsieh updated SPARK-28365:
Component/s: (was: PySpark)
> Set default locale param for StopWordsRemover to en_US i
[
https://issues.apache.org/jira/browse/SPARK-28365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Liang-Chi Hsieh updated SPARK-28365:
Issue Type: Bug (was: Test)
> Set default locale param for StopWordsRemover to en_US if s
[
https://issues.apache.org/jira/browse/SPARK-28365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Liang-Chi Hsieh updated SPARK-28365:
Component/s: (was: Tests)
ML
> Set default locale for StopWordsRemove
[
https://issues.apache.org/jira/browse/SPARK-28365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Liang-Chi Hsieh updated SPARK-28365:
Description:
Because the local default locale isn't in available locales at {{Locale}}, wh
Liang-Chi Hsieh created SPARK-28381:
---
Summary: Upgraded version of Pyrolite to 4.30
Key: SPARK-28381
URL: https://issues.apache.org/jira/browse/SPARK-28381
Project: Spark
Issue Type: Improv
Liang-Chi Hsieh created SPARK-28378:
---
Summary: Remove usage of cgi.escape
Key: SPARK-28378
URL: https://issues.apache.org/jira/browse/SPARK-28378
Project: Spark
Issue Type: Improvement
Liang-Chi Hsieh created SPARK-28365:
---
Summary: Set default locale for StopWordsRemover tests to prevent
invalid locale error during test
Key: SPARK-28365
URL: https://issues.apache.org/jira/browse/SPARK-28365
[
https://issues.apache.org/jira/browse/SPARK-28345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16882712#comment-16882712
]
Liang-Chi Hsieh commented on SPARK-28345:
-
I found this when doing SPARK-28276.
Liang-Chi Hsieh created SPARK-28345:
---
Summary: PythonUDF predicate should be able to pushdown to join
Key: SPARK-28345
URL: https://issues.apache.org/jira/browse/SPARK-28345
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-28323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16881717#comment-16881717
]
Liang-Chi Hsieh commented on SPARK-28323:
-
I found this bug when doing SPARK-282
Liang-Chi Hsieh created SPARK-28323:
---
Summary: PythonUDF should be able to use in join condition
Key: SPARK-28323
URL: https://issues.apache.org/jira/browse/SPARK-28323
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-28276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16881033#comment-16881033
]
Liang-Chi Hsieh commented on SPARK-28276:
-
Will look into this.
> Convert and p
[
https://issues.apache.org/jira/browse/SPARK-24152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16877497#comment-16877497
]
Liang-Chi Hsieh edited comment on SPARK-24152 at 7/3/19 5:19 AM:
-
[
https://issues.apache.org/jira/browse/SPARK-24152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16877497#comment-16877497
]
Liang-Chi Hsieh commented on SPARK-24152:
-
Received reply that is cleaned up.
>
[
https://issues.apache.org/jira/browse/SPARK-24152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16877401#comment-16877401
]
Liang-Chi Hsieh commented on SPARK-24152:
-
I noticed that this issue happens now
Liang-Chi Hsieh created SPARK-28215:
---
Summary: as_tibble was removed from Arrow R API
Key: SPARK-28215
URL: https://issues.apache.org/jira/browse/SPARK-28215
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-22340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16872852#comment-16872852
]
Liang-Chi Hsieh commented on SPARK-22340:
-
[~hyukjin.kwon] Should we reopen this
[
https://issues.apache.org/jira/browse/SPARK-28079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16868577#comment-16868577
]
Liang-Chi Hsieh commented on SPARK-28079:
-
{{columnNameOfCorruptRecord}} current
[
https://issues.apache.org/jira/browse/SPARK-27946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16867771#comment-16867771
]
Liang-Chi Hsieh commented on SPARK-27946:
-
[~smilegator] Thanks for pinging me.
[
https://issues.apache.org/jira/browse/SPARK-28079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16866777#comment-16866777
]
Liang-Chi Hsieh commented on SPARK-28079:
-
Isn't it the expected behavior as doc
[
https://issues.apache.org/jira/browse/SPARK-28058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16865714#comment-16865714
]
Liang-Chi Hsieh edited comment on SPARK-28058 at 6/17/19 3:59 PM:
[
https://issues.apache.org/jira/browse/SPARK-28058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16865714#comment-16865714
]
Liang-Chi Hsieh commented on SPARK-28058:
-
[~hyukjin.kwon] Do you mean this is s
[
https://issues.apache.org/jira/browse/SPARK-28058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16865695#comment-16865695
]
Liang-Chi Hsieh commented on SPARK-28058:
-
[~stwhit] Thanks for letting us know
Liang-Chi Hsieh created SPARK-28082:
---
Summary: Add a note to DROPMALFORMED mode of CSV for column pruning
Key: SPARK-28082
URL: https://issues.apache.org/jira/browse/SPARK-28082
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-28058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16865664#comment-16865664
]
Liang-Chi Hsieh commented on SPARK-28058:
-
Although this isn't a bug, I think it
[
https://issues.apache.org/jira/browse/SPARK-28058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16865650#comment-16865650
]
Liang-Chi Hsieh commented on SPARK-28058:
-
This is due to CSV parser column prun
[
https://issues.apache.org/jira/browse/SPARK-28054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16865006#comment-16865006
]
Liang-Chi Hsieh commented on SPARK-28054:
-
I tested on Hive, the query works. Bt
[
https://issues.apache.org/jira/browse/SPARK-28054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16864189#comment-16864189
]
Liang-Chi Hsieh commented on SPARK-28054:
-
Is this query working on Hive?
> Una
[
https://issues.apache.org/jira/browse/SPARK-28043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16864107#comment-16864107
]
Liang-Chi Hsieh commented on SPARK-28043:
-
To make duplicate JSON keys work, I t
[
https://issues.apache.org/jira/browse/SPARK-28043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16863680#comment-16863680
]
Liang-Chi Hsieh commented on SPARK-28043:
-
I tried to look around that, like
ht
[
https://issues.apache.org/jira/browse/SPARK-28006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16863180#comment-16863180
]
Liang-Chi Hsieh commented on SPARK-28006:
-
I'm curious about two questions:
Can
[
https://issues.apache.org/jira/browse/SPARK-27966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16863030#comment-16863030
]
Liang-Chi Hsieh commented on SPARK-27966:
-
I can't see where input_file_name is,
1 - 100 of 1415 matches
Mail list logo
