Liang-Chi Hsieh created SPARK-28031:
---
Summary: Improve or remove doctest on over function of Column
Key: SPARK-28031
URL: https://issues.apache.org/jira/browse/SPARK-28031
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-28009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16862180#comment-16862180
]
Liang-Chi Hsieh commented on SPARK-28009:
-
I think this looks like duplicate to SPARK-27666.
>
[
https://issues.apache.org/jira/browse/SPARK-27984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Liang-Chi Hsieh updated SPARK-27984:
Description:
I noticed the failures on Jenkins job {{spark-master-package}}:
Liang-Chi Hsieh created SPARK-27984:
---
Summary: Jenkins job spark-master-package fails due to invalid gpg
option
Key: SPARK-27984
URL: https://issues.apache.org/jira/browse/SPARK-27984
Project:
[
https://issues.apache.org/jira/browse/SPARK-27966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16859451#comment-16859451
]
Liang-Chi Hsieh commented on SPARK-27966:
-
Can you show the output of explaining the query?
>
[
https://issues.apache.org/jira/browse/SPARK-27913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16859450#comment-16859450
]
Liang-Chi Hsieh commented on SPARK-27913:
-
But seems the above reproducible example also doesn't
[
https://issues.apache.org/jira/browse/SPARK-27798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16856362#comment-16856362
]
Liang-Chi Hsieh commented on SPARK-27798:
-
Is anyone working one this? If none, I will probably
[
https://issues.apache.org/jira/browse/SPARK-27873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16851952#comment-16851952
]
Liang-Chi Hsieh commented on SPARK-27873:
-
I can prepare a PR if Marcin or Hyukjin Kwon don't
[
https://issues.apache.org/jira/browse/SPARK-27873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16851948#comment-16851948
]
Liang-Chi Hsieh commented on SPARK-27873:
-
I guess what Marcin meant is:
{code}
val schema =
[
https://issues.apache.org/jira/browse/SPARK-27832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Liang-Chi Hsieh resolved SPARK-27832.
-
Resolution: Won't Fix
> Don't decompress and create column batch when the task is
[
https://issues.apache.org/jira/browse/SPARK-27837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16849871#comment-16849871
]
Liang-Chi Hsieh commented on SPARK-27837:
-
Btw, I think this is not a bug but like an
[
https://issues.apache.org/jira/browse/SPARK-27837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16849836#comment-16849836
]
Liang-Chi Hsieh commented on SPARK-27837:
-
Ah, I see. MySQL disallows nonconstant argument in
[
https://issues.apache.org/jira/browse/SPARK-27855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16849016#comment-16849016
]
Liang-Chi Hsieh commented on SPARK-27855:
-
If you notice, the printed schema of two Datasets is
[
https://issues.apache.org/jira/browse/SPARK-27837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16848752#comment-16848752
]
Liang-Chi Hsieh commented on SPARK-27837:
-
I don't see it makes sense. I checked few DBs, and
[
https://issues.apache.org/jira/browse/SPARK-27837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16848125#comment-16848125
]
Liang-Chi Hsieh commented on SPARK-27837:
-
Please see the analysis exception: Input argument to
[
https://issues.apache.org/jira/browse/SPARK-27836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16848124#comment-16848124
]
Liang-Chi Hsieh commented on SPARK-27836:
-
rand function initializes only once with given seed
[
https://issues.apache.org/jira/browse/SPARK-27837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16848123#comment-16848123
]
Liang-Chi Hsieh commented on SPARK-27837:
-
The problem isn't that val1 isn't an int, but it
Liang-Chi Hsieh created SPARK-27832:
---
Summary: Don't decompress and create column batch when the task is
completed
Key: SPARK-27832
URL: https://issues.apache.org/jira/browse/SPARK-27832
Project:
[
https://issues.apache.org/jira/browse/SPARK-27779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Liang-Chi Hsieh updated SPARK-27779:
Description:
When I ran MiscBenchmark for SPARK-27707, I found a regression regarding
[
https://issues.apache.org/jira/browse/SPARK-21484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Liang-Chi Hsieh resolved SPARK-21484.
-
Resolution: Won't Fix
> Wrong query plans of Dataset after persist/unpersist
>
[
https://issues.apache.org/jira/browse/SPARK-21484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16844487#comment-16844487
]
Liang-Chi Hsieh commented on SPARK-21484:
-
I think this issue isn't going to be fixed, at least,
[
https://issues.apache.org/jira/browse/SPARK-27779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Liang-Chi Hsieh updated SPARK-27779:
Description:
When I ran MiscBenchmark for SPARK-27707, I found a regression regarding
[
https://issues.apache.org/jira/browse/SPARK-27779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Liang-Chi Hsieh updated SPARK-27779:
Description:
When I ran MiscBenchmark for SPARK-27707, I found a regression regarding
Liang-Chi Hsieh created SPARK-27779:
---
Summary: Regression when explode on map in Generate
Key: SPARK-27779
URL: https://issues.apache.org/jira/browse/SPARK-27779
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-27716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16843649#comment-16843649
]
Liang-Chi Hsieh commented on SPARK-27716:
-
If the added support doesn't cover all cases, doesn't
[
https://issues.apache.org/jira/browse/SPARK-27714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16840220#comment-16840220
]
Liang-Chi Hsieh commented on SPARK-27714:
-
In case how many joined tables there are, the
[
https://issues.apache.org/jira/browse/SPARK-27722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16840197#comment-16840197
]
Liang-Chi Hsieh commented on SPARK-27722:
-
cc [~cloud_fan] Can it be removed? Or I miss
Liang-Chi Hsieh created SPARK-27722:
---
Summary: Remove UnsafeKeyValueSorter
Key: SPARK-27722
URL: https://issues.apache.org/jira/browse/SPARK-27722
Project: Spark
Issue Type: Improvement
Liang-Chi Hsieh created SPARK-27701:
---
Summary: Extend NestedColumnAliasing to more nested field cases
Key: SPARK-27701
URL: https://issues.apache.org/jira/browse/SPARK-27701
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-27671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839070#comment-16839070
]
Liang-Chi Hsieh commented on SPARK-27671:
-
[~dongjoon] Thanks for test and updating `Affects
Liang-Chi Hsieh created SPARK-27671:
---
Summary: Analysis exception thrown when casting from a nested null
in a struct
Key: SPARK-27671
URL: https://issues.apache.org/jira/browse/SPARK-27671
Project:
Liang-Chi Hsieh created SPARK-27633:
---
Summary: Remove redundant aliases in NestedColumnAliasing
Key: SPARK-27633
URL: https://issues.apache.org/jira/browse/SPARK-27633
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-27629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Liang-Chi Hsieh updated SPARK-27629:
Description:
In SPARK-27612, one correctness issue was reported. When protocol 4 is used
[
https://issues.apache.org/jira/browse/SPARK-27629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Liang-Chi Hsieh updated SPARK-27629:
Description:
In SPARK-27612, one correctness issue was reported. When protocol 4 is used
[
https://issues.apache.org/jira/browse/SPARK-27629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Liang-Chi Hsieh updated SPARK-27629:
Component/s: (was: SQL)
> Prevent Unpickler from intervening each unpickling
>
Liang-Chi Hsieh created SPARK-27629:
---
Summary: Prevent Unpickler from intervening each unpickling
Key: SPARK-27629
URL: https://issues.apache.org/jira/browse/SPARK-27629
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-27612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16831680#comment-16831680
]
Liang-Chi Hsieh commented on SPARK-27612:
-
yeah, seems the issue is happened when python object
[
https://issues.apache.org/jira/browse/SPARK-27612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16831600#comment-16831600
]
Liang-Chi Hsieh commented on SPARK-27612:
-
Yup, I can reproduce it too. No worry [~bryanc]. :)
[
https://issues.apache.org/jira/browse/SPARK-27597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16830911#comment-16830911
]
Liang-Chi Hsieh commented on SPARK-27597:
-
I see. Please follow [~hyukjin.kwon]'s suggestion if
[
https://issues.apache.org/jira/browse/SPARK-27597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16830179#comment-16830179
]
Liang-Chi Hsieh commented on SPARK-27597:
-
Do you want to access {{SparkSession}} in UDF?
[
https://issues.apache.org/jira/browse/SPARK-27595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16830165#comment-16830165
]
Liang-Chi Hsieh commented on SPARK-27595:
-
Is turning off
[
https://issues.apache.org/jira/browse/SPARK-27594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16830160#comment-16830160
]
Liang-Chi Hsieh commented on SPARK-27594:
-
I can't reproduce it. Is it possibly specific to your
[
https://issues.apache.org/jira/browse/SPARK-27591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16829370#comment-16829370
]
Liang-Chi Hsieh commented on SPARK-27591:
-
oh, you're right. I've misread the description. Want
[
https://issues.apache.org/jira/browse/SPARK-27591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16829336#comment-16829336
]
Liang-Chi Hsieh commented on SPARK-27591:
-
Are you returning string in {{serialize}} in your
[
https://issues.apache.org/jira/browse/SPARK-27567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16826831#comment-16826831
]
Liang-Chi Hsieh commented on SPARK-27567:
-
Sounds like a kafka problem, instead of Spark:
[
https://issues.apache.org/jira/browse/SPARK-27439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16826551#comment-16826551
]
Liang-Chi Hsieh commented on SPARK-27439:
-
I will look into it. Thanks [~huonw]
> Use analyzed
[
https://issues.apache.org/jira/browse/SPARK-27367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16823178#comment-16823178
]
Liang-Chi Hsieh commented on SPARK-27367:
-
So I think the new serde API has performance
[
https://issues.apache.org/jira/browse/SPARK-27367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16822724#comment-16822724
]
Liang-Chi Hsieh commented on SPARK-27367:
-
I changed spark code to use the new API when
[
https://issues.apache.org/jira/browse/SPARK-27439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16821977#comment-16821977
]
Liang-Chi Hsieh commented on SPARK-27439:
-
One possible issue I'm aware of is, {{df.explain}}
[
https://issues.apache.org/jira/browse/SPARK-27439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16821824#comment-16821824
]
Liang-Chi Hsieh edited comment on SPARK-27439 at 4/19/19 10:36 AM:
---
[
https://issues.apache.org/jira/browse/SPARK-27439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16821824#comment-16821824
]
Liang-Chi Hsieh edited comment on SPARK-27439 at 4/19/19 10:35 AM:
---
[
https://issues.apache.org/jira/browse/SPARK-27439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16821824#comment-16821824
]
Liang-Chi Hsieh edited comment on SPARK-27439 at 4/19/19 10:28 AM:
---
[
https://issues.apache.org/jira/browse/SPARK-27439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16821824#comment-16821824
]
Liang-Chi Hsieh commented on SPARK-27439:
-
The review is resolved during analysis stage when we
[
https://issues.apache.org/jira/browse/SPARK-27429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16821763#comment-16821763
]
Liang-Chi Hsieh commented on SPARK-27429:
-
Generally I think you can always know which are the
[
https://issues.apache.org/jira/browse/SPARK-27367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16821653#comment-16821653
]
Liang-Chi Hsieh edited comment on SPARK-27367 at 4/19/19 8:01 AM:
--
I do
[
https://issues.apache.org/jira/browse/SPARK-27367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16821653#comment-16821653
]
Liang-Chi Hsieh edited comment on SPARK-27367 at 4/19/19 4:32 AM:
--
I do
[
https://issues.apache.org/jira/browse/SPARK-27367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16821653#comment-16821653
]
Liang-Chi Hsieh commented on SPARK-27367:
-
I do upgrade it in local. But seems the performance
Liang-Chi Hsieh created SPARK-27502:
---
Summary: Update nested schema benchmark result for Orc V2
Key: SPARK-27502
URL: https://issues.apache.org/jira/browse/SPARK-27502
Project: Spark
Issue
Liang-Chi Hsieh created SPARK-27476:
---
Summary: Refactoring SchemaPruning rule to remove duplicate code
Key: SPARK-27476
URL: https://issues.apache.org/jira/browse/SPARK-27476
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-27332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16809720#comment-16809720
]
Liang-Chi Hsieh commented on SPARK-27332:
-
I think this should be already fixed by SPARK-25482.
[
https://issues.apache.org/jira/browse/SPARK-27385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16809706#comment-16809706
]
Liang-Chi Hsieh edited comment on SPARK-27385 at 4/4/19 10:39 AM:
--
I
[
https://issues.apache.org/jira/browse/SPARK-27385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16809706#comment-16809706
]
Liang-Chi Hsieh commented on SPARK-27385:
-
I don't really see
[
https://issues.apache.org/jira/browse/SPARK-27375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16809704#comment-16809704
]
Liang-Chi Hsieh commented on SPARK-27375:
-
This is the physical plan when using current master
[
https://issues.apache.org/jira/browse/SPARK-27329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Liang-Chi Hsieh updated SPARK-27329:
Issue Type: Sub-task (was: Improvement)
Parent: SPARK-25603
> Pruning nested
Liang-Chi Hsieh created SPARK-27329:
---
Summary: Pruning nested field in map of map key and value from
object serializers
Key: SPARK-27329
URL: https://issues.apache.org/jira/browse/SPARK-27329
Liang-Chi Hsieh created SPARK-27288:
---
Summary: Pruning nested field in complex map key from object
serializers
Key: SPARK-27288
URL: https://issues.apache.org/jira/browse/SPARK-27288
Project: Spark
Liang-Chi Hsieh created SPARK-27268:
---
Summary: Add map_keys and map_values support in nested schema
pruning
Key: SPARK-27268
URL: https://issues.apache.org/jira/browse/SPARK-27268
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-27241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Liang-Chi Hsieh updated SPARK-27241:
Summary: Add map_keys and map_values support to SelectedField in nested
schema pruning
[
https://issues.apache.org/jira/browse/SPARK-27241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Liang-Chi Hsieh updated SPARK-27241:
Description: {{SelectedField}} in nested schema pruning doesn't support
map_keys and
Liang-Chi Hsieh created SPARK-27241:
---
Summary: Add map keys support to SelectedField in nested schema
pruning
Key: SPARK-27241
URL: https://issues.apache.org/jira/browse/SPARK-27241
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-27191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16795154#comment-16795154
]
Liang-Chi Hsieh commented on SPARK-27191:
-
Thanks for pining me and giving the answer
Liang-Chi Hsieh created SPARK-27126:
---
Summary: Consolidate Scala and Java type deserializerFor
Key: SPARK-27126
URL: https://issues.apache.org/jira/browse/SPARK-27126
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-27039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16783247#comment-16783247
]
Liang-Chi Hsieh commented on SPARK-27039:
-
Not sure if I miss it, but I don't see avro usage.
Liang-Chi Hsieh created SPARK-27043:
---
Summary: Nested schema pruning benchmark for ORC
Key: SPARK-27043
URL: https://issues.apache.org/jira/browse/SPARK-27043
Project: Spark
Issue Type:
Liang-Chi Hsieh created SPARK-27034:
---
Summary: Nested schema pruning for ORC
Key: SPARK-27034
URL: https://issues.apache.org/jira/browse/SPARK-27034
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-26847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Liang-Chi Hsieh updated SPARK-26847:
Summary: Pruning nested serializers from object serializers: MapType
support (was: Prune
[
https://issues.apache.org/jira/browse/SPARK-26847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16763211#comment-16763211
]
Liang-Chi Hsieh commented on SPARK-26847:
-
I will finish this once SPARK-26837 is merged.
>
Liang-Chi Hsieh created SPARK-26847:
---
Summary: Prune nested serializers from object serializers: MapType
support
Key: SPARK-26847
URL: https://issues.apache.org/jira/browse/SPARK-26847
Project:
Liang-Chi Hsieh created SPARK-26837:
---
Summary: Pruning nested fields from object serializers
Key: SPARK-26837
URL: https://issues.apache.org/jira/browse/SPARK-26837
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-26808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Liang-Chi Hsieh resolved SPARK-26808.
-
Resolution: Won't Fix
> Pruned schema should not change nullability
>
Liang-Chi Hsieh created SPARK-26808:
---
Summary: Pruned schema should not change nullability
Key: SPARK-26808
URL: https://issues.apache.org/jira/browse/SPARK-26808
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-26727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16752822#comment-16752822
]
Liang-Chi Hsieh commented on SPARK-26727:
-
When it asks if a table exists, doesn't it only check
[
https://issues.apache.org/jira/browse/SPARK-26727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16752277#comment-16752277
]
Liang-Chi Hsieh commented on SPARK-26727:
-
I can't reproduce it even continuing running the SQL
Liang-Chi Hsieh created SPARK-26702:
---
Summary: Create a test trait for Parquet and Orc test
Key: SPARK-26702
URL: https://issues.apache.org/jira/browse/SPARK-26702
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-26646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16745685#comment-16745685
]
Liang-Chi Hsieh commented on SPARK-26646:
-
Thanks for pinging me [~hyukjin.kwon]! Sure, let me
Liang-Chi Hsieh created SPARK-26604:
---
Summary: Register channel for stream request
Key: SPARK-26604
URL: https://issues.apache.org/jira/browse/SPARK-26604
Project: Spark
Issue Type:
Liang-Chi Hsieh created SPARK-26559:
---
Summary: ML image can't work with numpy versions prior to 1.9
Key: SPARK-26559
URL: https://issues.apache.org/jira/browse/SPARK-26559
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-26558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16735605#comment-16735605
]
Liang-Chi Hsieh commented on SPARK-26558:
-
This looks like an issue at spark-greenplum connector
[
https://issues.apache.org/jira/browse/SPARK-26534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16735214#comment-16735214
]
Liang-Chi Hsieh commented on SPARK-26534:
-
I think the only difference is using Dataset or RDD.
[
https://issues.apache.org/jira/browse/SPARK-26534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16735130#comment-16735130
]
Liang-Chi Hsieh commented on SPARK-26534:
-
I do a test as below:
{code:java}
object Test {
val
Liang-Chi Hsieh created SPARK-26551:
---
Summary: Selecting one complex field and having is null predicate
on another complex field can cause error
Key: SPARK-26551
URL:
[
https://issues.apache.org/jira/browse/SPARK-26436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16734282#comment-16734282
]
Liang-Chi Hsieh commented on SPARK-26436:
-
Sorry I don't know what you mean "should groupByKey
[
https://issues.apache.org/jira/browse/SPARK-26436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16734178#comment-16734178
]
Liang-Chi Hsieh commented on SPARK-26436:
-
This issue is caused by how you create the row:
[
https://issues.apache.org/jira/browse/SPARK-25591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16732569#comment-16732569
]
Liang-Chi Hsieh commented on SPARK-25591:
-
I can make backport PRs if you need. [~dongjoon]
>
[
https://issues.apache.org/jira/browse/SPARK-25591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16732567#comment-16732567
]
Liang-Chi Hsieh commented on SPARK-25591:
-
This is bug fixing, so I think it makes sense to
Liang-Chi Hsieh created SPARK-26517:
---
Summary: Avoid duplicate test in ParquetSchemaPruningSuite
Key: SPARK-26517
URL: https://issues.apache.org/jira/browse/SPARK-26517
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-26511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16731592#comment-16731592
]
Liang-Chi Hsieh commented on SPARK-26511:
-
The model you provided has a different column order
Liang-Chi Hsieh created SPARK-26435:
---
Summary: Support creating partitioned table using Hive CTAS by
specifying partition column names
Key: SPARK-26435
URL: https://issues.apache.org/jira/browse/SPARK-26435
[
https://issues.apache.org/jira/browse/SPARK-26405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16725691#comment-16725691
]
Liang-Chi Hsieh commented on SPARK-26405:
-
I think the exception message is somehow clear:
[
https://issues.apache.org/jira/browse/SPARK-26408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16725683#comment-16725683
]
Liang-Chi Hsieh commented on SPARK-26408:
-
Looks like an issue at
101 - 200 of 1394 matches
Mail list logo
