[
https://issues.apache.org/jira/browse/SPARK-26847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Liang-Chi Hsieh updated SPARK-26847:
Summary: Pruning nested serializers from object serializers: MapType
support (was: Prune
[
https://issues.apache.org/jira/browse/SPARK-26831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-26831.
--
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 23736
[
https://issues.apache.org/jira/browse/SPARK-26831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-26831:
Assignee: Stefaan Lippens
> bin/pyspark: avoid hardcoded `python` command and improve
[
https://issues.apache.org/jira/browse/SPARK-24657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16763243#comment-16763243
]
Tao Luo commented on SPARK-24657:
-
If SortMergeJoinScanner doesn't consume UnsafeExternalRowSorter
[
https://issues.apache.org/jira/browse/SPARK-24211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takeshi Yamamuro updated SPARK-24211:
-
Affects Version/s: (was: 2.4.0)
2.3.2
> Flaky test:
[
https://issues.apache.org/jira/browse/SPARK-26847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16763211#comment-16763211
]
Liang-Chi Hsieh commented on SPARK-26847:
-
I will finish this once SPARK-26837 is merged.
>
Liang-Chi Hsieh created SPARK-26847:
---
Summary: Prune nested serializers from object serializers: MapType
support
Key: SPARK-26847
URL: https://issues.apache.org/jira/browse/SPARK-26847
Project:
[
https://issues.apache.org/jira/browse/SPARK-26841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16763149#comment-16763149
]
Jungtaek Lim commented on SPARK-26841:
--
[~Bartalos]
Are you working on the patch? Because I'm
[
https://issues.apache.org/jira/browse/SPARK-26846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arvind Krishnan Iyer updated SPARK-26846:
-
Description:
{code:java}
import spark.implicits._
val sc = spark.sparkContext
[
https://issues.apache.org/jira/browse/SPARK-26845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16763094#comment-16763094
]
Attila Zsolt Piros commented on SPARK-26845:
This also works:
{code}
test("roundtrip in
[
https://issues.apache.org/jira/browse/SPARK-26192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Martin Loncaric updated SPARK-26192:
Description:
There are at least two options accessed in MesosClusterScheduler that should
[
https://issues.apache.org/jira/browse/SPARK-26845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16763066#comment-16763066
]
Attila Zsolt Piros commented on SPARK-26845:
The test would work if you replace the line
[
https://issues.apache.org/jira/browse/SPARK-26845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gabor Somogyi updated SPARK-26845:
--
Summary: Avro to_avro from_avro roundtrip fails if data type is string
(was: Avro from_avro
Arvind Krishnan Iyer created SPARK-26846:
Summary: Empty Strings in dataframe are written as "" in CSV
Key: SPARK-26846
URL: https://issues.apache.org/jira/browse/SPARK-26846
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-26845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gabor Somogyi updated SPARK-26845:
--
Labels: correctness (was: )
> Avro from_avro to_avro roundtrip fails if data type is string
[
https://issues.apache.org/jira/browse/SPARK-26845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gabor Somogyi updated SPARK-26845:
--
Description:
I was playing with AvroFunctionsSuite and created a situation where test fails
[
https://issues.apache.org/jira/browse/SPARK-26845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gabor Somogyi updated SPARK-26845:
--
Description:
I was playing with AvroFunctionsSuite and creates a situation where test fails
Gabor Somogyi created SPARK-26845:
-
Summary: Avro from_avro to_avro roundtrip fails if data type is
string
Key: SPARK-26845
URL: https://issues.apache.org/jira/browse/SPARK-26845
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-10892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16763001#comment-16763001
]
Jash Gala commented on SPARK-10892:
---
This issue is still reproducible in Spark 2.4.0.
> Join with
[
https://issues.apache.org/jira/browse/SPARK-26842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun closed SPARK-26842.
-
> java.lang.IllegalArgumentException: Unsupported class file major version 55
>
[
https://issues.apache.org/jira/browse/SPARK-26844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16762993#comment-16762993
]
Dongjoon Hyun commented on SPARK-26844:
---
Hi, [~tenstriker].
Please report with a reproducible
[
https://issues.apache.org/jira/browse/SPARK-26844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-26844:
--
Priority: Minor (was: Major)
> Parquet Reader exception - ArrayIndexOutOfBound should give
[
https://issues.apache.org/jira/browse/SPARK-26164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16762991#comment-16762991
]
Thincrs commented on SPARK-26164:
-
A user of thincrs has selected this issue. Deadline: Thu, Feb 14,
[
https://issues.apache.org/jira/browse/SPARK-21755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin resolved SPARK-21755.
Resolution: Not A Bug
I'm closing this for a few reasons.
- There's been a lot of
[
https://issues.apache.org/jira/browse/SPARK-19528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin resolved SPARK-19528.
Resolution: Duplicate
I believe this is the same issue as SPARK-24355. There's a new
[
https://issues.apache.org/jira/browse/SPARK-26707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-26707:
Assignee: (was: Apache Spark)
> Insert into table with single struct column fails
>
[
https://issues.apache.org/jira/browse/SPARK-26707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-26707:
Assignee: Apache Spark
> Insert into table with single struct column fails
>
[
https://issues.apache.org/jira/browse/SPARK-23974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin resolved SPARK-23974.
Resolution: Not A Problem
Closing based on the above comment.
> Do not allocate more
[
https://issues.apache.org/jira/browse/SPARK-21097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-21097:
Assignee: Apache Spark
> Dynamic allocation will preserve cached data
>
[
https://issues.apache.org/jira/browse/SPARK-16158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin reassigned SPARK-16158:
--
Assignee: Marcelo Vanzin
> Support pluggable dynamic allocation heuristics
>
[
https://issues.apache.org/jira/browse/SPARK-21097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-21097:
Assignee: (was: Apache Spark)
> Dynamic allocation will preserve cached data
>
[
https://issues.apache.org/jira/browse/SPARK-16158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin reassigned SPARK-16158:
--
Assignee: (was: Marcelo Vanzin)
> Support pluggable dynamic allocation
[
https://issues.apache.org/jira/browse/SPARK-26264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16762931#comment-16762931
]
Thincrs commented on SPARK-26264:
-
A user of thincrs has selected this issue. Deadline: Thu, Feb 14,
[
https://issues.apache.org/jira/browse/SPARK-21097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin reassigned SPARK-21097:
--
Assignee: (was: Marcelo Vanzin)
> Dynamic allocation will preserve cached data
>
[
https://issues.apache.org/jira/browse/SPARK-21097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin reassigned SPARK-21097:
--
Assignee: Marcelo Vanzin
> Dynamic allocation will preserve cached data
>
[
https://issues.apache.org/jira/browse/SPARK-26817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16762926#comment-16762926
]
Thincrs commented on SPARK-26817:
-
A user of thincrs has selected this issue. Deadline: Thu, Feb 14,
[
https://issues.apache.org/jira/browse/SPARK-26266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16762918#comment-16762918
]
Thincrs commented on SPARK-26266:
-
A user of thincrs has selected this issue. Deadline: Thu, Feb 14,
[
https://issues.apache.org/jira/browse/SPARK-26822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16762910#comment-16762910
]
Thincrs commented on SPARK-26822:
-
A user of thincrs has selected this issue. Deadline: Thu, Feb 14,
[
https://issues.apache.org/jira/browse/SPARK-26842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin resolved SPARK-26842.
Resolution: Invalid
Java 11 is not supported in 2.4.
>
[
https://issues.apache.org/jira/browse/SPARK-2387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Imran Rashid updated SPARK-2387:
Component/s: Scheduler
> Remove the stage barrier for better resource utilization
>
[
https://issues.apache.org/jira/browse/SPARK-26842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16762749#comment-16762749
]
Gabor Somogyi commented on SPARK-26842:
---
Please see the response provided by [~kabhwan] and me on
[
https://issues.apache.org/jira/browse/SPARK-23685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16762756#comment-16762756
]
Gabor Somogyi commented on SPARK-23685:
---
[~sindiri] gentle ping.
> Spark Structured Streaming
[
https://issues.apache.org/jira/browse/SPARK-26842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16762754#comment-16762754
]
Gabor Somogyi commented on SPARK-26842:
---
Have you tried it out [~ranjit_hande]?
>
[
https://issues.apache.org/jira/browse/SPARK-26842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16762753#comment-16762753
]
Gabor Somogyi commented on SPARK-26842:
---
{quote}so you may need to use lower version of JDK (8
nirav patel created SPARK-26844:
---
Summary: Parquet Reader exception - ArrayIndexOutOfBound should
give more information to user
Key: SPARK-26844
URL: https://issues.apache.org/jira/browse/SPARK-26844
[
https://issues.apache.org/jira/browse/SPARK-26843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-26843:
Assignee: (was: Apache Spark)
> Use ConfigEntry for hardcoded configs for "mesos"
[
https://issues.apache.org/jira/browse/SPARK-26843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-26843:
Assignee: Apache Spark
> Use ConfigEntry for hardcoded configs for "mesos" resource
Jungtaek Lim created SPARK-26843:
Summary: Use ConfigEntry for hardcoded configs for "mesos"
resource manager
Key: SPARK-26843
URL: https://issues.apache.org/jira/browse/SPARK-26843
Project: Spark
Ranjit Hande created SPARK-26842:
Summary: java.lang.IllegalArgumentException: Unsupported class
file major version 55
Key: SPARK-26842
URL: https://issues.apache.org/jira/browse/SPARK-26842
[
https://issues.apache.org/jira/browse/SPARK-26841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tomas updated SPARK-26841:
--
Description:
As a Spark user I'd like to have fast queries on Kafka table restricted by
timestamp.
I'd like
Tomas created SPARK-26841:
-
Summary: Timestamp pushdown on Kafka table
Key: SPARK-26841
URL: https://issues.apache.org/jira/browse/SPARK-26841
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-26841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tomas updated SPARK-26841:
--
Affects Version/s: (was: 2.5.0)
2.4.0
> Timestamp pushdown on Kafka table
>
[
https://issues.apache.org/jira/browse/SPARK-26835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16762584#comment-16762584
]
Peter Horvath edited comment on SPARK-26835 at 2/7/19 11:33 AM:
This
[
https://issues.apache.org/jira/browse/SPARK-26835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-26835:
Assignee: Apache Spark
> Document configuration properties of Spark SQL Generic
[
https://issues.apache.org/jira/browse/SPARK-26835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16762584#comment-16762584
]
Peter Horvath commented on SPARK-26835:
---
This might be trivial / self-explanatory if you have been
[
https://issues.apache.org/jira/browse/SPARK-26835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-26835:
Assignee: (was: Apache Spark)
> Document configuration properties of Spark SQL
[
https://issues.apache.org/jira/browse/SPARK-26082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16762552#comment-16762552
]
Dongjoon Hyun commented on SPARK-26082:
---
Although this is not a blocker, cc [~maropu].
>
[
https://issues.apache.org/jira/browse/SPARK-26082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16762511#comment-16762511
]
Dongjoon Hyun commented on SPARK-26082:
---
Thank you, [~mwlon]. You are added to Apache Spark
[
https://issues.apache.org/jira/browse/SPARK-26082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-26082:
-
Assignee: Martin Loncaric
> Misnaming of spark.mesos.fetch(er)Cache.enable in
[
https://issues.apache.org/jira/browse/SPARK-26082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-26082.
---
Resolution: Fixed
Fix Version/s: 3.0.0
2.4.1
[
https://issues.apache.org/jira/browse/SPARK-26082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16762499#comment-16762499
]
Dongjoon Hyun edited comment on SPARK-26082 at 2/7/19 9:17 AM:
---
Since this
[
https://issues.apache.org/jira/browse/SPARK-26082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16762499#comment-16762499
]
Dongjoon Hyun commented on SPARK-26082:
---
Since this bug is introduced by SPARK-15994 which is
[
https://issues.apache.org/jira/browse/SPARK-26082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-26082:
--
Affects Version/s: (was: 2.0.2)
(was: 2.0.1)
[
https://issues.apache.org/jira/browse/SPARK-26082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16762496#comment-16762496
]
Apache Spark commented on SPARK-26082:
--
User 'mwlon' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-26082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-26082:
Assignee: (was: Apache Spark)
> Misnaming of spark.mesos.fetch(er)Cache.enable in
[
https://issues.apache.org/jira/browse/SPARK-26082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-26082:
Assignee: Apache Spark
> Misnaming of spark.mesos.fetch(er)Cache.enable in
[
https://issues.apache.org/jira/browse/SPARK-26826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Petar Zecevic resolved SPARK-26826.
---
Resolution: Won't Fix
> Array indexing functions array_allpositions and array_select
>
67 matches
Mail list logo
