[
https://issues.apache.org/jira/browse/SPARK-26939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chenxiao Mao updated SPARK-26939:
-
Description:
Some comments about task schedulers are outdated. They should be fixed.
*
Chenxiao Mao created SPARK-26939:
Summary: Fix some outdated comments about task schedulers
Key: SPARK-26939
URL: https://issues.apache.org/jira/browse/SPARK-26939
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-26813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chenxiao Mao updated SPARK-26813:
-
Description:
The java version here means versions of javac source, javac target, scalac
[
https://issues.apache.org/jira/browse/SPARK-26813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chenxiao Mao updated SPARK-26813:
-
Description:
The java version here means versions of javac source, javac target, scalac
[
https://issues.apache.org/jira/browse/SPARK-26813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chenxiao Mao updated SPARK-26813:
-
Description:
The java version here means versions of javac source, javac target, scalac
Chenxiao Mao created SPARK-26813:
Summary: Consolidate java version across language compilers and
build tools
Key: SPARK-26813
URL: https://issues.apache.org/jira/browse/SPARK-26813
Project: Spark
Chenxiao Mao created SPARK-26799:
Summary: Make ANTLR v4 version consistent between Maven and SBT
Key: SPARK-26799
URL: https://issues.apache.org/jira/browse/SPARK-26799
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-26444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chenxiao Mao updated SPARK-26444:
-
Attachment: failed.png
complete.png
active.png
> Stage color
[
https://issues.apache.org/jira/browse/SPARK-26444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chenxiao Mao updated SPARK-26444:
-
Description:
On job page, in event timeline section, stage color doesn't change according to
Chenxiao Mao created SPARK-26444:
Summary: Stage color doesn't change with it's status
Key: SPARK-26444
URL: https://issues.apache.org/jira/browse/SPARK-26444
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-26440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chenxiao Mao updated SPARK-26440:
-
Summary: Show total CPU time across all tasks on stage pages (was: Display
total CPU time
Chenxiao Mao created SPARK-26440:
Summary: Display total CPU time across all tasks on stage pages
Key: SPARK-26440
URL: https://issues.apache.org/jira/browse/SPARK-26440
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-26279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chenxiao Mao updated SPARK-26279:
-
Summary: Remove unused method in Logging (was: Remove unused methods in
Logging)
> Remove
Chenxiao Mao created SPARK-26279:
Summary: Remove unused methods in Logging
Key: SPARK-26279
URL: https://issues.apache.org/jira/browse/SPARK-26279
Project: Spark
Issue Type: Improvement
Chenxiao Mao created SPARK-26277:
Summary: WholeStageCodegen metrics should be tested with
whole-stage codegen enabled
Key: SPARK-26277
URL: https://issues.apache.org/jira/browse/SPARK-26277
Project:
[
https://issues.apache.org/jira/browse/SPARK-25833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chenxiao Mao updated SPARK-25833:
-
Priority: Minor (was: Major)
> Update migration guide for Hive view compatibility
>
[
https://issues.apache.org/jira/browse/SPARK-25833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chenxiao Mao updated SPARK-25833:
-
Issue Type: Documentation (was: Bug)
> Update migration guide for Hive view compatibility
>
[
https://issues.apache.org/jira/browse/SPARK-25833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chenxiao Mao updated SPARK-25833:
-
Description:
Views without column names created by Hive are not readable by Spark.
A simple
[
https://issues.apache.org/jira/browse/SPARK-25833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chenxiao Mao updated SPARK-25833:
-
Summary: Update migration guide for Hive view compatibility (was: Views
without column names
[
https://issues.apache.org/jira/browse/SPARK-25833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1291#comment-1291
]
Chenxiao Mao commented on SPARK-25833:
--
[~dkbiswal] Thanks for you comments. I think you are right
[
https://issues.apache.org/jira/browse/SPARK-25833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chenxiao Mao updated SPARK-25833:
-
Summary: Views without column names created by Hive are not readable by
Spark (was: Views
Chenxiao Mao created SPARK-25833:
Summary: Views without column names created by Hive is not
readable by Spark
Key: SPARK-25833
URL: https://issues.apache.org/jira/browse/SPARK-25833
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-25797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chenxiao Mao updated SPARK-25797:
-
Description:
We ran into this issue when we update our Spark from 2.1 to 2.3. Below's a
simple
[
https://issues.apache.org/jira/browse/SPARK-25797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chenxiao Mao updated SPARK-25797:
-
Description:
We ran into this issue when we update our Spark from 2.1 to 2.3. Below's a
simple
[
https://issues.apache.org/jira/browse/SPARK-25797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chenxiao Mao updated SPARK-25797:
-
Description:
We ran into this issue when we update our Spark from 2.1 to 2.3. Below's a
simple
[
https://issues.apache.org/jira/browse/SPARK-25797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chenxiao Mao updated SPARK-25797:
-
Description:
We ran into this issue when we update our Spark from 2.1 to 2.3. Below's a
simple
Chenxiao Mao created SPARK-25797:
Summary: Views created via 2.1 cannot be read via 2.2+
Key: SPARK-25797
URL: https://issues.apache.org/jira/browse/SPARK-25797
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-20885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623308#comment-16623308
]
Chenxiao Mao commented on SPARK-20885:
--
[~phalverson] To avoid this issue, you may try this option
[
https://issues.apache.org/jira/browse/SPARK-25489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622325#comment-16622325
]
Chenxiao Mao commented on SPARK-25489:
--
User 'seancxmao' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-25487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622319#comment-16622319
]
Chenxiao Mao commented on SPARK-25487:
--
User 'seancxmao' has created a pull request for this issue:
Chenxiao Mao created SPARK-25490:
Summary: Refactor KryoBenchmark
Key: SPARK-25490
URL: https://issues.apache.org/jira/browse/SPARK-25490
Project: Spark
Issue Type: Sub-task
Chenxiao Mao created SPARK-25489:
Summary: Refactor UDTSerializationBenchmark
Key: SPARK-25489
URL: https://issues.apache.org/jira/browse/SPARK-25489
Project: Spark
Issue Type: Sub-task
Chenxiao Mao created SPARK-25487:
Summary: Refactor PrimitiveArrayBenchmark
Key: SPARK-25487
URL: https://issues.apache.org/jira/browse/SPARK-25487
Project: Spark
Issue Type: Sub-task
Chenxiao Mao created SPARK-25484:
Summary: Refactor ExternalAppendOnlyUnsafeRowArrayBenchmark
Key: SPARK-25484
URL: https://issues.apache.org/jira/browse/SPARK-25484
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-25453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16620058#comment-16620058
]
Chenxiao Mao commented on SPARK-25453:
--
User 'seancxmao' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-25453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16619165#comment-16619165
]
Chenxiao Mao commented on SPARK-25453:
--
I'm working on this. cc [~maropu] [~yumwang]
>
[
https://issues.apache.org/jira/browse/SPARK-25391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chenxiao Mao closed SPARK-25391.
> Make behaviors consistent when converting parquet hive table to parquet data
> source
>
[
https://issues.apache.org/jira/browse/SPARK-25391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chenxiao Mao resolved SPARK-25391.
--
Resolution: Won't Do
> Make behaviors consistent when converting parquet hive table to
Chenxiao Mao created SPARK-25391:
Summary: Make behaviors consistent when converting parquet hive
table to parquet data source
Key: SPARK-25391
URL: https://issues.apache.org/jira/browse/SPARK-25391
[
https://issues.apache.org/jira/browse/SPARK-25175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chenxiao Mao updated SPARK-25175:
-
Summary: Field resolution should fail if there's ambiguity for ORC native
reader (was: Field
[
https://issues.apache.org/jira/browse/SPARK-25175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16595240#comment-16595240
]
Chenxiao Mao commented on SPARK-25175:
--
[~cloud_fan] Does it make sense?
> Field resolution should
[
https://issues.apache.org/jira/browse/SPARK-25175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chenxiao Mao updated SPARK-25175:
-
Summary: Field resolution should fail if there is ambiguity for ORC data
source native
[
https://issues.apache.org/jira/browse/SPARK-25175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16595225#comment-16595225
]
Chenxiao Mao commented on SPARK-25175:
--
After a deep dive into ORC file read paths (data source
[
https://issues.apache.org/jira/browse/SPARK-25175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chenxiao Mao updated SPARK-25175:
-
Summary: Field resolution should fail if there is ambiguity in
case-insensitive mode when
[
https://issues.apache.org/jira/browse/SPARK-25175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16593194#comment-16593194
]
Chenxiao Mao edited comment on SPARK-25175 at 8/28/18 4:00 PM:
---
[
https://issues.apache.org/jira/browse/SPARK-25175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chenxiao Mao updated SPARK-25175:
-
Description:
SPARK-25132 adds support for case-insensitive field resolution when reading
from
[
https://issues.apache.org/jira/browse/SPARK-25175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16593185#comment-16593185
]
Chenxiao Mao edited comment on SPARK-25175 at 8/28/18 3:27 PM:
---
[
https://issues.apache.org/jira/browse/SPARK-25175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16593194#comment-16593194
]
Chenxiao Mao edited comment on SPARK-25175 at 8/28/18 3:22 PM:
---
[
https://issues.apache.org/jira/browse/SPARK-25175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16593200#comment-16593200
]
Chenxiao Mao edited comment on SPARK-25175 at 8/27/18 3:53 PM:
---
Also here
[
https://issues.apache.org/jira/browse/SPARK-25175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chenxiao Mao updated SPARK-25175:
-
Description:
SPARK-25132 adds support for case-insensitive field resolution when reading
from
[
https://issues.apache.org/jira/browse/SPARK-25175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16593194#comment-16593194
]
Chenxiao Mao edited comment on SPARK-25175 at 8/27/18 7:50 AM:
---
[
https://issues.apache.org/jira/browse/SPARK-25175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16593185#comment-16593185
]
Chenxiao Mao edited comment on SPARK-25175 at 8/27/18 7:33 AM:
---
Thorough
[
https://issues.apache.org/jira/browse/SPARK-25175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16593185#comment-16593185
]
Chenxiao Mao edited comment on SPARK-25175 at 8/27/18 7:24 AM:
---
Thorough
[
https://issues.apache.org/jira/browse/SPARK-25175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chenxiao Mao updated SPARK-25175:
-
Description:
SPARK-25132 adds support for case-insensitive field resolution when reading
from
[
https://issues.apache.org/jira/browse/SPARK-25175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chenxiao Mao updated SPARK-25175:
-
Description:
SPARK-25132 adds support for case-insensitive field resolution when reading
from
[
https://issues.apache.org/jira/browse/SPARK-25175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16593194#comment-16593194
]
Chenxiao Mao edited comment on SPARK-25175 at 8/27/18 6:56 AM:
---
[
https://issues.apache.org/jira/browse/SPARK-25175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16593185#comment-16593185
]
Chenxiao Mao edited comment on SPARK-25175 at 8/27/18 6:45 AM:
---
Thorough
[
https://issues.apache.org/jira/browse/SPARK-25175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16593200#comment-16593200
]
Chenxiao Mao commented on SPARK-25175:
--
Also here is the similar investigation I did for parquet
[
https://issues.apache.org/jira/browse/SPARK-25175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chenxiao Mao reopened SPARK-25175:
--
> Case-insensitive field resolution when reading from ORC
>
[
https://issues.apache.org/jira/browse/SPARK-25175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16593194#comment-16593194
]
Chenxiao Mao commented on SPARK-25175:
--
[~dongjoon] [~yucai] Here is a brief summary. We can see
[
https://issues.apache.org/jira/browse/SPARK-25175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16593185#comment-16593185
]
Chenxiao Mao commented on SPARK-25175:
--
Thorough investigation about ORC tables
{code}
val data =
[
https://issues.apache.org/jira/browse/SPARK-25175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16587206#comment-16587206
]
Chenxiao Mao commented on SPARK-25175:
--
This is followup of SPARK-25132. I'm working on this.
>
Chenxiao Mao created SPARK-25175:
Summary: Case-insensitive field resolution when reading from ORC
Key: SPARK-25175
URL: https://issues.apache.org/jira/browse/SPARK-25175
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-25132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chenxiao Mao updated SPARK-25132:
-
Summary: Case-insensitive field resolution when reading from Parquet/ORC
(was: Spark returns
[
https://issues.apache.org/jira/browse/SPARK-25132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16583305#comment-16583305
]
Chenxiao Mao commented on SPARK-25132:
--
I'm working on this.
> Spark returns NULL for a column
[
https://issues.apache.org/jira/browse/SPARK-25132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16582606#comment-16582606
]
Chenxiao Mao commented on SPARK-25132:
--
We found this PR
Chenxiao Mao created SPARK-25132:
Summary: Spark returns NULL for a column whose Hive metastore
schema and Parquet schema are in different letter cases
Key: SPARK-25132
URL:
67 matches
Mail list logo
