[
https://issues.apache.org/jira/browse/SPARK-33502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17236434#comment-17236434
]
Arwin S Tio edited comment on SPARK-33502 at 11/10/21, 7:22 PM:
Note,
[
https://issues.apache.org/jira/browse/SPARK-33502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arwin S Tio updated SPARK-33502:
Description:
On Spark 2.4.7 Standalone Mode on my laptop (Macbook Pro 2015), I ran the
[
https://issues.apache.org/jira/browse/SPARK-33502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17236434#comment-17236434
]
Arwin S Tio commented on SPARK-33502:
-
Note, running my program with "-Xss3072k" fixed it
> Large
[
https://issues.apache.org/jira/browse/SPARK-33502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arwin S Tio updated SPARK-33502:
Description:
On Spark 2.4.7 Standalone Mode on my laptop (Macbook Pro 2015), I ran the
[
https://issues.apache.org/jira/browse/SPARK-33502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arwin S Tio updated SPARK-33502:
Description:
On Spark 2.4.7 Standalone Mode on my laptop (Macbook Pro 2015), I ran the
[
https://issues.apache.org/jira/browse/SPARK-33502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arwin S Tio updated SPARK-33502:
Description:
On Spark 2.4.7 Standalone Mode on my laptop (Macbook Pro 2015), I ran the
[
https://issues.apache.org/jira/browse/SPARK-33502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arwin S Tio updated SPARK-33502:
Description:
On Spark 2.4.7 Standalone Mode on my laptop (Macbook Pro 2015), I ran the
[
https://issues.apache.org/jira/browse/SPARK-33502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arwin S Tio updated SPARK-33502:
Description:
On Spark 2.4.7 Standalone Mode on my laptop (Macbook Pro 2015), I ran the
Arwin S Tio created SPARK-33502:
---
Summary: Large number of SELECT columns causes StackOverflowError
Key: SPARK-33502
URL: https://issues.apache.org/jira/browse/SPARK-33502
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-29089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arwin S Tio updated SPARK-29089:
Component/s: (was: Spark Core)
SQL
> DataFrameReader bottleneck in
[
https://issues.apache.org/jira/browse/SPARK-29089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arwin S Tio updated SPARK-29089:
Target Version/s: (was: 2.4.5, 3.0.0)
> DataFrameReader bottleneck in
[
https://issues.apache.org/jira/browse/SPARK-29089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arwin S Tio updated SPARK-29089:
Description:
When using DataFrameReader#csv to read many S3 files (in my case 300k), I've
[
https://issues.apache.org/jira/browse/SPARK-29089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arwin S Tio updated SPARK-29089:
Description:
When using DataFrameReader#csv to read many S3 files (in my case 300k), I've
[
https://issues.apache.org/jira/browse/SPARK-29089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arwin S Tio updated SPARK-29089:
Description:
When using DataFrameReader#csv to read many S3 files (in my case 300k), I've
[
https://issues.apache.org/jira/browse/SPARK-29089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arwin S Tio updated SPARK-29089:
Description:
When using DataFrameReader#csv to read many S3 files (in my case 300k), I've
[
https://issues.apache.org/jira/browse/SPARK-29089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arwin S Tio updated SPARK-29089:
Description:
When using DataFrameReader#csv to read many S3 files (in my case 300k), I've
[
https://issues.apache.org/jira/browse/SPARK-29089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arwin S Tio updated SPARK-29089:
Description:
When using DataFrameReader#csv to read many S3 files (in my case 300k), I've
[
https://issues.apache.org/jira/browse/SPARK-29089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arwin S Tio updated SPARK-29089:
Description:
When using DataFrameReader#csv to read many S3 files (in my case 300k), I've
[
https://issues.apache.org/jira/browse/SPARK-29089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arwin S Tio updated SPARK-29089:
Description:
When using DataFrameReader#csv to read many S3 files (in my case 300k), I've
[
https://issues.apache.org/jira/browse/SPARK-29089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arwin S Tio updated SPARK-29089:
Description:
When using DataFrameReader#csv to read many S3 files (in my case 300k), I've
[
https://issues.apache.org/jira/browse/SPARK-29089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arwin S Tio updated SPARK-29089:
Description:
When using DataFrameReader#csv to read many S3 files (in my case 300k), I've
[
https://issues.apache.org/jira/browse/SPARK-29089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arwin S Tio updated SPARK-29089:
Description:
When using DataFrameReader#csv to read many S3 files (in my case 300k), I've
[
https://issues.apache.org/jira/browse/SPARK-29089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arwin S Tio updated SPARK-29089:
Description:
When using DataFrameReader#csv to read many S3 files (in my case 300k), I've
[
https://issues.apache.org/jira/browse/SPARK-29089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arwin S Tio updated SPARK-29089:
Description:
When using DataFrameReader#csv to read many S3 files (in my case 300k), I've
[
https://issues.apache.org/jira/browse/SPARK-29089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arwin S Tio updated SPARK-29089:
Description:
When using DataFrameReader#csv to read many S3 files (in my case 300k), I've
[
https://issues.apache.org/jira/browse/SPARK-29089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arwin S Tio updated SPARK-29089:
Description:
When using DataFrameReader#csv to read many S3 files (in my case 300k), I've
[
https://issues.apache.org/jira/browse/SPARK-29089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arwin S Tio updated SPARK-29089:
Description:
When using DataFrameReader#csv to read many S3 files (in my case 300k), I've
Arwin S Tio created SPARK-29089:
---
Summary: DataFrameReader bottleneck in
DataSource#checkAndGlobPathIfNecessary when reading large amount of S3 files
Key: SPARK-29089
URL:
28 matches
Mail list logo