[jira] [Comment Edited] (SPARK-33502) Large number of SELECT columns causes StackOverflowError

2021-11-10 Thread Arwin S Tio (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17236434#comment-17236434 ] Arwin S Tio edited comment on SPARK-33502 at 11/10/21, 7:22 PM: Note,

[jira] [Updated] (SPARK-33502) Large number of SELECT columns causes StackOverflowError

2020-11-20 Thread Arwin S Tio (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arwin S Tio updated SPARK-33502: Description: On Spark 2.4.7 Standalone Mode on my laptop (Macbook Pro 2015), I ran the

[jira] [Commented] (SPARK-33502) Large number of SELECT columns causes StackOverflowError

2020-11-20 Thread Arwin S Tio (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17236434#comment-17236434 ] Arwin S Tio commented on SPARK-33502: - Note, running my program with "-Xss3072k" fixed it > Large

[jira] [Updated] (SPARK-33502) Large number of SELECT columns causes StackOverflowError

2020-11-20 Thread Arwin S Tio (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arwin S Tio updated SPARK-33502: Description: On Spark 2.4.7 Standalone Mode on my laptop (Macbook Pro 2015), I ran the

[jira] [Updated] (SPARK-33502) Large number of SELECT columns causes StackOverflowError

2020-11-20 Thread Arwin S Tio (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arwin S Tio updated SPARK-33502: Description: On Spark 2.4.7 Standalone Mode on my laptop (Macbook Pro 2015), I ran the

[jira] [Updated] (SPARK-33502) Large number of SELECT columns causes StackOverflowError

2020-11-20 Thread Arwin S Tio (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arwin S Tio updated SPARK-33502: Description: On Spark 2.4.7 Standalone Mode on my laptop (Macbook Pro 2015), I ran the

[jira] [Updated] (SPARK-33502) Large number of SELECT columns causes StackOverflowError

2020-11-20 Thread Arwin S Tio (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arwin S Tio updated SPARK-33502: Description: On Spark 2.4.7 Standalone Mode on my laptop (Macbook Pro 2015), I ran the

[jira] [Updated] (SPARK-33502) Large number of SELECT columns causes StackOverflowError

2020-11-20 Thread Arwin S Tio (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arwin S Tio updated SPARK-33502: Description: On Spark 2.4.7 Standalone Mode on my laptop (Macbook Pro 2015), I ran the

[jira] [Created] (SPARK-33502) Large number of SELECT columns causes StackOverflowError

2020-11-20 Thread Arwin S Tio (Jira)
Arwin S Tio created SPARK-33502: --- Summary: Large number of SELECT columns causes StackOverflowError Key: SPARK-33502 URL: https://issues.apache.org/jira/browse/SPARK-33502 Project: Spark Issue

[jira] [Updated] (SPARK-29089) DataFrameReader bottleneck in DataSource#checkAndGlobPathIfNecessary when reading large amount of S3 files

2019-09-16 Thread Arwin S Tio (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arwin S Tio updated SPARK-29089: Component/s: (was: Spark Core) SQL > DataFrameReader bottleneck in

[jira] [Updated] (SPARK-29089) DataFrameReader bottleneck in DataSource#checkAndGlobPathIfNecessary when reading large amount of S3 files

2019-09-15 Thread Arwin S Tio (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arwin S Tio updated SPARK-29089: Target Version/s: (was: 2.4.5, 3.0.0) > DataFrameReader bottleneck in

[jira] [Updated] (SPARK-29089) DataFrameReader bottleneck in DataSource#checkAndGlobPathIfNecessary when reading large amount of S3 files

2019-09-15 Thread Arwin S Tio (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arwin S Tio updated SPARK-29089: Description: When using DataFrameReader#csv to read many S3 files (in my case 300k), I've

[jira] [Updated] (SPARK-29089) DataFrameReader bottleneck in DataSource#checkAndGlobPathIfNecessary when reading large amount of S3 files

2019-09-15 Thread Arwin S Tio (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arwin S Tio updated SPARK-29089: Description: When using DataFrameReader#csv to read many S3 files (in my case 300k), I've

[jira] [Updated] (SPARK-29089) DataFrameReader bottleneck in DataSource#checkAndGlobPathIfNecessary when reading large amount of S3 files

2019-09-15 Thread Arwin S Tio (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arwin S Tio updated SPARK-29089: Description: When using DataFrameReader#csv to read many S3 files (in my case 300k), I've

[jira] [Updated] (SPARK-29089) DataFrameReader bottleneck in DataSource#checkAndGlobPathIfNecessary when reading large amount of S3 files

2019-09-15 Thread Arwin S Tio (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arwin S Tio updated SPARK-29089: Description: When using DataFrameReader#csv to read many S3 files (in my case 300k), I've

[jira] [Updated] (SPARK-29089) DataFrameReader bottleneck in DataSource#checkAndGlobPathIfNecessary when reading large amount of S3 files

2019-09-15 Thread Arwin S Tio (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arwin S Tio updated SPARK-29089: Description: When using DataFrameReader#csv to read many S3 files (in my case 300k), I've

[jira] [Updated] (SPARK-29089) DataFrameReader bottleneck in DataSource#checkAndGlobPathIfNecessary when reading large amount of S3 files

2019-09-15 Thread Arwin S Tio (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arwin S Tio updated SPARK-29089: Description: When using DataFrameReader#csv to read many S3 files (in my case 300k), I've

[jira] [Updated] (SPARK-29089) DataFrameReader bottleneck in DataSource#checkAndGlobPathIfNecessary when reading large amount of S3 files

2019-09-15 Thread Arwin S Tio (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arwin S Tio updated SPARK-29089: Description: When using DataFrameReader#csv to read many S3 files (in my case 300k), I've

[jira] [Updated] (SPARK-29089) DataFrameReader bottleneck in DataSource#checkAndGlobPathIfNecessary when reading large amount of S3 files

2019-09-15 Thread Arwin S Tio (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arwin S Tio updated SPARK-29089: Description: When using DataFrameReader#csv to read many S3 files (in my case 300k), I've

[jira] [Updated] (SPARK-29089) DataFrameReader bottleneck in DataSource#checkAndGlobPathIfNecessary when reading large amount of S3 files

2019-09-15 Thread Arwin S Tio (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arwin S Tio updated SPARK-29089: Description: When using DataFrameReader#csv to read many S3 files (in my case 300k), I've

[jira] [Updated] (SPARK-29089) DataFrameReader bottleneck in DataSource#checkAndGlobPathIfNecessary when reading large amount of S3 files

2019-09-15 Thread Arwin S Tio (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arwin S Tio updated SPARK-29089: Description: When using DataFrameReader#csv to read many S3 files (in my case 300k), I've

[jira] [Updated] (SPARK-29089) DataFrameReader bottleneck in DataSource#checkAndGlobPathIfNecessary when reading large amount of S3 files

2019-09-15 Thread Arwin S Tio (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arwin S Tio updated SPARK-29089: Description: When using DataFrameReader#csv to read many S3 files (in my case 300k), I've

[jira] [Updated] (SPARK-29089) DataFrameReader bottleneck in DataSource#checkAndGlobPathIfNecessary when reading large amount of S3 files

2019-09-15 Thread Arwin S Tio (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arwin S Tio updated SPARK-29089: Description: When using DataFrameReader#csv to read many S3 files (in my case 300k), I've

[jira] [Updated] (SPARK-29089) DataFrameReader bottleneck in DataSource#checkAndGlobPathIfNecessary when reading large amount of S3 files

2019-09-15 Thread Arwin S Tio (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arwin S Tio updated SPARK-29089: Description: When using DataFrameReader#csv to read many S3 files (in my case 300k), I've

[jira] [Updated] (SPARK-29089) DataFrameReader bottleneck in DataSource#checkAndGlobPathIfNecessary when reading large amount of S3 files

2019-09-15 Thread Arwin S Tio (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arwin S Tio updated SPARK-29089: Description: When using DataFrameReader#csv to read many S3 files (in my case 300k), I've

[jira] [Updated] (SPARK-29089) DataFrameReader bottleneck in DataSource#checkAndGlobPathIfNecessary when reading large amount of S3 files

2019-09-15 Thread Arwin S Tio (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arwin S Tio updated SPARK-29089: Description: When using DataFrameReader#csv to read many S3 files (in my case 300k), I've

[jira] [Updated] (SPARK-29089) DataFrameReader bottleneck in DataSource#checkAndGlobPathIfNecessary when reading large amount of S3 files

2019-09-15 Thread Arwin S Tio (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arwin S Tio updated SPARK-29089: Description: When using DataFrameReader#csv to read many S3 files (in my case 300k), I've

[jira] [Created] (SPARK-29089) DataFrameReader bottleneck in DataSource#checkAndGlobPathIfNecessary when reading large amount of S3 files

2019-09-15 Thread Arwin S Tio (Jira)
Arwin S Tio created SPARK-29089: --- Summary: DataFrameReader bottleneck in DataSource#checkAndGlobPathIfNecessary when reading large amount of S3 files Key: SPARK-29089 URL: