[jira] [Updated] (SPARK-21465) array('L') support might lead to overflow error

2017-07-18 Thread Xiang Gao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiang Gao updated SPARK-21465: -- Description: For now, the behavior of different types of {{array.array}} support in pyspark is not

[jira] [Created] (SPARK-21465) array('L') support might lead to overflow error

2017-07-18 Thread Xiang Gao (JIRA)
Xiang Gao created SPARK-21465: - Summary: array('L') support might lead to overflow error Key: SPARK-21465 URL: https://issues.apache.org/jira/browse/SPARK-21465 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-21420) Support array type code 'q' and 'Q'

2017-07-18 Thread Xiang Gao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiang Gao updated SPARK-21420: -- Description: Python's array type {{q}} and {{Q}} are currently not supported by

[jira] [Updated] (SPARK-21420) Support array type code 'q' and 'Q'

2017-07-18 Thread Xiang Gao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiang Gao updated SPARK-21420: -- Description: Python's array type {{q}} and {{Q}} are currently not supported by

[jira] [Created] (SPARK-21420) Support array type code 'q' and 'Q'

2017-07-14 Thread Xiang Gao (JIRA)
Xiang Gao created SPARK-21420: - Summary: Support array type code 'q' and 'Q' Key: SPARK-21420 URL: https://issues.apache.org/jira/browse/SPARK-21420 Project: Spark Issue Type: Improvement

[jira] [Comment Edited] (SPARK-17185) Unify naming of API for RDD and Dataset

2016-08-22 Thread Xiang Gao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15430897#comment-15430897 ] Xiang Gao edited comment on SPARK-17185 at 8/22/16 2:59 PM: Changing API is a

[jira] [Updated] (SPARK-17185) Unify naming of API for RDD and Dataset

2016-08-22 Thread Xiang Gao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiang Gao updated SPARK-17185: -- Description: In {{RDD}}, {{groupByKey}} is used to generate a key-list pair and {{aggregateByKey}}

[jira] [Commented] (SPARK-17185) Unify naming of API for RDD and Dataset

2016-08-22 Thread Xiang Gao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15430897#comment-15430897 ] Xiang Gao commented on SPARK-17185: --- Changing API is a bad idea and we should not do this. Maybe these

[jira] [Created] (SPARK-17185) Unify naming of API for RDD and Dataset

2016-08-22 Thread Xiang Gao (JIRA)
Xiang Gao created SPARK-17185: - Summary: Unify naming of API for RDD and Dataset Key: SPARK-17185 URL: https://issues.apache.org/jira/browse/SPARK-17185 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-16586) spark-class crash with "[: too many arguments" instead of displaying the correct error message

2016-07-16 Thread Xiang Gao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiang Gao updated SPARK-16586: -- Description: When trying to run spark on a machine that cannot provide enough memory for java to use,

[jira] [Updated] (SPARK-16586) spark-class crash with "[: too many arguments" instead of displaying the correct error message

2016-07-16 Thread Xiang Gao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiang Gao updated SPARK-16586: -- Description: When trying to run spark on a machine that cannot provide enough memory for java to use,

[jira] [Created] (SPARK-16586) spark-class crash with "[: too many arguments" instead of displaying the correct error message

2016-07-16 Thread Xiang Gao (JIRA)
Xiang Gao created SPARK-16586: - Summary: spark-class crash with "[: too many arguments" instead of displaying the correct error message Key: SPARK-16586 URL: https://issues.apache.org/jira/browse/SPARK-16586

[jira] [Updated] (SPARK-16542) bugs about types that result an array of null when creating dataframe using python

2016-07-15 Thread Xiang Gao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiang Gao updated SPARK-16542: -- Description: This is a bugs about types that result an array of null when creating DataFrame using

[jira] [Updated] (SPARK-16542) bugs about types that result an array of null when creating dataframe using python

2016-07-15 Thread Xiang Gao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiang Gao updated SPARK-16542: -- Description: This is a bugs about types that result an array of null when creating DataFrame using

[jira] [Updated] (SPARK-16542) bugs about types that result an array of null when creating dataframe using python

2016-07-14 Thread Xiang Gao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiang Gao updated SPARK-16542: -- Description: This is a bugs about types that result an array of null when creating DataFrame using

[jira] [Updated] (SPARK-16542) bugs about types that result an array of null when creating dataframe using python

2016-07-14 Thread Xiang Gao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiang Gao updated SPARK-16542: -- Description: This is a bugs about types that result an array of null when creating DataFrame using

[jira] [Updated] (SPARK-16542) bugs about types that result an array of null when creating dataframe using python

2016-07-14 Thread Xiang Gao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiang Gao updated SPARK-16542: -- Description: This is a bugs about types that result an array of null when creating DataFrame using

[jira] [Updated] (SPARK-16542) bugs about types that result an array of null when creating dataframe using python

2016-07-14 Thread Xiang Gao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiang Gao updated SPARK-16542: -- Description: This is a bugs about types that result an array of null when creating dataframe using

[jira] [Updated] (SPARK-16542) bugs about types that result an array of null when creating dataframe using python

2016-07-14 Thread Xiang Gao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiang Gao updated SPARK-16542: -- Description: This is a bugs about types that result an array of null when creating dataframe using

[jira] [Updated] (SPARK-16542) bugs about types that result an array of null when creating dataframe using python

2016-07-14 Thread Xiang Gao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiang Gao updated SPARK-16542: -- Description: This is a bugs about types that result an array of null when creating dataframe using

[jira] [Updated] (SPARK-16542) bugs about types that result an array of null when creating dataframe using python

2016-07-14 Thread Xiang Gao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiang Gao updated SPARK-16542: -- Description: This is a bugs about types that result an array of null when creating dataframe using

[jira] [Updated] (SPARK-16542) bugs about types that result an array of null when creating dataframe using python

2016-07-14 Thread Xiang Gao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiang Gao updated SPARK-16542: -- Description: This is a bugs about types that result an array of null when creating dataframe using

[jira] [Updated] (SPARK-16542) bugs about types that result an array of null when creating dataframe using python

2016-07-14 Thread Xiang Gao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiang Gao updated SPARK-16542: -- Description: This is a bugs about types that result an array of null when creating dataframe using

[jira] [Updated] (SPARK-16542) bugs about types that result an array of null when creating dataframe using python

2016-07-14 Thread Xiang Gao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiang Gao updated SPARK-16542: -- Description: This is a bugs about types that result an array of null when creating dataframe using

[jira] [Updated] (SPARK-16542) bugs about types that result an array of null when creating dataframe using python

2016-07-14 Thread Xiang Gao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiang Gao updated SPARK-16542: -- Description: This is a bugs about types that result an array of null when creating dataframe using

[jira] [Updated] (SPARK-16542) bugs about types that result an array of null when creating dataframe using python

2016-07-14 Thread Xiang Gao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiang Gao updated SPARK-16542: -- Description: This is a bugs about types that result an array of null when creating dataframe using

[jira] [Updated] (SPARK-16542) bugs about types that result an array of null when creating dataframe using python

2016-07-14 Thread Xiang Gao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiang Gao updated SPARK-16542: -- Description: This is a bugs about types that result an array of null when creating dataframe using

[jira] [Updated] (SPARK-16542) bugs about types that result an array of null when creating dataframe using python

2016-07-14 Thread Xiang Gao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiang Gao updated SPARK-16542: -- Description: This is a bugs about types that result an array of null when creating dataframe using

[jira] [Created] (SPARK-16542) bugs about types that result an array of null when creating dataframe using python

2016-07-14 Thread Xiang Gao (JIRA)
Xiang Gao created SPARK-16542: - Summary: bugs about types that result an array of null when creating dataframe using python Key: SPARK-16542 URL: https://issues.apache.org/jira/browse/SPARK-16542

[jira] [Updated] (SPARK-16352) change sbin scripts to allow running spark foregroud

2016-07-02 Thread Xiang Gao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiang Gao updated SPARK-16352: -- Component/s: (was: Deploy) Spark Core > change sbin scripts to allow running

[jira] [Updated] (SPARK-16352) change sbin scripts to allow running spark foregroud

2016-07-02 Thread Xiang Gao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiang Gao updated SPARK-16352: -- Description: change sbin scripts to allow running spark foregroud

[jira] [Created] (SPARK-16352) change sbin scripts to allow running spark foregroud

2016-07-02 Thread Xiang Gao (JIRA)
Xiang Gao created SPARK-16352: - Summary: change sbin scripts to allow running spark foregroud Key: SPARK-16352 URL: https://issues.apache.org/jira/browse/SPARK-16352 Project: Spark Issue Type: